File Storage (S3, GCS, etc)#

Smart Open#

Smart Open: Easiest way to read and write files from storage such as S3, GCS, Azure Blob Storage, HDFS, local filesystem, etc.

  • Drop-in replacement from python’s open()

  • On-the-fly decompression for a variety of different formats (.gz, .bz2)

  • Easily iterate over S3 bucket contents with iter_bucket()

  • Skip the boilerplate!

pip install smart-open

🌟 Github: https://github.com/RaRe-Technologies/smart_open

📖 More examples: Documentation(https://github.com/RaRe-Technologies/smart_open/blob/develop/howto.md)