File Storage (S3, GCS, etc)
Contents
File Storage (S3, GCS, etc)#
Smart Open#
Smart Open: Easiest way to read and write files from storage such as S3, GCS, Azure Blob Storage, HDFS, local filesystem, etc.
Drop-in replacement from python’s open()
On-the-fly decompression for a variety of different formats (.gz, .bz2)
Easily iterate over S3 bucket contents with iter_bucket()
Skip the boilerplate!
pip install smart-open
🌟 Github: https://github.com/RaRe-Technologies/smart_open
📖 More examples: Documentation(https://github.com/RaRe-Technologies/smart_open/blob/develop/howto.md)