Smart open Utils for streaming large files (S3, HDFS, gzip, bz2...) See also python PyFilesystem2 - Python's Filesystem abstraction layer Favorite site Github - piskvorky/smart_open