iostreams

https://github.com/reidmorrison/iostreams

IOStreams makes file formats, compression (gzip, zip, bzip2), encryption (PGP, symmetric), and storage location (local file, S3, SFTP, HTTP) transparent to your application code. Files of any size are read and written one block at a time, without loading the entire file into memory.