# Compression

## Links

* [Zstandard](https://github.com/facebook/zstd) - Fast real-time compression algorithm. ([HN](https://news.ycombinator.com/item?id=24714854)) ([HN 2](https://news.ycombinator.com/item?id=25455314))
* [Orz](https://github.com/richox/orz) - General purpose data compressor written in rust.
* [FiniteStateEntropy](https://github.com/Cyan4973/FiniteStateEntropy) - New Generation Entropy coders.
* [Snappy](https://github.com/google/snappy) - Fast compressor/decompressor.
* [UPX](https://github.com/upx/upx) - Advanced executable file compressor.
* [gzip-js](https://github.com/beatgammit/gzip-js) - Pure JavaScript implementation of the GZIP file format.
* [Blosc](https://github.com/Blosc/c-blosc) - Blocking, shuffling and lossless compression library. ([HN](https://news.ycombinator.com/item?id=23484342))
* [wasm-flate](https://github.com/drbh/wasm-flate) - Fastest compression and decompression in the browser.
* [zlib](https://github.com/madler/zlib) - General purpose data compression library.
* [zlib-ng](https://github.com/zlib-ng/zlib-ng) - zlib data compression library for the next generation systems.
* [LZ4](https://github.com/lz4/lz4) - Extremely Fast Compression Algorithm. ([Web](https://lz4.github.io/lz4/)) ([HN](https://news.ycombinator.com/item?id=25915274))
* [How LZ4 works (2016)](http://ticki.github.io/blog/how-lz4-works/)
* [Handbook of Data Compression (2010)](https://www.springer.com/gp/book/9781848829022)
* [Faster integer compression in Go with SIMD using StreamVByte codec](https://github.com/rleiwang/svb)
* [fast\_rsync](https://github.com/dropbox/fast_rsync) - Optimized implementation of librsync in pure Rust.
* [SDefl](https://github.com/vurtun/sdefl) - Small bare bone lossless compression library in ANSI C (ISO C90) that implements the Deflate (RFC 1951) compressed data format specification standard.
* [Pixz](https://github.com/vasi/pixz) - Parallel, indexed xz compressor.
* [Flywheel: Google’s Data Compression Proxy for the Mobile Web](https://colin-scott.github.io/personal_website/research/nsdi15.pdf)
* [Opus](https://github.com/xiph/opus) - Codec for interactive speech and audio transmission over the Internet.
* [minizip](https://github.com/nmoinvaz/minizip) - Zip manipulation library written in C that is supported on Windows, macOS, and Linux.
* [Comparing zstd/gzip/bzip2/lzma/xz Compression (2020)](https://etbe.coker.com.au/2020/06/06/comparing-compression/) ([Lobsters](https://lobste.rs/s/wd79sy/comparing_zstd_gzip_bzip2_lzma_xz))
* [ZFP](https://github.com/LLNL/zfp) - Compressed format for representing multidimensional floating-point and integer arrays.
* [PyTorch Implementation of the CVPR'19 Paper "Practical Full Resolution Learned Lossless Image Compression"](https://github.com/fab-jul/L3C-PyTorch)
* [Lossless compression of English messages using GPT-2](http://textsynth.org/sms.html) ([HN](https://news.ycombinator.com/item?id=23618465)) ([Code](https://bellard.org/nncp/gpt2tc.html))
* [Visualizing gzip compression with Python (2020)](https://brennan.io/2020/09/22/compression-curves/) ([HN](https://news.ycombinator.com/item?id=24563372))
* [The Hitchhiker's Guide to Compression](https://go-compression.github.io/) ([Code](https://github.com/go-compression/go-compression.github.io)) ([HN](https://news.ycombinator.com/item?id=24691422))
* [Miniz](https://github.com/richgel999/miniz) - Single C source file zlib-replacement library.
* [Rationale for a Large Text Compression Benchmark (2009)](http://mattmahoney.net/dc/rationale.html)
* [LZSA](https://github.com/emmanuel-marty/lzsa) - Byte-aligned, efficient lossless packer that is optimized for fast decompression on 8-bit micros.
* [pigz](https://github.com/madler/pigz) - Parallel implementation of gzip for modern multi-processor, multi-core machines.
* [Precomp](https://github.com/schnaader/precomp-cpp) - Command line precompressor that can be used to further compress files that are already compressed.
* [pako](https://github.com/nodeca/pako) - High speed zlib port to javascript, works in browser & node.js.
* [A System to Transparently Compress Hundreds of Petabytes of Image](https://www.usenix.org/conference/nsdi17/technical-sessions/presentation/horn)
* [Kanzi](https://github.com/flanglet/kanzi-go) - Modern, modular, expendable and efficient lossless data compressor implemented in Go.
* [Data Compression With Arithmetic Coding (2014)](https://marknelson.us/posts/2014/10/19/data-compression-with-arithmetic-coding.html)
* [Snappy](https://github.com/golang/snappy) - Snappy compression format in the Go programming language.
* [Semantic Compression (2014)](https://caseymuratori.com/blog_0015)
* [fflate](https://github.com/101arrowz/fflate) - High performance (de)compression in an 8kB package.
* [etcpak](https://github.com/wolfpld/etcpak) - Extremely fast Ericsson Texture Compression and S3 Texture Compression (DXT1/DXT5) utility.
* [Zopfli Compression Algorithm](https://github.com/google/zopfli) - Compression library programmed in C to perform very good, but slow, deflate or zlib compression.
* [python-blosc](https://github.com/Blosc/python-blosc) - Python wrapper for the extremely fast Blosc compression library.
* [zip](https://github.com/kuba--/zip) - Portable, simple zip library written in C.