Compression

Links

• Zstandard - Fast real-time compression algorithm. (HN) (HN 2)

• Orz - General purpose data compressor written in rust.

• FiniteStateEntropy - New Generation Entropy coders.

• Snappy - Fast compressor/decompressor.

• UPX - Advanced executable file compressor.

• gzip-js - Pure JavaScript implementation of the GZIP file format.

• Blosc - Blocking, shuffling and lossless compression library. (HN)

• wasm-flate - Fastest compression and decompression in the browser.

• zlib - General purpose data compression library.

• zlib-ng - zlib data compression library for the next generation systems.

• LZ4 - Extremely Fast Compression Algorithm. (Web) (HN)

• How LZ4 works (2016)

• Handbook of Data Compression (2010)

• Faster integer compression in Go with SIMD using StreamVByte codec

• fast_rsync - Optimized implementation of librsync in pure Rust.

• SDefl - Small bare bone lossless compression library in ANSI C (ISO C90) that implements the Deflate (RFC 1951) compressed data format specification standard.

• Pixz - Parallel, indexed xz compressor.

• Flywheel: Google’s Data Compression Proxy for the Mobile Web

• Opus - Codec for interactive speech and audio transmission over the Internet.

• minizip - Zip manipulation library written in C that is supported on Windows, macOS, and Linux.

• Comparing zstd/gzip/bzip2/lzma/xz Compression (2020) (Lobsters)

• ZFP - Compressed format for representing multidimensional floating-point and integer arrays.

• PyTorch Implementation of the CVPR'19 Paper "Practical Full Resolution Learned Lossless Image Compression"

• Lossless compression of English messages using GPT-2 (HN) (Code)

• Visualizing gzip compression with Python (2020) (HN)

• The Hitchhiker's Guide to Compression (Code) (HN)

• Miniz - Single C source file zlib-replacement library.

• Rationale for a Large Text Compression Benchmark (2009)

• LZSA - Byte-aligned, efficient lossless packer that is optimized for fast decompression on 8-bit micros.

• pigz - Parallel implementation of gzip for modern multi-processor, multi-core machines.

• Precomp - Command line precompressor that can be used to further compress files that are already compressed.

• pako - High speed zlib port to javascript, works in browser & node.js.

• A System to Transparently Compress Hundreds of Petabytes of Image

• Kanzi - Modern, modular, expendable and efficient lossless data compressor implemented in Go.

• Data Compression With Arithmetic Coding (2014)

• Snappy - Snappy compression format in the Go programming language.

• Semantic Compression (2014)

• fflate - High performance (de)compression in an 8kB package.

• etcpak - Extremely fast Ericsson Texture Compression and S3 Texture Compression (DXT1/DXT5) utility.

• Zopfli Compression Algorithm - Compression library programmed in C to perform very good, but slow, deflate or zlib compression.

• python-blosc - Python wrapper for the extremely fast Blosc compression library.

• zip - Portable, simple zip library written in C.