On Sunday, 22 May 2016 at 12:12:09 UTC, Martin Nowak wrote:
Yes, LZO, LZ4, or snappy would be good choices. They are real-time compression algorithms, i.e. it's faster to compress and write to main memory than w/o compression.
Yes the LZ compressors are very good for this usecase
Please don't write anything on your own. There is a meta library for those algorithms http://blosc.org/, for which I added Deimos headers http://code.dlang.org/packages/d-blosc.
Agreed. The existing implementations have been fine-tuned for performance, and we should use them as leverage.
