Hi again, Unfortunately I let some inefficiency in Blosc 1.1 code to pass through. 1.1.1 should fix this (i.e. it should be 2x or 3x faster that 1.1 on threaded and small data chunk scenarios).
Also, a new mailing list for Blosc discussion has been setup. =============================================================== Announcing Blosc 1.1.1 A blocking, shuffling and lossless compression library =============================================================== What is new? ============ - Added code to avoid calling blosc_set_nthreads more than necessary. That will improve performance up to 3x or more, specially for small chunksizes (< 1 MB). For more info, please see the RELEASE_NOTES.txt file. What is it? =========== Blosc (http://blosc.pytables.org) is a high performance compressor optimized for binary data. It has been designed to transmit data to the processor cache faster than the traditional, non-compressed, direct memory fetch approach via a memcpy() OS call. Blosc is the first compressor (that I'm aware of) that is meant not only to reduce the size of large datasets on-disk or in-memory, but also to accelerate memory-bound computations. Download sources ================ Please go to: http://blosc.pytables.org/sources/ and download the stable release from here. Blosc is distributed using the MIT license, see LICENSES/BLOSC.txt for details. Mailing list ============ There is an official Blosc blosc mailing list at: [email protected] http://groups.google.es/group/blosc ---- **Enjoy data!** -- Francesc Alted _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
