A Friday 05 December 2008, Andrew Collette escrigué:
Another possibility would be to use HDF5 as a data container. It
supports the fletcher32 filter [1] which basically computes a
chuksum for evey data chunk written to disk and then always check
that the data read satifies the checksum
On Fri, Dec 05, 2008 at 06:59:25PM -0500, Pierre GM wrote:
Here's the latest version of genloadtxt, with some recent corrections. With
just a couple of tweaking, we end up with some decent speed: it's still
slower than np.loadtxt, but only 15% so according to the test at the end of
the
OK so maybe I should
(1) not add some sort of checksum type functionality to my read/write
methods
these read/write methods simply read/write numpy arrays to a
binary file which contains one or more numpy arrays (and nothing else).
(2) replace my binary files iwith either HDF5 or
