On 19. des. 2011, at 19:46, Mark Miller wrote: > Hmm. Never thought of this before but one of the first things that comes > to mind is whether rsync supports 'diffing' of HDF5 binary, compressed, > chunked files? > > My naive understanding of tools like rsync is that they come > pre-packaged with the ability to diff ascii text files but not binary > files of any kind.
It looks like you're wrong. Proof by Wikipedia: "Unlike diff, the process of creating a delta file has two steps: first a signature file is created from file A, and then this (relatively small) signature and file B are used to create the delta file. Also unlike diff, rdiff works well with binary files." https://en.wikipedia.org/wiki/Rsync Compression might screw with that, though. An idea is to use rsync compression instead, and leave the hdf5 files uncompressed. From man rsync: -z, --compress compress file data during the transfer Cheers Paul _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
