On Mon, Jul 18, 2011 at 9:30 AM, Quincey Koziol <[email protected]> wrote: > Hi Konrad, > > On Jul 18, 2011, at 7:39 AM, Konrad wrote: > >> I wonder about the existing techniques aimed at avoiding data file >> corruption, be it from concurrent writes or process/machine death. I am >> currently employing serialized copy-on-write semantics, but this will only >> work for infrequent writes on small files. > > We are working on adding a couple of mechanisms to the HDF5 library to > help with the process/machine death issue.
Is there any information concerning data corruption in hdf5 from concurrent writes? I just visited with a group that uses a distributed data acquisition system to create and update hdf5 files, in which case different processes could attempt to update different portions of an hdf5 file concurrently. Is there any discussion in the hdf5 documentation that would address this issue? Thanks, Darren _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
