Hi Darren, On Jul 18, 2011, at 9:34 AM, Darren Dale wrote:
> On Mon, Jul 18, 2011 at 9:30 AM, Quincey Koziol <[email protected]> wrote: >> Hi Konrad, >> >> On Jul 18, 2011, at 7:39 AM, Konrad wrote: >> >>> I wonder about the existing techniques aimed at avoiding data file >>> corruption, be it from concurrent writes or process/machine death. I am >>> currently employing serialized copy-on-write semantics, but this will only >>> work for infrequent writes on small files. >> >> We are working on adding a couple of mechanisms to the HDF5 library >> to help with the process/machine death issue. > > Is there any information concerning data corruption in hdf5 from > concurrent writes? I just visited with a group that uses a distributed > data acquisition system to create and update hdf5 files, in which case > different processes could attempt to update different portions of an > hdf5 file concurrently. Is there any discussion in the hdf5 > documentation that would address this issue? Sorry for the tardy reply - concurrent writes to HDF5 files are not supported (except under the MPI programming model). Here's our FAQ entry on how to get something like this working though: http://www.hdfgroup.org/hdf5-quest.html#gconc Quincey _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
