Hello, I would like to give a status update on the h5diff slowness issue.
Background: 1.8.6 and earlier versions of h5diff had a bug in the attributes comparison. In some cases attributes were not compared at all ;-) When the bug was removed in 1.8.7, a performance issue in HDF5 was exposed. The performance deficiencies in the h5diff code were also not ruled out. We are actively working on the problem, but unfortunately will not be able to provide a fix in the upcoming 1.8.10 release. We will inform the FORUM as soon as the root(s) of the problem and the possible solutions are identified. Thank you! Elena ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elena Pourmal The HDF Group http://hdfgroup.org 1800 So. Oak St., Suite 203, Champaign IL 61820 217.531.6112 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ On Oct 16, 2012, at 3:44 PM, Jonathan Kim wrote: > Hi Gregory, > > We've identified the issue and put it in the bug tracking system. > We will look into the issue. > > If it's possible to send us your HDF5 file, we'd appreciate. > > Thanks for your input! > > Jonathan > > On 10/16/2012 12:50 PM, Gregory Sjaardema wrote: >> We are also seeing this slowdown. I did a little looking and some of the >> issue seems to be in H5O_attr_find_opened_attr. There is a call to >> "num_open_attr = H5F_get_obj_count(loc->file, H5F_OBJ_ATTR | H5F_OBJ_LOCAL, >> FALSE);" >> >> On hdf5 >= 1.8.7, the num_open_attr count keeps increasing on each call. >> For one particular problem I am running, it returns 21153 at the end of >> execution. However, in hdf5 < 1.8.7, the num_open_attr is always 0. >> >> Hope this helps track down the issue; h5diff is unusable for us at the >> current time. >> >> --Greg >> >> >> _______________________________________________ >> Hdf-forum is for HDF software users discussion. >> [email protected] >> http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org > > _______________________________________________ > Hdf-forum is for HDF software users discussion. > [email protected] > http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
_______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
