Hi Paul and Quincey,
This is a known problem. We have some benchmarks results that show similar
behavior (Neil ran benchmarks for 1.6.7 and 1.8.1.; see
http://www.hdfeos.net/workshops/ws12/agenda.php, "Migrating from HDF5 1.6 to
1.8")
After 700000 groups HDF5 becomes really very slow unless latest file format is
used (see below how to use it).
fapl_id = H5Pcreate(H5P_FILE_ACCESS);
H5Pset_libver_bounds(fapl_id, H5F_LIBVER_LATEST, H5F_LIBVER_LATEST);
fid = H5Fcreate(...,...,...,fapl_id);
Elena
On Mar 27, 2010, at 10:28 AM, Quincey Koziol wrote:
> Hi Paul,
>
> On Mar 26, 2010, at 5:24 PM, Paul Zumbo wrote:
>
>>
>> Hello,
>>
>> I am new to HD5.
>>
>>
>> I am trying to create many many number of groups ; however, the below piece
>> of code hangs,
>>
>> chr1_id = H5Gcreate(file_id, "/chr1", H5P_DEFAULT, H5P_DEFAULT,
>> H5P_DEFAULT);
>> for (i = 1; i <= 247249719; i++){
>> k = sprintf(pos, "%d", i);
>> group_id = H5Gcreate(chr1_id, pos, H5P_DEFAULT, H5P_DEFAULT,
>> H5P_DEFAULT);
>> status = H5Gclose(group_id);
>> }
>>
>> whenever i attempt to create, say, 1000 groups, it works just fine..
>> is there a maximum number of groups that an H5 structure supports?
>>
>> am I doing some wrong?
>
> Looks fine to me. What version of the HDF5 library are you using?
>
> Quincey
>
>
> _______________________________________________
> Hdf-forum is for HDF software users discussion.
> [email protected]
> http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
