Hi Alok, Please try to run h5stat tool (http://www.hdfgroup.org/HDF5/doc/RM/Tools.html#Tools-Stat) to see how space is allocated in the file for raw data and HDF5 metadata.
Elena ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elena Pourmal The HDF Group http://hdfgroup.org 1800 So. Oak St., Suite 203, Champaign IL 61820 217.531.6112 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ On Aug 26, 2012, at 9:15 PM, alokjadhav wrote: > Hi, > > could someone comment on this? I am still not sure why new format with less > number of elements is taking so much more storage space. One more > observation is that > > format 1 has around 300 groups ..each with 2 datasets. -> total 600 > datasets. > format 2 has around 200 groups .. each with 11 datasets -> total of 2200 > datasets. > > in fromat 1, each dataset is a double array where as in format 2, each > dataset is a complex type. (doubles and ints mixed). > > What is the overhead of having a complex dtype vs a double array. having > 2200 datasets vs 600 datasets, can it double the size of the hdf5 file? i am > basically converting horizontal data into vertical data with more datasets. > > Regards, > Alok > > > > -- > View this message in context: > http://hdf-forum.184993.n3.nabble.com/why-changing-the-format-had-adverse-effect-tp4025330p4025344.html > Sent from the hdf-forum mailing list archive at Nabble.com. > > _______________________________________________ > Hdf-forum is for HDF software users discussion. > [email protected] > http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
_______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
