Hi Tuan,
with that many time steps, you might want to organize the time hierarchically, like having a group of hundred time groups, so 100 x 100 time groups cover the 10.000 timesteps. It's probably inefficient to have 10.000 timesteps or more in the same group, though I don't have experience (yet) with that scenario. It would also be inefficient if all your datasets per time step are pretty small. It might be better in that case to use a multidimensional dataset with one varying dimension, and this dimension being the time, such that you can append data as it flows and you get new ones.
I don't use IDL, so I don't know which constraints IDL would give on the HDF5 layout. If IDL is your primary target, it might be best to investigate what data layout IDL can handle best.
Werner
On Thu, 08 Dec 2011 07:01:36 -0600, Hoang Trong Minh Tuan <[email protected]> wrote:
Hi Dr. Werner,I'm doing the simulation of cells. In such case, one group is a snapshot at a single time point of the system. As such, I will have tens of thousands of such groups in a file; or maybe multiple files, each file contains thousands of groups. Also, I want to generate the video from these snapshots using IDL. Would your suggestion still be the reasonable approach or should I do in a different way? . Thank you!Bests,Tuan
On Thu, Dec 8, 2011 at 2:28 AM, Werner Benger <[email protected]> wrote:Hi Tuan,why don't you put all datasets which belong to a specific time into a group, one group for each timestep, and attach time information (physical time, seconds, float attribute) as attribute to this group?WernerOn Thu, 08 Dec 2011 00:40:34 -0600, Hoang Trong Minh Tuan <[email protected]> wrote:
Hi all,I am doing simulation in which I need to keep track of time information and 2d/3d data at each time step ( I may have more than one arrays). My question is what is the best way to store such data. Should I keep 2 separate dataset, one to store time, and one to store 2d/3d data; or I can combine them into a special dataset (which is I don't know)?Thanks a lot,Tuan--___________________________________________________________________________
Dr. Werner Benger Visualization Research
Laboratory for Creative Arts and Technology (LCAT)
Center for Computation & Technology at Louisiana State University (CCT/LSU)
211 Johnston Hall, Baton Rouge, Louisiana 70803
Tel.: +1 225 578 4809 Fax.: +1 225 578-5362
--
___________________________________________________________________________
Dr. Werner Benger Visualization Research
Laboratory for Creative Arts and Technology (LCAT)
Center for Computation & Technology at Louisiana State University (CCT/LSU)
211 Johnston Hall, Baton Rouge, Louisiana 70803
Tel.: +1 225 578 4809 Fax.: +1 225 578-5362
Dr. Werner Benger Visualization Research
Laboratory for Creative Arts and Technology (LCAT)
Center for Computation & Technology at Louisiana State University (CCT/LSU)
211 Johnston Hall, Baton Rouge, Louisiana 70803
Tel.: +1 225 578 4809 Fax.: +1 225 578-5362
_______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
