here is one idea: I would discretize my time dimension (bin these) and just
store the data in a multidimensional data set, perhaps with the outermost
dimension being time. Then store the primary data in the inner dimension(s) one
layer of which could be the time variable (as float32) if you really that much
time precision. If you don't need time stored at a granularity beyond your bin
interval width, you will save a lot of space and achieve better computational
efficiency.
Storing data this way would allow you very efficient compression rates as
well, and lend itself to video animation later in whatever environment you want
to do that. Just some thoughts.
Cheers,
Joe Glassy
Sent from my iPad
On Dec 8, 2011, at 5:01, Hoang Trong Minh Tuan <[email protected]>
wrote:
> Hi Dr. Werner,
> I'm doing the simulation of cells. In such case, one group is a snapshot
> at a single time point of the system. As such, I will have tens of thousands
> of such groups in a file; or maybe multiple files, each file contains
> thousands of groups. Also, I want to generate the video from these snapshots
> using IDL. Would your suggestion still be the reasonable approach or should I
> do in a different way? . Thank you!
>
> Bests,
> Tuan
>
>
> On Thu, Dec 8, 2011 at 2:28 AM, Werner Benger <[email protected]> wrote:
> Hi Tuan,
>
> why don't you put all datasets which belong to a specific time into a group,
> one group for each timestep, and attach time information (physical time,
> seconds, float attribute) as attribute to this group?
>
> Werner
>
>
> On Thu, 08 Dec 2011 00:40:34 -0600, Hoang Trong Minh Tuan
> <[email protected]> wrote:
>
> Hi all,
> I am doing simulation in which I need to keep track of time information
> and 2d/3d data at each time step ( I may have more than one arrays). My
> question is what is the best way to store such data. Should I keep 2 separate
> dataset, one to store time, and one to store 2d/3d data; or I can combine
> them into a special dataset (which is I don't know)?
> Thanks a lot,
>
>
> Tuan
>
>
>
>
> --
> ___________________________________________________________________________
> Dr. Werner Benger Visualization Research
> Laboratory for Creative Arts and Technology (LCAT)
> Center for Computation & Technology at Louisiana State University (CCT/LSU)
> 211 Johnston Hall, Baton Rouge, Louisiana 70803
> Tel.: +1 225 578 4809 Fax.: +1 225 578-5362
>
> _______________________________________________
> Hdf-forum is for HDF software users discussion.
> [email protected]
> http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
