A Monday 19 April 2010 19:37:24 Kirk Harrison escrigué: > Does HDF5 support construction of a virtual HDF5 file composed of both > local disk (e.g., H5FD_SEC2, H5FD_STDIO) and memory-based files (e.g., > H5FD_CORE). possibly through the use of the H5FD_FAMILY driver? > > Application > > > HDF5 Virtual File Layer (VLF) > ( H5FD_FAMILY ) > > > H5FD_CORE H5FD_STDIO > > > Memory Hard Drive > > I also would like to create an HDF5 file that has a small and fast memory > cache for incoming live data and periodically write its contents to storage > for longer term retrieval. > > It is not clear to me through the documentation whether the H5FD_FAMILY is > only applicable to combining local disk (i.e. Hard Drive) based file > drivers. > > The goal that I'm shooting for is seamless access across both a > memory-based file and one that is stored on a hard disk.
If I were you I would not bother too much in having different media for keeping your files: just take advantage of OS filesystem cache. When you have a small file that is accessed frequently, it is loaded in memory by the OS, so the access to it is made at memory speed, no disk speed. In addition, letting the OS to load in memory the data that is most accessed in your filesystem is probably the best way towards a sensible usage of computer resources. -- Francesc Alted _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
