I haven't worked with external links myself yet, but I think you can
just link an object from another HDF5 file (like a group or dataset)
into an HDF5 file, and once you iterate over the main HDF5 file, the
application would no longer know where the data actually come from,
it's just one logical HDF5 file.
Cited from:
http://www.hdfgroup.org/HDF5/doc/RM/RM_H5L.html#Link-CreateExternal
"H5Lcreate_external creates a new soft link to an external object, w
hich is an object in a different HDF5 file from the location of the link. "
Werner
On Mon, 19 Apr 2010 15:01:01 -0400, <[email protected]> wrote:
Werner,
Thanks for the reply. Yes, that is precisely what I would like to do. I
thought I recalled that "external links" were for non-HDF5 files though.
Perhaps I am mistaken.
So would/could a client use the HDF5 files transparently as though they
were a single file?
Kirk
You should be able to set up both a harddisk and memory HDF5 file and make
external links from one to the other and vice versa. Would that do the
job?
Werner
On Mon, 19 Apr 2010 13:37:24 -0400, Kirk Harrison <[email protected]>
wrote:
Does HDF5 support construction of a virtual HDF5 file composed of both
local disk (e.g., H5FD_SEC2, H5FD_STDIO) and memory-based files
(e.g., H5FD_CORE) possibly through the use of the H5FD_FAMILY driver?
Application
|
|
HDF5 Virtual File Layer (VLF)
( H5FD_FAMILY )
| |
| |
H5FD_CORE H5FD_STDIO
| |
| |
Memory Hard Drive
I also would like to create an HDF5 file that has a small and fast memory
cache for incoming live data and periodically write its contents to
storage
for longer term retrieval.
It is not clear to me through the documentation whether the H5FD_FAMILY
is only applicable to combining local disk (i.e. Hard Drive) based file
drivers.
The goal that I'm shooting for is seamless access across both a
memory-based file and one that is stored on a hard disk.
Regards, Kirk
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
--
___________________________________________________________________________
Dr. Werner Benger Visualization Research
Laboratory for Creative Arts and Technology (LCAT)
Center for Computation & Technology at Louisiana State University
(CCT/LSU)
211 Johnston Hall, Baton Rouge, Louisiana 70803
Tel.: +1 225 578 4809 Fax.: +1 225 578-5362
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
--
___________________________________________________________________________
Dr. Werner Benger Visualization Research
Laboratory for Creative Arts and Technology (LCAT)
Center for Computation & Technology at Louisiana State University (CCT/LSU)
211 Johnston Hall, Baton Rouge, Louisiana 70803
Tel.: +1 225 578 4809 Fax.: +1 225 578-5362
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
