Hi John,
On Apr 13, 2010, at 3:12 PM, John Knutson wrote:
> Quincey Koziol wrote:
>> Hi John,
>>
>> On Apr 12, 2010, at 10:09 AM, John Knutson wrote:
>>
>>> In the mean-time, it seems I can work around the issue by closing and
>>> opening the HDF file again, but being new to HDF5, I'm unsure what the
>>> potential problems are there.
>>>
>>
>> That may be fine, but could you describe your usage scenario a bit more?
>>
>> Quincey
>>
> Okay, we're collecting data in near real time from a number of sources,
> identical in all relevant ways. This leads to roughly 100-200 "messages"
> arriving every 6 seconds. That data needs to be archived, which we are
> currently looking at HDF to do.
Is there only one process writing to the file?
> A small number of applications that use the data are expected to be able to
> get current updates of the data as it's being written. Currently, the data
> being used is stored in flat files, and are tracked in a similar (if not
> identical) method to tail -f. The implementation in HDF will obviously not
> be the same, but we need some way to be able to get file updates at a ~1s
> update rate or less.
Assuming that there is only one process writing to the file, you have
provided a very accurate description for the primary SWMR use case. :-) Until
we have something ready for testing, you can open and close the file according
to the procedure here: http://www.hdfgroup.org/hdf5-quest.html#grdwt
Quincey
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
