Re: [Hdf-forum] Could not load file or assembly 'HDF5DotNet.dll' or one of its dependencies

2011-02-11 Thread Gerd Heber
Did you copy szip.dll? This is an oversight in the document. (You don't need those .lib files in 'C:\Windows\System32'.) Best, G. -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of TigerPVR Sent: Sunday, February 06, 2011 1:05 PM

Re: [Hdf-forum] Read and wrote string attributes

2011-03-01 Thread Gerd Heber
Pavel, how are you? If you want to write a fixed-length string scalar attribute, here's a snippet of IronPython code that will get you started. def addScalarStringAttribute(dset): string ='ABCD' dspace = H5S.create(H5S.H5SClass.SCALAR) dtype = H5T.copy(H5T.H5Type.C_S1)

Re: [Hdf-forum] Read and wrote string attributes

2011-03-06 Thread Gerd Heber
Pavel, how are you? -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Pavel Rudchenko Sent: Sunday, March 06, 2011 4:59 PM To: HDF Users Discussion List Subject: Re: [Hdf-forum] Read and wrote string attributes Hello,

[Hdf-forum] EVO Booking : HDF5DotNet from Thu, 14 Apr 11 12:30 -0500 (CDT)

2011-03-31 Thread Gerd Heber
) Hello Gerd Heber, You have BOOKED a meeting in EVO (http://evo.caltech.edu). Title: HDF5DotNet Description:A better .NET wrapper for HDF5 Community: Universe Password: HDF5.NET Meeting Access Information: - Meeting URL http://evo.caltech.edu/evoNext/koala.jnlp

[Hdf-forum] HDF5DotNet Virtual Meeting Notes (04/14/11)

2011-04-15 Thread Gerd Heber
Here're the meeting minutes from yesterday's HDF5DotNet virtual meeting on EVO. Attendees: Jesse Lai, Scott Mitchell, Jason P., Gerd Heber (My sincere apologies to Jason. I scribbled down his last name, but can't find it anymore.) The following topics were discussed: HDF5DotNet in its current

Re: [Hdf-forum] Assertion failed! error when exiting program (HDF5 1.8.6)

2011-05-24 Thread Gerd Heber
Josh, the assertion comes out of H5F_close (in the unmanaged library). It appears that the application is trying to close the same file twice in the context of the same process. (H5F_close sets the file id to -1 and that would trip the assertion in the next round.) Separate processes (but not

Re: [Hdf-forum] Assertion failed! error when exiting program (HDF5 1.8.6)

2011-05-24 Thread Gerd Heber
Josh, you definitely should call H5F.close(). I need to consult with the local experts on what the library does in response to a device/file system removal (if anything). Maybe H5F_close doesn't get called twice. Maybe the library attempts some kind of forceful cleanup and by the time your

Re: [Hdf-forum] PInvokeStackImbalance was detected from HDFDotNet 1.8.7

2011-05-27 Thread Gerd Heber
Josha, which unmanaged binaries are you using? G. -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of josha Sent: Thursday, May 26, 2011 5:15 PM To: hdf-forum@hdfgroup.org Subject: [Hdf-forum] PInvokeStackImbalance was detected

Re: [Hdf-forum] Fwd: GZIP Compression and h5repack

2011-07-08 Thread Gerd Heber
Bas, how are you? Attached is an IronPython (http://ironpython.codeplex.com/) script that you might want to run and recreate in C#. (IronPython uses HDF5DotNet.dll the same way you do from C#.) It creates a compressed, chunked dataset of a compound type (int, float, double). 'h5dump -p -H

Re: [Hdf-forum] HDF JAVA AND HASHTABLE

2011-07-19 Thread Gerd Heber
Kim, how are you? Out of curiosity, I would like to clarify something. My naïve impression was that, if your keys are French words, the dataset can't be very large. Let's say that a highly educated English speaker has about 300,000 words in his/her vocabulary. Let's give a French speaker 500,000

Re: [Hdf-forum] HDF5DotNet assembly

2011-08-28 Thread Gerd Heber
-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Gerd Heber Sent: Thursday, August 25, 2011 8:49 AM To: 'HDF Users Discussion List' Subject: Re: [Hdf-forum] HDF5DotNet assembly Don, how are you? Adding an assembly reference should be all that's needed. Note

Re: [Hdf-forum] HDF5DotNet memory leak when expanding with HD5.setExtent?

2011-09-02 Thread Gerd Heber
You're welcome. Yes, I'm sorry, I forgot to mention that H5PT is currently not funded/supported in HDF5DotNet. You still might want to check it out. What if that 10klines/sec turns into 500k/lines in two years? And, if you really like it, maybe you want to coerce us with a small donation into

Re: [Hdf-forum] H5Array Conversion

2011-09-04 Thread Gerd Heber
Don, currently, there's no way to do that conversion and, frankly, H5ArrayT is not intended to be used as some kind of array substitute. The only reason to use H5ArrayT is to pass .NET arrays to methods like H5D.read/write(..., new H5ArrayT(your_array)). Why can't you just hang on to 'your_array'

Re: [Hdf-forum] H5Array Conversion

2011-09-04 Thread Gerd Heber
Don, how about this: byte[] my_array = ConvertToBytes(buffer); H5A.read(curAttID, curAttNativeType, new H5ArrayByte(my_array)); // now do something with my_array H5ArrayT is really just a shell game. If you look at the (C++) source code, you'll see that no new arrays/elements are being

Re: [Hdf-forum] H5F.flush from HDF5DotNet?

2011-10-13 Thread Gerd Heber
Barry, H5F::flush will be back in the HDF5DotNet release that comes out with 1.8.8. Best, G. -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum- boun...@hdfgroup.org] On Behalf Of Barry Wark Sent: Friday, September 30, 2011 11:51 AM To: hdf-forum@hdfgroup.org

Re: [Hdf-forum] H5Literate and H5_INDEX_CRT_ORDER

2011-10-24 Thread Gerd Heber
Tobias, yes, it appears that the creation order is not tracked. As you know, a creation property must be set upon group creation via H5Pset_link_creation_order (http://www.hdfgroup.org/HDF5/doc/RM/RM_H5P.html#Property-SetLinkCreationOrd er) Currently, setting this property is not supported in

Re: [Hdf-forum] HDF5/XML synergy

2011-11-21 Thread Gerd Heber
Rhys, thanks for the comment and sorry for the delay. (Just got back from travel...) On the data side, using a skeletal HDF5/XML dump of a datafile to check that it is valid according to some domain-specific schema will be handy. I suggest adding recommended HDF5 attributes with particular

Re: [Hdf-forum] Read hdf5 string dataset with C#

2011-11-23 Thread Gerd Heber
Yaqiang, how are you? Your code is pretty close, but misses a technical detail. The 'StructMetadata.x' scalar datasets of fixed-length ASCII encoded strings. Strings in .NET are Unicode-based and use 2-byte character representations (as opposed to 1-byte for ASCII). It'd be nice to directly do a

Re: [Hdf-forum] HDF5.net Compound datatype with variable length string

2012-01-23 Thread Gerd Heber
Jesse, how are you? Please have a look at the attached IronPython script. It shows how to write a compound type with two integer members and one variable-length string member. I'm sure there are more elegant ways, but the brute force writing of a byte array is effective. We use BitConverter to get

Re: [Hdf-forum] Reading variable-length strings into fixed-size char array

2012-02-05 Thread Gerd Heber
Andrei, knowing that the lengths of all the strings in the file don't exceed 32 doesn't help. The string type in the file is variable length and not fixed length and the library doesn't do any kind of automatic conversion for you. The call H5Tset_size(strType, 32); is well intended but wrong

Re: [Hdf-forum] Flush in Hdf5DotNet

2012-02-21 Thread Gerd Heber
Karl, yes, this is a known problem and we'll address it as soon as we get around to it. As a workaround, you can use the Id property (of hid_t) of a FileId object and call H5Fflush directly. [DllImport(hdf5dll.dll, CallingConvention=CallingConvention::Cdecl)] extern C herr_t _cdecl

Re: [Hdf-forum] Can't create attributes on named DataType with Hdf5DotNet

2012-02-27 Thread Gerd Heber
Keith, how are you? H5DataTypeId does not derive from H5ObjectWithAttributes because most type handles do not refer to linked or committed HDF5 datatypes, which are the only flavors of datatypes that can be decorated with attributes. My suggestion for a workaround would be to wrap and call H5Oopen

Re: [Hdf-forum] .h5 read query

2012-03-27 Thread Gerd Heber
Bhavini, for starters, get a copy of HDFView http://www.hdfgroup.org/hdf-java-html/hdfview/index.html#download_hdfview Best, G. From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Bhavini Solanki Sent: Tuesday, March 27, 2012 1:35 AM To:

Re: [Hdf-forum] Problem to add HDF5.NET wrapper (dll) to vs 2008

2012-03-28 Thread Gerd Heber
Lukas, all you need is to add a reference to HDF5DotNet.dll . No references are needed for the unmanaged DLLs (hdf5_hldll.dll etc.) I don't have vs2008, but 2010 should be pretty similar. In the 'Add Reference' dialog, are you using the 'Browse' tab to locate HDF5DotNet.dll? Are you sure

Re: [Hdf-forum] Error in FileAccPropList::getCache

2012-04-09 Thread Gerd Heber
Alok, which HDF5DotNet library are you talking about? I'm looking at www.hdf5.net , but I can't see any of the calls from your code snippet. Best, G. -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Jadhav, Alok Sent: Sunday,

Re: [Hdf-forum] HDF5DotNet an unknown compound dataset

2012-04-18 Thread Gerd Heber
Rackamm, how are you? I'M traveling at the moment and will get back to you later in the week/early next week. The general approach I'VE taken involves dynamically generating/loading .NET code. You'd read the dataset into memory as a byte array and then use BitConverter and the information

Re: [Hdf-forum] Read All Available Chunk in a Dataset.

2012-05-10 Thread Gerd Heber
Mathieu, don't worry about the chunks. Just read/write what you need in terms of the dataspace (hyperslab, point selection...) and the library will determine for you which chunks are touched (read/written) by the operation. It'll just return fill values for un-allocated/partially filled chunks.

Re: [Hdf-forum] Read All Available Chunk in a Dataset.

2012-05-10 Thread Gerd Heber
/2012 02:01 PM, Gerd Heber wrote: Mathieu, don't worry about the chunks. Just read/write what you need in terms of the dataspace (hyperslab, point selection...) and the library will determine for you which chunks are touched (read/written) by the operation. It'll just return fill values

Re: [Hdf-forum] Read All Available Chunk in a Dataset.

2012-05-14 Thread Gerd Heber
to store an hyperslab wich describe where the available data is. Thanks for your help Mathieu Quoting Gerd Heber ghe...@hdfgroup.org: That's why I asked you to define the smallest hyperslab or union of hyperslabs, or point selections that cover you chunks and read just those. The library

Re: [Hdf-forum] H5Dread and array organization

2012-05-15 Thread Gerd Heber
Mathieu, you should bear in mind that reading a dataset is logically a mapping between dataspaces. The underlying physical layout in the file is irrelevant for this mapping. Users may not appreciate getting different answers when reading the nominally same datset with different physical layouts.

[Hdf-forum] Celebrating HDF5

2012-05-17 Thread Gerd Heber
Motto: It is the stillest words that bring on the storm. Thoughts that come on doves' feet guide the world. (*) Dear HDF users and dear PowerShell users, While reports from HDF5 1.8.9 release parties are still pouring in from all corners of the planet, we would like to offer you this

Re: [Hdf-forum] HDF5DotNet H5P::create(H5P.PropertyListClass.FILE_ACCESS) fails i.e. returns -1

2012-06-18 Thread Gerd Heber
Mark, have you tried calling H5::Open() before making any other calls to HDF5? BTW, which HDF5DotNet/OS version are you using? G. -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Mark Page Sent: Monday, June 18, 2012 10:34 AM

Re: [Hdf-forum] HDF5 and C#

2012-06-21 Thread Gerd Heber
Greg, how about https://github.com/galpin/HDF5.NET or http://hdf5.net/ ? Best, G. -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of C_gg Sent: Thursday, June 21, 2012 4:18 AM To: hdf-forum@hdfgroup.org Subject: [Hdf-forum] HDF5

Re: [Hdf-forum] HDF5 and installation

2012-06-27 Thread Gerd Heber
But now, I would like to run it... So, I wanted to use these following .dll: hdf5dll.dll, hdf5_hldll.dll, szip.dll, and zlib.dll. The assembly was built against HDF5 1.8.8. You need http://www.hdfgroup.org/ftp/HDF5/releases/hdf5-1.8.8/bin/windows/HDF5188-win 64-shared.zip Make sure that

Re: [Hdf-forum] request/suggestion re: high level libraries and debugging

2012-07-26 Thread Gerd Heber
Would you be interested in XML or JSON snippets rather than clunky BNF? G. -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of John K Sent: Thursday, July 26, 2012 1:20 PM To: HDF Users Discussion List Subject: [Hdf-forum]

Re: [Hdf-forum] HDF5DotNet vs HDFView (write string dataset)

2012-08-13 Thread Gerd Heber
Andy, very odd indeed. Does SMS expect a scalar dataset of a fixed or variable-length string type? Are we sure that it's not finding the dataset or it's finding it and not happy with the content and still saying it's not finding it? (You could verify that by creating a scalar integer dataset

Re: [Hdf-forum] Unique object identifier

2012-08-17 Thread Gerd Heber
Eugen, how are you? Yes, you can concoct something that is unique in the file scope using addresses, but I'd be hesitant to go down that path. I'd invest in a few UUIDs (call it whatever you want) attributes and not look back. They survive repacks and other machinations. True, for existing

Re: [Hdf-forum] Error with H5Oget_info_by_idx on soft links

2012-09-13 Thread Gerd Heber
Calixte, how are you? It's the latter. The documentation is not very precise on this, but HDF5 links aren't HDF5 objects. See section '1.2.2 Group', Figures 5 and 6 in the HDF5 User Guide. http://www.hdfgroup.org/HDF5/doc/UG/ The H5L interface has several functions for inspecting HDF5 links.

[Hdf-forum] Putting on a Good Show with HDF5, ILNumerics, and PowerShell

2012-09-13 Thread Gerd Heber
Title: Putting on a Good Show with HDF5, ILNumerics, and PowerShell Authors: Gerd Heber (The HDF Group), Haymo Kutschbach (ILNumerics) Abstract: In this article, we describe how a simple combination of three freely available tools - HDF5, ILNumerics, and PowerShell - can be used to analyze

Re: [Hdf-forum] Parallel dataset creation: unable to create and link to dataset

2012-09-13 Thread Gerd Heber
Or pass a link creation property list to H5Dcreate2 with H5Pset_create_intermediate_group http://www.hdfgroup.org/HDF5/doc/RM/RM_H5P.html#Property-SetCreateIntermedia teGroup to create missing intermediate groups as a side-effect. G. -Original Message- From:

Re: [Hdf-forum] Missing description in DDL

2012-09-17 Thread Gerd Heber
Calixte, there is no such thing at the moment. The ability to commit dataspaces and link them to a group might be supported in a future version of the library. What is your scenario or use case? Best, G. -Original Message- From: hdf-forum-boun...@hdfgroup.org

Re: [Hdf-forum] free memory for variable length types

2012-11-08 Thread Gerd Heber
I think the problem is that the library currently does not provide a matching H5XYZfree call for some of the resources it allocates for you. Non C APIs compound the problem and lead to the obscure behavior you're seeing. 'free' is a well-intended guess, but still a guess. G. -Original

Re: [Hdf-forum] Reading a HDF5 file with C#/VS2008

2012-11-16 Thread Gerd Heber
The DLLs were made for .NET 4, not a particular version of Visual Studio. (There are also separate DLLs for x86 and x64.) Make sure in your project settings that you are building against the .NET 4 runtime and not 2, or 3.5. G. -Original Message- From: Hdf-forum

Re: [Hdf-forum] Reading a HDF5 file with C#/VS2008

2012-11-16 Thread Gerd Heber
Michael, I don't have VS2008 and can't help you there. VS2008 is just a vehicle. Have you ever used a compiler from the command line? The C# compiler is part of the .NET framework (csc.exe in C:\Windows\Microsoft.NET\Framework64\v4.0.30319 on my machine). and works just fine in a DOS shell or

Re: [Hdf-forum] HDF5DotNet Visual Studio 2010 dll issue

2013-01-02 Thread Gerd Heber
The unmanaged DLLs (szip, zlib, hdf5dll, hdf5_hldll) need to be in a directory in your PATH environment. If you are using the standard binaries from http://www.hdfgroup.org/ftp/HDF5/current/bin/windows/ they are installed in C:\Program Files\HDF Group\HDF5\VERSION\bin. You can add that to the

Re: [Hdf-forum] RESTful HDF5

2013-01-24 Thread Gerd Heber
] On Behalf Of Rob Latham Sent: Thursday, January 24, 2013 2:52 PM To: HDF Users Discussion List Subject: Re: [Hdf-forum] RESTful HDF5 On Tue, Jan 22, 2013 at 08:39:34AM -0600, Gerd Heber wrote: In this document, we specify a REST interface for HDF5 data stores. We describe HDF5 resources, URIs

Re: [Hdf-forum] mongodb compared to HDF5 ?

2013-02-24 Thread Gerd Heber
Guillaume, how are you? This is an interesting question, but there're several omissions and assumptions that make it rather ill-posed. The omissions have to do with what you didn't tell us (and I come back to that in a moment). The assumptions have to do with an unspecified base on which HDF5

Re: [Hdf-forum] mongodb compared to HDF5 ?

2013-02-25 Thread Gerd Heber
Feel free to join FastBit mailing list https://hpcrdm.lbl.gov/pipermail/fastbit-users to post your questions regarding FastBit and FastQuery. Best, G. -Message d'origine- De : Hdf-forum [mailto:hdf-forum-boun...@hdfgroup.org] De la part de Gerd Heber Envoyé : dimanche 24 février 2013 18

Re: [Hdf-forum] Query regarding HDF5

2013-03-18 Thread Gerd Heber
C is binary compatible, no problem there. C++ is another matter. I don't know much about the different FORTRAN flavors. Good luck! G. From: Hdf-forum [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Suman Vajjala Sent: Sunday, March 17, 2013 1:26 AM To: HDF Users Discussion List Subject:

Re: [Hdf-forum] How do people use H5S_NULL?

2013-03-19 Thread Gerd Heber
Andrew, what an interesting question! I can't answer the question, but would like to add an observation that might help finding an answer. HDF5 attributes and datasets represent different uses of what some would refer to as array variables. What is the value of such an array variable? An (HDF5)

Re: [Hdf-forum] PyTables cannot find the HDF5 shared library

2013-04-11 Thread Gerd Heber
Bibudh, you've downloaded the static rather than the dynamic build. You probably want http://www.hdfgroup.org/ftp/HDF5/releases/hdf5-1.8.7/bin/mac-intel/hdf5-1.8. 7-mac-intel-shared.tar.gz or http://www.hdfgroup.org/ftp/HDF5/releases/hdf5-1.8.7/bin/mac-intel-x86_64/hd

[Hdf-forum] FW: Gauging interest in a ODBC Driver for HDF5

2013-04-18 Thread Gerd Heber
From: The HDF Group [mailto:outre...@hdfgroup.ccsend.com] On Behalf Of The HDF Group Sent: Wednesday, April 17, 2013 2:54 PM To: ghe...@hdfgroup.org Subject: Gauging interest in a ODBC Driver for HDF5 http://r20.rs6.net/on.jsp?t=1113102178043.0.1113040920034.945ts=S0891o=ht

[Hdf-forum] HDF Mendeley group

2013-05-01 Thread Gerd Heber
one article, all of us will soon be awe-struck by our ignorance and all the wonderful things others are doing. Thanks, G. Gerd Heber | The HDF Group Applications Architect | 1800 South Oak Street Phone: (217) 531-6109 | Suite 203 Web: www.hdfgroup.org | Champaign, IL 61820