[Hdf-forum] NATIVE_HBOOL storage

2010-02-03 Thread Mitchell, Scott - IS
I've been working on integrating the output of a new instrument into our system, but when writing the streams to HDF, I was regularly getting out of bounds exceptions. And it took a good bit of searching to discover that the NATIVE_HBOOL types where I was storing several bool fields are

Re: [Hdf-forum] NATIVE_HBOOL storage

2010-02-03 Thread Mitchell, Scott - IS
] NATIVE_HBOOL storage Hi Scott, On Feb 3, 2010, at 12:51 PM, Mitchell, Scott - IS wrote: I've been working on integrating the output of a new instrument into our system, but when writing the streams to HDF, I was regularly getting out of bounds exceptions. And it took a good bit of searching

[Hdf-forum] Attribute existance

2010-03-11 Thread Mitchell, Scott - IS
Is there a way to check for the existence of an attribute before attempting to create one? H5Lexists doesn't seem to work, I get an error message when I try. Scott This e-mail and any files transmitted with it may be proprietary and are intended solely for

Re: [Hdf-forum] HDF5-1.8.4 patch1 on Windows7 64bit

2010-03-17 Thread Mitchell, Scott - IS
I'd like to agree that appending the 'd' to the debug libraries name is a bad thing tm. It played particular havoc with the HDF5DotNet library because it links the hdf DLLs in code: [DllImport(hdf5dll.dll, CharSet=CharSet::Auto,

Re: [Hdf-forum] Problem: could not load file or assembly 'HDF5DotNet' or one of its dependencies

2010-08-25 Thread Mitchell, Scott - IS
I do not believe the Any CPU is available to Visual Studio C++ projects, C# VB, but not C++. I've had the assembly load problem too, but only when I've done an installer. In that case I've had to force the hdf _hl libraries to be installed as well, because the VS auto detect doesn't seem to

Re: [Hdf-forum] How to write empty or missing values in a dataset ?

2010-10-26 Thread Mitchell, Scott - IS
Can you instead use a time stamp on each data value? Then when you have no data, just don't write anything. Scott From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Herrero Vincent Sent: Tuesday, October 26, 2010 3:54 AM To: hdf-forum@hdfgroup.org

[Hdf-forum] H5L:iterate at file level

2010-11-04 Thread Mitchell, Scott - IS
On the .NET side, H5L::iterate works on a H5GroupId not an H5FileOrGroupId like the rest of H5L. Is there a reason for this? There should be a way to iterate what's at the root level of the file, right? The core HDF5 code seems to use the same underlying id. So, I tried changing the

Re: [Hdf-forum] Best practice for timeseries and storing timestamps in Packet Table API

2010-12-17 Thread Mitchell, Scott - IS
I am doing it slightly differently. My data structure is a similar compound type depending upon the instrument data being saved. I however chose to put the time data into a second time axis (dimension scale) which is also a Packet Table. I chose this because having a smaller dataset should

Re: [Hdf-forum] Storing binary data in hdf5

2011-01-20 Thread Mitchell, Scott - IS
If you know nothing about the data going in. Look at the Opaque data type. Here's some info and an example (in IDL): http://idlastro.gsfc.nasa.gov/idl_html_help/Opaque_Datatypes.html S -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On

Re: [Hdf-forum] hdf suitability for packetized data

2011-02-11 Thread Mitchell, Scott - IS
I'm doing something similar to what you are looking at. I have data coming in from multiple instruments which go through processing and result in one or several C# structures/arrays. In my example each instrument type has a structure containing Packet Tables with associated time axes/scales.

Re: [Hdf-forum] hdf suitability for packetized data

2011-02-11 Thread Mitchell, Scott - IS
. The index would be in it's own dataset with an array of time records and perhaps a few other fields and relative links (I forget what HDF5 calls them) to the actual data records. -Val On Feb 11, 2011, at 10:56 AM, Mitchell, Scott - IS wrote: I'm doing something similar to what you are looking

Re: [Hdf-forum] HDF5DotNet and H5PT

2011-03-21 Thread Mitchell, Scott - IS
Yes. That would be my message. I had to write my own wrapper class for H5PT though. At a basic level it's pretty straight forward using the other wrappers as a template. There are difficulties with some dataset functions that should work with the packet table, but don't (ex. adding or

Re: [Hdf-forum] Compression Level

2011-03-21 Thread Mitchell, Scott - IS
: [Hdf-forum] Compression Level Quoting Mitchell, Scott - IS scott.mitch...@itt.com: Is there any guidance, rule of thumb, whatever on what compression level to use? I haven't been able to find much detail; apart from 0 being no compression and 9 being maximum. Is there a good balance

Re: [Hdf-forum] How do I distingush between Datasets of NATIVE_HBOOL NATIVE_CHAR?

2011-04-19 Thread Mitchell, Scott - IS
If you look at the size, there will be a difference. The NATIVE_HBOOL is 4 bytes... which means it can be confused with Int32. I have written code which will convert .NET to from HDF types and this is a big conflict. There are several primitive type cases for which there is not a 1:1

Re: [Hdf-forum] HDF5DotNet: Compound Data Type Bug when using Doubles

2011-07-07 Thread Mitchell, Scott - IS
Try it setting your struct with the Sequential Attribute: [StructLayout(LayoutKind.Sequential)] public struct testStruct {...} These are members of the System.Runtime.InteropServices namespace. Scott -Original Message- From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-

Re: [Hdf-forum] Writing Performance

2011-08-15 Thread Mitchell, Scott - IS
Speaking of h5perf_serial, I ran it (v 1.8.6) on my test machine (win 2008 32bit) and I'm seeing strange results for the HDF5 Read measurement. For a single run, I see 0.0 or 19 MB/s or whatever. When I run many iterations, I get something like Maximum Throughput @ 0.0 MB/s, Average Throughput

Re: [Hdf-forum] HDF5 file structure for data logging

2011-08-18 Thread Mitchell, Scott - IS
Daniele, The Packet Table interface ends up creating a standard dataset that can be read just like any other dataset. But it does simplify setup and appending data. In fact, at a code level, you must access it as a dataset (H5D) in order to do certain things... attributes scales come to mind.

Re: [Hdf-forum] HDF5DotNet assembly

2011-08-29 Thread Mitchell, Scott - IS
The hdf5.net wrappers point specifically to the release version. If you want to use the debug hdf libs you need to rename the libs or edit the Wrapper. S From: hdf-forum-boun...@hdfgroup.org [hdf-forum-boun...@hdfgroup.org] On Behalf Of Gerd Heber

Re: [Hdf-forum] Getting an Array of values from a data set.

2011-09-15 Thread Mitchell, Scott - IS
DB, Why the 'round-about way of creating a byte array? Won't this work? byte[] buffer = new byte[bufferSize]; What's going on inside your HdfHelper.ConvertToBytes function? Scott From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Donald

Re: [Hdf-forum] Getting an Array of values from a data set.

2011-09-16 Thread Mitchell, Scott - IS
11:00 AM, Mitchell, Scott - IS wrote: DB, Why the 'round-about way of creating a byte array? Won't this work? byte[] buffer = new byte[bufferSize]; What's going on inside your HdfHelper.ConvertToBytes function? Scott From: hdf-forum-boun...@hdfgroup.orgmailto:hdf-forum-boun

Re: [Hdf-forum] memory issues when reading multiple datasets

2011-09-19 Thread Mitchell, Scott - IS
Hey Donald, You need to be close()ing your H5T type objects. I'm not sure if that's it, but Scott From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Donald Brandon Sent: Monday, September 19, 2011 3:22 PM To: HDF Users Discussion List Subject:

Re: [Hdf-forum] H5F.flush from HDF5DotNet?

2011-09-27 Thread Mitchell, Scott - IS
There is an H5Fflush function, but it is currently not in HDF5DotNet. But it is pretty easy to add. Take a look at H5F.cpp. Duplicate what's done for H5F::close, but call H5Fflush instead. You'll need the function, the DllImport statement, and the declaration in the header. Scott

Re: [Hdf-forum] Problem to add HDF5.NET wrapper (dll) to vs 2008

2012-03-28 Thread Mitchell, Scott - IS
I'm not sure why you're having the Error 1 problem. But don't add the c hdf *zip libs to the project. They should, however be in the build folder and/or wherever you install/execute from. From: hdf-forum-boun...@hdfgroup.org [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Lukas

[Hdf-forum] Win 64 difficulties

2012-07-19 Thread Mitchell, Scott - IS
We've been making changes to the code that will allow it to run truly 64 bit, and I'm having trouble getting the 64 bit HDF libraries to work. On the 32 bit side(Windows Server 2008 Ent.), I've been running relatively trouble free with version 1.8.6 (and the HDF5DotNet wrapper). With the 64 bit

Re: [Hdf-forum] Win 64 difficulties

2012-07-20 Thread Mitchell, Scott - IS
environment are you using? Visual Studio? MinGW? Cygwin? -- Mike Jackson www.bluequartz.net On Jul 19, 2012, at 1:53 PM, Mitchell, Scott - IS wrote: We've been making changes to the code that will allow it to run truly 64 bit, and I'm having trouble getting the 64 bit HDF libraries to work

[Hdf-forum] HDFDotNet SNK

2012-08-07 Thread Mitchell, Scott - IS
I'm running into an interesting problem with the latest HDFDotNet build under Visual Studio 2010. I have to make a few changes to the project; a couple extra function interface wrappers and adding a strong named key to sign the library. The last build (1.8.6) worked fine. The current one

Re: [Hdf-forum] Newbie questions regarding tables

2012-10-23 Thread Mitchell, Scott - IS
tried using the file identifier in the H5Dopen in conjunction with the packet table name, and this seems to work (I have other errors). Is this the accepted way to do this? Thanks, Michele On Tue, Oct 23, 2012 at 7:41 AM, Mitchell, Scott - IS scott.mitch...@exelisinc.commailto:scott.mitch

Re: [Hdf-forum] Reading a HDF5 file with C#/VS2008

2012-11-15 Thread Mitchell, Scott - IS
Michael, Do you have the HDF5 libraries in the build directory? Scott -Original Message- From: Hdf-forum [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Michael Koch Sent: Thursday, November 15, 2012 1:00 PM To: hdf-forum@hdfgroup.org Subject: [Hdf-forum] Reading a HDF5 file

Re: [Hdf-forum] c# read different datatypes

2013-04-09 Thread Mitchell, Scott - IS
With the string/Chararray fix, I think things will work. String is probably screwing up the offset of the rest of the fields. I think if you had an int/float/etc. first that one would work, but all after the string go 'bad'. Perhaps you need to add a [StructLayout(LayoutKind.Sequential)] to

Re: [Hdf-forum] c# read different datatypes

2013-04-09 Thread Mitchell, Scott - IS
[StructLayout(LayoutKind.Sequential)] should be at the head of your metadata struct not Chararray. So, [StructLayout(LayoutKind.Sequential)] struct metadata { public Chararray a; public int b; public float c; public float d; public Chararray f;

Re: [Hdf-forum] c# read different datatypes

2013-04-09 Thread Mitchell, Scott - IS
Also I'm not sure why you're using a double* in Chararray. It should be a char* and is only used as a replacement for string. This is what I use: /// summary /// Chararray is a helper struct to marshal the strings into/out of unmanaged HDF. /// /summary

Re: [Hdf-forum] c# read different datatypes

2013-04-09 Thread Mitchell, Scott - IS
In my code I build the dataset via brute force to write the data. So I build out the H5T struct(s) that I use. -Original Message- From: Hdf-forum [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Insane Sent: Tuesday, April 09, 2013 4:46 PM To: hdf-forum@hdfgroup.org Subject:

Re: [Hdf-forum] c# read different datatypes

2013-04-10 Thread Mitchell, Scott - IS
It looks ok at first glance. Do you define s1? I have no code I can extract for a simple example, but I have many where I use strings in a compound data type. S -Original Message- From: Hdf-forum [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Insane Sent: Wednesday, April

Re: [Hdf-forum] c# read different datatypes

2013-04-10 Thread Mitchell, Scott - IS
You need to allocate a buffer where H5D.read() stores the data. H5Array doesn't do that, it's just a wrapper. You should have something like: Metadata[] s1 = new Metadata[datasetSize]; H5DataSetId dsetId = H5D.open(fileID, /metadata/songs); H5DataTypeId

Re: [Hdf-forum] Different data types --- H5NX

2013-04-17 Thread Mitchell, Scott - IS
You can dynamically build a compound HDF type. I'm playing in the C#/.NET world and through reflection, I can dynamically build the struct too. It's a bit ugly, but is certainly do-able. I'm guessing it can be done on the C side using untyped buffers and a lot of work figuring out appropriate

Re: [Hdf-forum] FW: Different data types --- H5NX

2013-04-18 Thread Mitchell, Scott - IS
the struct. Can I have a copy of it? I will look into untyped buffers and Boost::Variant. Thanks, Cecilia From: Hdf-forum [mailto:hdf-forum-boun...@hdfgroup.org] On Behalf Of Mitchell, Scott - IS Sent: Wednesday, April 17, 2013 3:50 PM To: HDF Users Discussion List Subject: Re: [Hdf-forum

Re: [Hdf-forum] HDF5 and C#

2013-04-18 Thread Mitchell, Scott - IS
HDF5DotNet won't run in debug mode without some tweaking. The debug builds of HDF add an extra 'd' into the name... hdf5ddll.dll, for example. The HDF5DotNet libraries explicitly link to the release version. So you need to manually change the code, the hdf dll names, or run HDF5DotNet in debug

Re: [Hdf-forum] HDF Errors in .NET

2009-12-22 Thread Mitchell, Scott - AES
) { // different error handling } I'm doing something similar when trying to load an attribute because the H5L.exists function doesn't exist in the .NET wrapper (hint, hint :-)) Jesse Mitchell, Scott - AES wrote: Has anyone had success getting HDF5 error information from within a .NET project