Hi Elena, Hi Dana I've uploaded "Cropped_ferret182group2confocalalign.zip" (it took more than 4 hours).
At the moment I can't tell if the software crashed while writing - it could even be that the user pulled the power plug of his computer ;-) ... I'm investigating there. Cheers, Christoph From: Hdf-forum [mailto:[email protected]] On Behalf Of Elena Pourmal Sent: Mittwoch, 5. Februar 2014 16:59 To: HDF Users Discussion List Subject: Re: [Hdf-forum] Hdf5 view crashes without error message when opening a (corrupt) file Hi Christoph, h5check shouldn't give segmentation fault. We need to fix this and will need the file. Could you please upload it to ftp://ftp.hdfgroup.uiuc.edu/pub/incoming/epourmal/ Thank you! Elena ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elena Pourmal The HDF Group http://hdfgroup.org 1800 So. Oak St., Suite 203, Champaign IL 61820 217.531.6112 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ On Feb 5, 2014, at 6:42 AM, Dana Robinson <[email protected]<mailto:[email protected]>> wrote: Hi Christoph, Did the software crash while writing the file? It looks like the file is missing an object header. Since we use a metadata cache, this can happen if a program crashes while the cache contains unflushed metadata. HDF5 is not (currently) journaled, so we don't order or group metadata writes to avoid this situation (yet). Dana From: Hdf-forum [mailto:[email protected]<mailto:[email protected]>] On Behalf Of Christoph Laimer Sent: Wednesday, February 05, 2014 5:33 AM To: HDF Users Discussion List Subject: Re: [Hdf-forum] Hdf5 view crashes without error message when opening a (corrupt) file Hi Elena Thanks for your quick response. H5check produces the output below. It ends with a segmentation fault. There is also an error message, but I don't know how to interpret this. Maybe an indicator of the subsequent crash. I've tested also other files, which are generated by our software, and "h5check" doesn't tell errors there. ./h5check --verbose=2 /Volumes/Data/tmp/Cropped_ferret182group2confocalalign.ims VERBOSE is true:verbose # = 2 VALIDATING /Volumes/Data/tmp/Cropped_ferret182group2confocalalign.ims according to library version 1.8.0 FOUND super block signature VALIDATING the super block at physical address 0... Validating version 2 superblock... INITIALIZING filters ... VALIDATING the object header at logical address 48... VALIDATING version 2 object header ... FOUND Version 2 object header signature VALIDATING the object header at logical address 1382334217... VALIDATING version 1 object header... Version 1 object header encountered VALIDATING the local heap at logical address 1382334801... FOUND local heap signature. VALIDATING version 1 btree at logical address 1382334257... FOUND version 1 btree signature. VALIDATING the Symbol table node at logical address 1382335675... FOUND Symbol table node signature. VALIDATING the object header at logical address 1382334971... VALIDATING version 1 object header... Version 1 object header encountered VALIDATING the local heap at logical address 1382335555... FOUND local heap signature. VALIDATING version 1 btree at logical address 1382335011... FOUND version 1 btree signature. VALIDATING the Symbol table node at logical address 1382352746... FOUND Symbol table node signature. VALIDATING the object header at logical address 1382352042... VALIDATING version 1 object header... Version 1 object header encountered VALIDATING the local heap at logical address 1382352626... FOUND local heap signature. VALIDATING version 1 btree at logical address 1382352082... FOUND version 1 btree signature. VALIDATING the object header at logical address 1382336003... VALIDATING version 1 object header... Version 1 object header encountered VALIDATING version 1 btree at logical address 1382336275... FOUND version 1 btree signature. VALIDATING the object header at logical address 267213... VALIDATING version 2 object header ... FOUND Version 2 object header signature ***Error*** version 2 Object Header:Couldn't find CONT signature at addr 1351906296 ***End of Error messages*** VALIDATING the object header at logical address 267412... VALIDATING version 1 object header... ***Error*** Object Header:Unable to read object header data at addr 267444 Version 1 Object Header:Bad version number at addr 267412; Value decoded: 120 ***End of Error messages*** VALIDATING the object header at logical address 1096354995... VALIDATING version 2 object header ... FOUND Version 2 object header signature VALIDATING the object header at logical address 1096355142... VALIDATING version 2 object header ... FOUND Version 2 object header signature VALIDATING the object header at logical address 1096355289... VALIDATING version 2 object header ... FOUND Version 2 object header signature VALIDATING the object header at logical address 1096355665... VALIDATING version 2 object header ... FOUND Version 2 object header signature VALIDATING version 1 btree at logical address 1096358724... Segmentation fault: 11 (I don't expect, that our customer was storing a lot of hdf5-objects. In situations, where our software potentially produces tons of "objects", we consequently use tables that contain these "objects" - and the file certainly contains 4d-image-data) Cheers, Christoph From: Hdf-forum [mailto:[email protected]] On Behalf Of Elena Pourmal Sent: Mittwoch, 5. Februar 2014 02:38 To: HDF Users Discussion List Subject: Re: [Hdf-forum] Hdf5 view crashes without error message when opening a (corrupt) file Hi Christoph, On Feb 3, 2014, at 7:50 AM, Christoph Laimer <[email protected]<mailto:[email protected]>> wrote: Dear HDF-Forum I have a file, which causes an immediate crash of the HDF-viewer (no error message, tested with newest versions on Windows and Mac OS X). HDFView cannot handle big files or files with a lot of objects. This is a known limitation that we are trying to address in the next major release. You will need to use other tools to confirm that the file is indeed corrupted. I have to assume the file is corrupt. It was written with our Software (Imaris) which uses regular calls from the official HDF-library (v1.8.6). Loading the file with our Software causes a crash. In order to figure out, what was last written into the file, I opened the file in the HDF-viewer, but there it also crashes (Windows and Mac OS X). In the debugger on Windows it crashes inside "H5Gopen", but I don't understand, what happens there in detail. Try catch(...) doesn't catch - it must be a severe memory violation. Could you please try to run h5check tool to see if HDF5 metadata in this file is corrupted? If h5check doesn't find anything, try to run h5ls to see how far you can traverse the file. Information about both tools can be found here http://www.hdfgroup.org/HDF5/doc/RM/Tools.html Hi Obviously something went wrong when the file was written. Unfortunately I can't tell, what exactly was done there - it was a customer using our software, and "save" was successful. I'd like to do two things: - Try to understand from the file content, what went wrong when the file was written. HDF View would be helpful, if it would show the non-corrupted parts of the file (instead of crashing). - Show a more graceful message to the user, when he tries to open such a file in our Software. Ideally "H5Gopen" would return some error code, or at least do something catchable. Agree on both issues. Is there a common place for the HDF-forum to upload my file? The zipped file size is 1.3 GB. I'll check with our sysadmin people. Stay tuned. Elena ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elena Pourmal The HDF Group http://hdfgroup.org 1800 So. Oak St., Suite 203, Champaign IL 61820 217.531.6112 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Please help! Cheers, Christoph This message is intended only for the use of the addressee and may contain information that is confidential and/or subject to copyright. If you are not the intended recipient, you are hereby notified that any dissemination, copying, or redistribution of this message is strictly prohibited. If you have received this message in error please delete all copies immediately. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of Andor Technology Plc Companies. Andor Technology Plc has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. Andor Technology PLC is a registered company in Northern Ireland, registration number: NI022466. Registered Office: Andor Technology, 7 Millennium Way, Springvale Business Park, Belfast, BT12 7AL. _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected]<mailto:[email protected]> http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected]<mailto:[email protected]> http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
_______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
