Hi Andrew, A Dilluns 10 Abril 2006 20:39, Andrew Straw va escriure: > Just for everyone's information: > > I've finally had a chance to play around with this a little bit, and > I've found the only thing that makes my hdf5 files resistant to my > program being terminated (e.g. with "kill -9" while in the middle of a > time.sleep() call). Is to actually close and re-open the file after each > write. The suggestion to call Leaf.close() (== Table.close()) after > appending rows doesn't fix the hdf5 integrity issues. I suspect this may > be because I'm not calling close() (or _f_close()) on the root group. I > haven't tried doing that because I'm not sure what other effects that > would have.
This is intersting to know. In order to look for a reason for this to fail, it would be nice to know if PyTables 1.1.1 would be more stable in that regard than 1.2 (or 1.3). The reason for this can be the introduction of the LRU cache in PyTables 1.2. The LRU cache allows to fix a limit of open leaves in-memory, and this is why we decided to not open/close the leaves on every read/write operation (the number of open handles for disk objects is limited). This is supposed to accelerate the I/O, but of course might raise the probability to spoil the file. So, if you can experiment with PyTables 1.1.1 and your files are more stable, then we've found a possible reason of the problem. It also would help if you try with latest stable HDF5 (1.6.5), in order to avoid problems on the HDF5 side. Thanks for any feedback, -- >0,0< Francesc Altet http://www.carabos.com/ V V Cárabos Coop. V. Enjoy Data "-" ------------------------------------------------------- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642 _______________________________________________ Pytables-users mailing list Pytables-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pytables-users
