A Monday 04 February 2008, Michael Hoffman escrigué: > I also have this experience. And it's not just PyTables--the native > utilities that come with HDF5 can have a lot of trouble dealing with > large numbers of datasets. > > I found that for many uses I could speed things up by using a tree > topology so that no node has more than 256 children at each step. I > look forward to the fix.
Yeah. In the beginning 256 was the limit beyond it PyTables start to raise the PerformanceWarning. However, we raised this limit to 4096 because 256 seemed too low and besides, 4096 does not seem to consume too much resources. Are you experiencing some catastrophic resource consumption with 4096? Cheers, -- >0,0< Francesc Altet http://www.carabos.com/ V V Cárabos Coop. V. Enjoy Data "-" ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Pytables-users mailing list Pytables-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pytables-users
