A Monday 13 April 2009, Dav Clark escrigué:
> Interesting.  I think this is worth mentioning on the list...
>
> In brief - is there a reasonable upper limit on the number of arrays
> and/or tables that one should put in a single group in PyTables?

Yes.  In order to keep HDF5 metadata under reasonable limits (i.e. in 
order to avoid leaf access performance problems), you should'nt put a 
lot of leaves under a single group.  Just to put an example, 1024 
leaves per group should be such a reasonable limit.

Generall speaking, it is always much better to create (very) large 
datasets than too wide object trees.

Cheers,

-- 
Francesc Alted

"One would expect people to feel threatened by the 'giant
brains or machines that think'.  In fact, the frightening
computer becomes less frightening if it is used only to
simulate a familiar noncomputer."

-- Edsger W. Dykstra
   "On the cruelty of really teaching computer science"

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to