Hi all, I'm thinking of using pytables to efficiently store (and manage) long 
arrays. In my case each dataset would contain two dozens of arrays each 50 M - 
250 M long. for each of them I know the exact length before any operation so I 
thought I can use CArray (to compress fixed sized arrays). The only problem is 
that I don't know what would be the smartest shape, I mean, I'm currently using 
(N, 1), where N is the length of the array (I've noticed that shape (1, N) 
raises performance warnings for my N). WIll it make any difference in terms of 
performance (either I/O or compression) to choose another shape? 
Thanks

d

/*
Davide Cittaro, PhD

Cogentech - Consortium for Genomic Technologies
via adamello, 16
20139 Milano
Italy

tel.: +39(02)574303007
e-mail: davide.citt...@ifom-ieo-campus.it
*/




------------------------------------------------------------------------------
Free Software Download: Index, Search & Analyze Logs and other IT data in 
Real-Time with Splunk. Collect, index and harness all the fast moving IT data 
generated by your applications, servers and devices whether physical, virtual
or in the cloud. Deliver compliance at lower cost and gain new business 
insights. http://p.sf.net/sfu/splunk-dev2dev 
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to