A Thursday 03 March 2011 19:23:25 Davide Cittaro escrigué:
> Hi all, I'm thinking of using pytables to efficiently store (and
> manage) long arrays. In my case each dataset would contain two
> dozens of arrays each 50 M - 250 M long. for each of them I know the
> exact length before any operation so I thought I can use CArray (to
> compress fixed sized arrays). The only problem is that I don't know
> what would be the smartest shape, I mean, I'm currently using (N,
> 1), where N is the length of the array (I've noticed that shape (1,
> N) raises performance warnings for my N). WIll it make any
> difference in terms of performance (either I/O or compression) to
> choose another shape? Thanks

You said that your data is 1-d, so why do you insist in specifying 1 2-d 
shape?  I'd go saving 1-d straight.

-- 
Francesc Alted

------------------------------------------------------------------------------
Free Software Download: Index, Search & Analyze Logs and other IT data in 
Real-Time with Splunk. Collect, index and harness all the fast moving IT data 
generated by your applications, servers and devices whether physical, virtual
or in the cloud. Deliver compliance at lower cost and gain new business 
insights. http://p.sf.net/sfu/splunk-dev2dev 
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to