Hi Francesc, On Tue, Jan 04, 2011 at 01:11:03PM +0100, Francesc Alted wrote:
> Well, yes and no ;-) In principle they are only compressed on-disk, > but if you access a CArray enough, and it is small enough, then > chances are that it would actually exist in the OS filesystem cache > memory in compressed state. But this is kind of fake in-memory > compression. For a true compressed array in-memory, see this other > project of mine: > https://github.com/FrancescAlted/carray Thanks. That's very helpeful. Something else I forgot to ask regarding the implementation is: to what extent does PyTables employ threads? I have two arrays with shape (107352, 679, 839) and often need to perform operations over the entire array. I have an 8-way machine and have not yet attempted to access these arrays using multiple threads or processes (the operations are almost always highly parallel). If PyTables is already using threads to accelerate internal operation, there would not be much point trying to do this myself. Cheers, Ben
signature.asc
Description: Digital signature
------------------------------------------------------------------------------ Learn how Oracle Real Application Clusters (RAC) One Node allows customers to consolidate database storage, standardize their database environment, and, should the need arise, upgrade to a full multi-node Oracle RAC database without downtime or disruption http://p.sf.net/sfu/oracle-sfdevnl
_______________________________________________ Pytables-users mailing list Pytables-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pytables-users
