The problem I face is this:
I would like to store lots of time-dependend data in an EArray, where 
the extensible dimension represents the date. However, the size of the 
other dimensions are such that even an array slice of one date does not 
fit into memory. E.g. my EArray is defined with a shape of (40000, 
20000, 4, 0), UInt16. When I want to extend the EArray with a new date 
slice, I have to append the new slice at once, which does not work 
because a numpy array of (40000, 20000, 4, 1) is too large to fit into 
memory.
Is there a way to append an uninitialized array slice in a memory 
efficient way, and fill it part by part later?

Cheers,
Vincent.


-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to