Re: [Pytables-users] Blocked access using PyTables and matrix multiplication

2011-12-12 Thread Brad Buran
Hi Antonio: Yes, those slides look like what I was looking for. Thanks for taking the time to look over the blocking technique I described. It seems to work pretty well for the datasets we're dealing with. Brad On Sun, Dec 11, 2011 at 5:45 AM, Antonio Valentino antonio.valent...@tiscali.it

Re: [Pytables-users] Blocked access using PyTables and matrix multiplication

2011-12-11 Thread Antonio Valentino
Hi Brad, Il 10/12/2011 20:36, Brad Buran ha scritto: I am trying to speed up some analysis routines on arrays that are approximately 16 x 200,000,000 elements (stored in HDF5 arrays that were originally created with PyTables). I was looking into whether I could speed up the analysis using

[Pytables-users] Blocked access using PyTables and matrix multiplication

2011-12-10 Thread Brad Buran
I am trying to speed up some analysis routines on arrays that are approximately 16 x 200,000,000 elements (stored in HDF5 arrays that were originally created with PyTables). I was looking into whether I could speed up the analysis using tricks such as memmap and numexpr; however, since I need to