Re: [Pytables-users] Performance issues when writing a large number of arrays

2009-09-29 Thread Francesc Alted
Hi Abiel, A Saturday 26 September 2009 05:07:34 Abiel Reinhart escrigué: > I am attempting to store a large number of moderately-sized > variable-length numpy arrays in a PyTables database, where each array > can be referred to by a string key. Looking through the mailing list > archives, it seems

Re: [Pytables-users] Performance issues when writing a large number of arrays

2009-09-27 Thread David Fokkema
Hi Abiel, On Sat, 2009-09-26 at 09:56 -0400, Abiel Reinhart wrote: > David, > > Thanks for the reply. I have also looked at the VLArray approach, but > I am I looking to build an interactive application and I am a bit > confused about whether VLArray is compatible with this. For example, > people

Re: [Pytables-users] Performance issues when writing a large number of arrays

2009-09-26 Thread Abiel Reinhart
David, Thanks for the reply. I have also looked at the VLArray approach, but I am I looking to build an interactive application and I am a bit confused about whether VLArray is compatible with this. For example, people can naturally be expected to remove individual numpy arrays from the database,

Re: [Pytables-users] Performance issues when writing a large number of arrays

2009-09-26 Thread David Fokkema
Hi Abiel, On Fri, 2009-09-25 at 23:07 -0400, Abiel Reinhart wrote: > I am attempting to store a large number of moderately-sized > variable-length numpy arrays in a PyTables database, where each array > can be referred to by a string key. Looking through the mailing list > archives, it seems that

[Pytables-users] Performance issues when writing a large number of arrays

2009-09-25 Thread Abiel Reinhart
I am attempting to store a large number of moderately-sized variable-length numpy arrays in a PyTables database, where each array can be referred to by a string key. Looking through the mailing list archives, it seems that one possible solution to this problem is to simply create a large number of