Re: [Pytables-users] Determining effect of compression

2012-03-29 Thread Alvaro Tejero Cantero
Thanks for the link to Gaƫl's study (that shows well the strengths of pytables/blosc). Here' s the issue I created related to dataset size estimation linked for reference of people landing from web searches on this thread: https://github.com/PyTables/PyTables/issues/141 (there are pointers there

Re: [Pytables-users] Determining effect of compression

2012-03-28 Thread Francesc Alted
In case you want more feedback on compression filters, this study might be interesting for you: http://gael-varoquaux.info/blog/?p=159 Francesc On 3/28/12 12:33 PM, Alvaro Tejero Cantero wrote: > Hi, > > Trying to evaluate compression filters, I was looking for a call in > PyTables to get the s

Re: [Pytables-users] Determining effect of compression

2012-03-28 Thread Anthony Scopatz
On Wed, Mar 28, 2012 at 1:05 PM, Francesc Alted wrote: > On 3/28/12 12:33 PM, Alvaro Tejero Cantero wrote: > > Hi, > > > > Trying to evaluate compression filters, I was looking for a call in > > PyTables to get the size of a dataset (in bytes). As I didn't find it > > I remembered the many benchm

Re: [Pytables-users] Determining effect of compression

2012-03-28 Thread Francesc Alted
On 3/28/12 12:33 PM, Alvaro Tejero Cantero wrote: > Hi, > > Trying to evaluate compression filters, I was looking for a call in > PyTables to get the size of a dataset (in bytes). As I didn't find it > I remembered the many benchmarks and found instead [1] that the way to > do it is to create singl

[Pytables-users] Determining effect of compression

2012-03-28 Thread Alvaro Tejero Cantero
Hi, Trying to evaluate compression filters, I was looking for a call in PyTables to get the size of a dataset (in bytes). As I didn't find it I remembered the many benchmarks and found instead [1] that the way to do it is to create single-dataset files and interrogate the filesystem. Curiously eno