Re: [Numpy-discussion] numpy.savez does /not/ compress!?

2010-06-08 Thread Scott Sinclair
2010/6/8 Hans Meine me...@informatik.uni-hamburg.de: I just wondered why numpy.load(foo.npz) was so much faster than loading (gzip-compressed) hdf5 file contents, and found that numpy.savez did not compress my files at all. But is that intended?  The numpy.savez docstring says Save several

Re: [Numpy-discussion] numpy.savez does /not/ compress!?

2010-06-08 Thread Hans Meine
On Tuesday 08 June 2010 11:40:59 Scott Sinclair wrote: The savez docstring should probably be clarified to provide this information. I would prefer to actually offer compression to the user. Unfortunately, adding another argument to this function will never be 100% secure, since currently,

Re: [Numpy-discussion] numpy.savez does /not/ compress!?

2010-06-08 Thread Pauli Virtanen
ti, 2010-06-08 kello 12:03 +0200, Hans Meine kirjoitti: On Tuesday 08 June 2010 11:40:59 Scott Sinclair wrote: The savez docstring should probably be clarified to provide this information. I would prefer to actually offer compression to the user. Unfortunately, adding another argument to

Re: [Numpy-discussion] numpy.savez does /not/ compress!?

2010-06-08 Thread Hans Meine
On Tuesday 08 June 2010 12:11:28 Pauli Virtanen wrote: ti, 2010-06-08 kello 12:03 +0200, Hans Meine kirjoitti: I would prefer to actually offer compression to the user. Unfortunately, adding another argument to this function will never be 100% secure, since currently, all kwargs will be

Re: [Numpy-discussion] numpy.savez does /not/ compress!?

2010-06-08 Thread Anne Archibald
On 8 June 2010 06:11, Pauli Virtanen p...@iki.fi wrote: ti, 2010-06-08 kello 12:03 +0200, Hans Meine kirjoitti: On Tuesday 08 June 2010 11:40:59 Scott Sinclair wrote: The savez docstring should probably be clarified to provide this information. I would prefer to actually offer compression

Re: [Numpy-discussion] numpy.savez does /not/ compress!?

2010-06-08 Thread Hans Meine
Hi Anne, thanks for your input, too. On Tuesday 08 June 2010 12:53:51 Anne Archibald wrote: I'm also a little dubious about making compression the default. np.savez provides a feature - storing multiple arrays - that is not otherwise available. I suspect many users care more about speed than

Re: [Numpy-discussion] numpy.savez does /not/ compress!?

2010-06-08 Thread Scott Sinclair
2010/6/8 Hans Meine me...@informatik.uni-hamburg.de: On Tuesday 08 June 2010 11:40:59 Scott Sinclair wrote: The savez docstring should probably be clarified to provide this information. I would prefer to actually offer compression to the user. In the meantime, I've edited the docstring to