[Pytables-users] Subclassing File

2009-02-02 Thread Andreas Hilboll
Hi there, I'm trying to write a subclass of File, but somehow the initialization of a new instance of this class fails with a function takes exactly 8 arguments (1 given) error. It might well be that I haven't understood some integral aspect of sublclassing in Python yet =( So I'd really

[Pytables-users] Using built-in slice objects on CArray

2013-01-23 Thread Andreas Hilboll
Hi, how can I use Python's built-in `slice` object on CArray? Currently, I'm trying In: coord_slice Out: [slice(0, 31, None), slice(0, 5760, None), slice(0, 2880, None)] In: _ds Out: /data/mydata (CArray(31, 5760, 2880), shuffle, blosc(5)) '' atom :=

Re: [Pytables-users] Using built-in slice objects on CArray

2013-01-23 Thread Andreas Hilboll
On Tue, Jan 22, 2013 at 8:44 AM, Andreas Hilboll li...@hilboll.de mailto:li...@hilboll.de wrote: Hi, how can I use Python's built-in `slice` object on CArray? Currently, I'm trying In: coord_slice Out: [slice(0, 31, None), slice(0, 5760, None), slice(0

Re: [Pytables-users] ANN: PyTables 3.0 beta1

2013-04-27 Thread Andreas Hilboll
Am 27.04.2013 19:42, schrieb Anthony Scopatz: On Sat, Apr 27, 2013 at 12:35 PM, Andreas Hilboll li...@hilboll.de mailto:li...@hilboll.de wrote: Am 27.04.2013 19 tel:27.04.2013%2019:17, schrieb Anthony Scopatz: Whoo hoo! Thanks for all of your hard work Antonio! PyTables

[Pytables-users] Chunk selection for optimized data access

2013-06-03 Thread Andreas Hilboll
Hi, I'm storing large datasets (5760 x 2880 x ~150) in a compressed EArray (the last dimension represents time, and once per month there'll be one more 5760x2880 array to add to the end). Now, extracting timeseries at one index location is slow; e.g., for four indices, it takes several seconds:

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-03 Thread Andreas Hilboll
On 03.06.2013 14:43, Andreas Hilboll wrote: Hi, I'm storing large datasets (5760 x 2880 x ~150) in a compressed EArray (the last dimension represents time, and once per month there'll be one more 5760x2880 array to add to the end). Now, extracting timeseries at one index location is slow

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-04 Thread Andreas Hilboll
are investigating IO tuning. - I have found with CArray that the auto chunksize works fairly well. Experiment with that chunksize and with some chunksizes that you think are more appropriate (maybe temporal rather than spatial in your case). On Jun 03, 2013, at 10:45 PM, Andreas Hilboll li...@hilboll.de

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Andreas Hilboll
On 05.06.2013 10:31, Andreas Hilboll wrote: On 05.06.2013 03:29, Tim Burgess wrote: I was playing around with in-memory HDF5 prior to the 3.0 release. Here's an example based on what I was doing. I looked over the docs and it does mention that there is an option to throw away the 'file

Re: [Pytables-users] Pytables-users Digest, Vol 86, Issue 8

2013-07-18 Thread Andreas Hilboll
On 18.07.2013 08:45, Pushkar Raj Pande wrote: Both loadtxt and genfromtxt read the entire data into memory which is not desirable. Is there a way to achieve streaming writes? Thanks, Pushkar On Wed, Jul 17, 2013 at 7:04 PM, Pushkar Raj Pande topgun...@gmail.com