Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Anthony Scopatz
Thanks Tim! You are the best. Hopefully I will get to this later tonight. Be Well Anthony On Wed, Jun 5, 2013 at 9:20 PM, Tim Burgess wrote: > > > On Jun 06, 2013, at 04:19 AM, Anthony Scopatz wrote: > > Thanks Antonio and Tim! > > These are great. I think that one of these should definitel

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Tim Burgess
On Jun 06, 2013, at 04:19 AM, Anthony Scopatz wrote:Thanks Antonio and Tim!These are great. I think that one of these should definitely make it into the examples/ dir.Be WellAnthony OK. I have put up a pull request with the code added. https://github.com/PyTables/PyTables/pull/266Cheers, Tim -

Re: [Pytables-users] pytable 30 - encoding

2013-06-05 Thread Anthony Scopatz
Hi Jeff, I have made some comments in the issue. Thanks for investigating this so thoroughly. Be Well Anthony On Tue, Jun 4, 2013 at 8:16 PM, Jeff Reback wrote: > Anthony, > > I created an issue with more info > > I am not sure if this is a bug, or just a way both ne/pytables treat > strings

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Anthony Scopatz
Thanks Antonio and Tim! These are great. I think that one of these should definitely make it into the examples/ dir. Be Well Anthony On Wed, Jun 5, 2013 at 8:10 AM, Francesc Alted wrote: > On 6/5/13 11:45 AM, Andreas Hilboll wrote: > > On 05.06.2013 10:31, Andreas Hilboll wrote: > >> On 05.06

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Francesc Alted
On 6/5/13 11:45 AM, Andreas Hilboll wrote: > On 05.06.2013 10:31, Andreas Hilboll wrote: >> On 05.06.2013 03:29, Tim Burgess wrote: >>> I was playing around with in-memory HDF5 prior to the 3.0 release. >>> Here's an example based on what I was doing. >>> I looked over the docs and it does mention

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Francesc Alted
On 6/5/13 11:45 AM, Andreas Hilboll wrote: > On 05.06.2013 10:31, Andreas Hilboll wrote: >> On 05.06.2013 03:29, Tim Burgess wrote: >>> I was playing around with in-memory HDF5 prior to the 3.0 release. >>> Here's an example based on what I was doing. >>> I looked over the docs and it does mention

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Andreas Hilboll
On 05.06.2013 10:31, Andreas Hilboll wrote: > On 05.06.2013 03:29, Tim Burgess wrote: >> I was playing around with in-memory HDF5 prior to the 3.0 release. >> Here's an example based on what I was doing. >> I looked over the docs and it does mention that there is an option to >> throw away the 'fil

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Andreas Hilboll
On 05.06.2013 09:15, Seref Arikan wrote: > You would be suprised to see how convenient HDF5 can be in small scale > data :) There are cases where one may need to use binary serialization > of a few thousand items, but still needing metadata, indexing and other > nice features provided by HDF5/pyTab

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Andreas Hilboll
On 05.06.2013 03:29, Tim Burgess wrote: > I was playing around with in-memory HDF5 prior to the 3.0 release. > Here's an example based on what I was doing. > I looked over the docs and it does mention that there is an option to > throw away the 'file' rather than write it to disk. > Not sure how to

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Seref Arikan
You would be suprised to see how convenient HDF5 can be in small scale data :) There are cases where one may need to use binary serialization of a few thousand items, but still needing metadata, indexing and other nice features provided by HDF5/pyTables. On Wed, Jun 5, 2013 at 2:29 AM, Tim Burg

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Antonio Valentino
Hi Tim, Il 05/06/2013 03:29, Tim Burgess ha scritto: > I was playing around with in-memory HDF5 prior to the 3.0 release. Here's an > example based on what I was doing. > I looked over the docs and it does mention that there is an option to throw > away > the 'file' rather than write it to disk.

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Antonio Valentino
Hi list, Il 05/06/2013 00:38, Anthony Scopatz ha scritto: > On Tue, Jun 4, 2013 at 12:30 PM, Seref Arikan wrote: > >> I think I've seen this in the release notes of 3.0. This is actually >> something that I'm looking into as well. So any experience/feedback about >> creating files in memory would