Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Antonio Valentino
Hi list, Il 05/06/2013 00:38, Anthony Scopatz ha scritto: On Tue, Jun 4, 2013 at 12:30 PM, Seref Arikan serefari...@gmail.com wrote: I think I've seen this in the release notes of 3.0. This is actually something that I'm looking into as well. So any experience/feedback about creating files

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Seref Arikan
You would be suprised to see how convenient HDF5 can be in small scale data :) There are cases where one may need to use binary serialization of a few thousand items, but still needing metadata, indexing and other nice features provided by HDF5/pyTables. On Wed, Jun 5, 2013 at 2:29 AM, Tim

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Andreas Hilboll
On 05.06.2013 10:31, Andreas Hilboll wrote: On 05.06.2013 03:29, Tim Burgess wrote: I was playing around with in-memory HDF5 prior to the 3.0 release. Here's an example based on what I was doing. I looked over the docs and it does mention that there is an option to throw away the 'file'

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Francesc Alted
On 6/5/13 11:45 AM, Andreas Hilboll wrote: On 05.06.2013 10:31, Andreas Hilboll wrote: On 05.06.2013 03:29, Tim Burgess wrote: I was playing around with in-memory HDF5 prior to the 3.0 release. Here's an example based on what I was doing. I looked over the docs and it does mention that there

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Francesc Alted
On 6/5/13 11:45 AM, Andreas Hilboll wrote: On 05.06.2013 10:31, Andreas Hilboll wrote: On 05.06.2013 03:29, Tim Burgess wrote: I was playing around with in-memory HDF5 prior to the 3.0 release. Here's an example based on what I was doing. I looked over the docs and it does mention that there

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Anthony Scopatz
Thanks Antonio and Tim! These are great. I think that one of these should definitely make it into the examples/ dir. Be Well Anthony On Wed, Jun 5, 2013 at 8:10 AM, Francesc Alted fal...@gmail.com wrote: On 6/5/13 11:45 AM, Andreas Hilboll wrote: On 05.06.2013 10:31, Andreas Hilboll wrote:

Re: [Pytables-users] pytable 30 - encoding

2013-06-05 Thread Anthony Scopatz
Hi Jeff, I have made some comments in the issue. Thanks for investigating this so thoroughly. Be Well Anthony On Tue, Jun 4, 2013 at 8:16 PM, Jeff Reback jreb...@yahoo.com wrote: Anthony, I created an issue with more info I am not sure if this is a bug, or just a way both ne/pytables

Re: [Pytables-users] Chunk selection for optimized data access

2013-06-05 Thread Tim Burgess
On Jun 06, 2013, at 04:19 AM, Anthony Scopatz scop...@gmail.com wrote:Thanks Antonio and Tim!These are great. I think that one of these should definitely make it into the examples/ dir.Be WellAnthonyOK. I have put up a pull request with the code