Re: [Pytables-users] Help in redoing current pytables schema.

2012-07-06 Thread Anthony Scopatz
Ahh thanks for clarifying On Jul 6, 2012 2:06 AM, "Francesc Alted" wrote: > On 7/5/12 7:59 PM, Anthony Scopatz wrote: > > On Thu, Jul 5, 2012 at 12:34 PM, Jacob Bennett > wrote: > >> Hello Pytables Users, >> >> I am currently having a maximum number of children error within >> pytables. I

Re: [Pytables-users] Help in redoing current pytables schema.

2012-07-06 Thread Francesc Alted
On 7/5/12 7:59 PM, Anthony Scopatz wrote: On Thu, Jul 5, 2012 at 12:34 PM, Jacob Bennett mailto:jacob.bennet...@gmail.com>> wrote: Hello Pytables Users, I am currently having a maximum number of children error within pytables. I am trying to store stock updates within hdf5. My

Re: [Pytables-users] Help in redoing current pytables schema.

2012-07-05 Thread Anthony Scopatz
On Thu, Jul 5, 2012 at 12:34 PM, Jacob Bennett wrote: > Hello Pytables Users, > > I am currently having a maximum number of children error within pytables. > I am trying to store stock updates within hdf5. My current schema is to > have one file represent a trading day, each table represent a part

Re: [Pytables-users] Help on sorting tables

2012-03-22 Thread Francesc Alted
On 3/22/12 1:59 PM, Francesc Alted wrote: On 3/22/12 12:48 PM, sreeaurovindh viswanathan wrote: But.. Can i get sort one column by descending and the other ascending. say if i have two columns and first i would like to sort the one in ascending and then sort the second column based on the search

Re: [Pytables-users] Help on sorting tables

2012-03-22 Thread Francesc Alted
On 3/22/12 12:48 PM, sreeaurovindh viswanathan wrote: > But.. Can i get sort one column by descending and the other ascending. > say > if i have two columns and first i would like to sort the one in > ascending and then sort the second column based on the search from the > first. > > > I mean I i h

Re: [Pytables-users] Help on sorting tables

2012-03-22 Thread sreeaurovindh viswanathan
But.. Can i get sort one column by descending and the other ascending. say if i have two columns and first i would like to sort the one in ascending and then sort the second column based on the search from the first. I mean I i have 1 5 2 6 1 8 2 9 Could i get an output as 1 5 1 8 2 6 2 9 Sor

Re: [Pytables-users] Help on sorting tables

2012-03-22 Thread Ümit Seren
I completely forgot about the CSI index. That's of course much easier than what I suggested ;-) Am 22.03.2012 17:39 schrieb "Francesc Alted" : > On 3/22/12 11:02 AM, sreeaurovindh viswanathan wrote: > > Hi, > > > > If I have three columns in a table and if i wish to sort based on one > > field and

Re: [Pytables-users] Help on sorting tables

2012-03-22 Thread sreeaurovindh viswanathan
Thanks Francesc Alted for your advice. Regards Sree aurovindh V On Thu, Mar 22, 2012 at 10:09 PM, Francesc Alted wrote: > On 3/22/12 11:02 AM, sreeaurovindh viswanathan wrote: >> Hi, >> >> If I have three columns in a table and if i wish to sort based on one >> field and then on the other what w

Re: [Pytables-users] Help on sorting tables

2012-03-22 Thread Francesc Alted
On 3/22/12 11:02 AM, sreeaurovindh viswanathan wrote: > Hi, > > If I have three columns in a table and if i wish to sort based on one > field and then on the other what would be the recommended method.I > would be sorting atleast 75,00,000 records at a time. > > ie I would like to use something equ

Re: [Pytables-users] Help on sorting tables

2012-03-22 Thread Ümit Seren
AFAIK there is no sort functionality built into PyTables. I think there are 4 ways to do it: 1.) load all 7.5 million records and sort it in memory (if it fits into the memory) 2.) implement your own external sorting algorithm (http://en.wikipedia.org/wiki/External_sorting) using pytables iterato

[Pytables-users] Help on sorting tables

2012-03-22 Thread sreeaurovindh viswanathan
Hi, If I have three columns in a table and if i wish to sort based on one field and then on the other what would be the recommended method.I would be sorting atleast 75,00,000 records at a time. ie I would like to use something equivalent the following sql query. Select * from sample.table order

Re: [Pytables-users] Help iterate over table attributes and find their values

2011-05-11 Thread Curiouslearn
Thanks very much Francesc. Your solution worked great. Thanks again for sharing Pytables with the community. On Wed, May 11, 2011 at 5:54 AM, Francesc Alted wrote: > A Wednesday 11 May 2011 04:55:22 Curiouslearn escrigué: >> Hello, >> >> Can someone please tell me if it is possible to iterate o

Re: [Pytables-users] Help iterate over table attributes and find their values

2011-05-11 Thread Francesc Alted
A Wednesday 11 May 2011 04:55:22 Curiouslearn escrigué: > Hello, > > Can someone please tell me if it is possible to iterate over user > defined attributes of a table and print them out? Basically, I am > looking to get the same information that results from: > > sometable.attrs > > except t

[Pytables-users] Help iterate over table attributes and find their values

2011-05-10 Thread Curiouslearn
Hello, Can someone please tell me if it is possible to iterate over user defined attributes of a table and print them out? Basically, I am looking to get the same information that results from: sometable.attrs except that (1) the above command also contains system attributes, which I don't

Re: [Pytables-users] Help structuring data?

2011-04-17 Thread Francesc Alted
Hi Peter, A Saturday 16 April 2011 08:08:33 Peter Vessenes escrigué: > Hi all, > > I am working on an energy trading system right now, and am looking at > pytables as a way to store some large multidimensional arrays for use > with numpy. > > The main data is stored as roughly 4,000 points * 24

[Pytables-users] Help structuring data?

2011-04-15 Thread Peter Vessenes
Hi all, I am working on an energy trading system right now, and am looking at pytables as a way to store some large multidimensional arrays for use with numpy. The main data is stored as roughly 4,000 points * 24 hours * 365 days * 6 items * 10 years or so, and can be fit into an int16 if I'm wil

Re: [Pytables-users] Help with interpreting warning message

2010-08-15 Thread Francesc Alted
2010/8/15, Vineet Jain : > I'm getting the following warning on an index. What does the message > mean and what do you recommend I do? > > /usr/local/lib/python2.6/dist-packages/tables/leaf.py:416: > PerformanceWarning: The Leaf ``/_i_data/fullSymbol/sorted`` is > exceeding the maximum recommended

[Pytables-users] Help with interpreting warning message

2010-08-14 Thread Vineet Jain
I'm getting the following warning on an index. What does the message mean and what do you recommend I do? /usr/local/lib/python2.6/dist-packages/tables/leaf.py:416: PerformanceWarning: The Leaf ``/_i_data/fullSymbol/sorted`` is exceeding the maximum recommended rowsize (104857600 bytes); be ready

Re: [Pytables-users] help

2010-07-30 Thread Francesc Alted
A Friday 30 July 2010 00:09:37 matthew yeomans escrigué: > I was wondering on how inheritances of classes can be used in pytables. > > Let us say you have > > class A(isdescription): > property x... > property y... > class B(isdescription): > property z... > > h5f =

[Pytables-users] help

2010-07-30 Thread matthew yeomans
I was wondering on how inheritances of classes can be used in pytables. Let us say you have class A(isdescription): property x... property y... class B(isdescription): property z... h5f = openFile('DataBase.h5','w') MTdb = h5f.createTable("/",'Database' ,A) is it t

Re: [Pytables-users] help with an error when I tried to mod ify a table

2010-06-13 Thread Andrew Roth
Francesc Alted pytables.org> writes: > > I'm getting the following error: > > > > File "D:\python\prod_tests\src\test_receivers.py", line 54, in > > check_receivers(path_r,1) > > File "D:\python\prod_tests\src\test_receivers.py", line 45, in > > check_receivers for row in ro_detector.w

Re: [Pytables-users] help with an error when I tried to modify a table

2010-06-09 Thread Francesc Alted
Hola German, A Wednesday 09 June 2010 12:40:38 German Ocampo escrigué: > Hello > > Im newbie in pytables and I have a question regarding to an error > message. I writing a program which basically read a text file to a > pytable and then I want to modify one field in the table according to > a co

[Pytables-users] help with an error when I tried to modify a table

2010-06-09 Thread German Ocampo
Hello Im newbie in pytables and I have a question regarding to an error message. I writing a program which basically read a text file to a pytable and then I want to modify one field in the table according to a condition related to another field. the program is very simple and I'm getting the fol

Re: [Pytables-users] Help testing blosc

2010-06-06 Thread Francesc Alted
A Sunday 06 June 2010 02:04:43 escriguéreu: > Hi Francesc, > > Since it's called "bench", I thought I'd check a few compilers and see > the difference. > > CPU: Core 2 Duo 2.8 GHz > OS: OS X 10.6.3 > Compilers - hardsuite: > > GCC 4.0 Elapsed time: 6409.3 s, 444.3 MB/s > GCC 4.2 Elapsed time:

[Pytables-users] Help testing blosc

2010-06-03 Thread Francesc Alted
Hi List, I'm undergoing the last steps before declaring Blosc stable and I need your help. If you have some minutes, I'd like you to run some tests suites on Blosc in your machines. Please, go to: http://blosc.pytables.org/trac/wiki/SyntheticBenchmarks and follow the instructions there. The

Re: [Pytables-users] help, error

2009-02-21 Thread Gabriel Beckers
That is fantastic news, indeed. Thanks! That would open up a lot of new possibilities for me. Cheers, Gabriel On Sat, 2009-02-21 at 10:44 +0100, Francesc Alted wrote: > I see. Well, you should know that I'm working in providing fancy > selection features to *Array objects. So hopefully, for

Re: [Pytables-users] help, error

2009-02-21 Thread Francesc Alted
A Saturday 21 February 2009, Gabriel Beckers escrigué: > Hi Francesc, > > I can confirm that it does work with an older hdf5 version. I ran the > example that I attached earlier (problem.py) on my home machine, > which is still running an older version, and it does create the > table. > > gabr...@g

Re: [Pytables-users] help, error

2009-02-21 Thread Francesc Alted
A Friday 20 February 2009, Gabriel Beckers escrigué: > OK, thanks. I think in a previous version this was possible. Or am I > getting something wrong? I have many files with tables of 1002 rows, > with one column that holds a 32 x 3488 float32 matrix, for example: > > /bird1/IJ_5000/erp/lfp (Table(

Re: [Pytables-users] help, error

2009-02-20 Thread Gabriel Beckers
Hi Francesc, I can confirm that it does work with an older hdf5 version. I ran the example that I attached earlier (problem.py) on my home machine, which is still running an older version, and it does create the table. gabr...@gabriel-desktop:~/usbdisk/programs$ python problem.py 1.6.6 2.0.4 gab

Re: [Pytables-users] help, error

2009-02-20 Thread Gabriel Beckers
OK, thanks. I think in a previous version this was possible. Or am I getting something wrong? I have many files with tables of 1002 rows, with one column that holds a 32 x 3488 float32 matrix, for example: /bird1/IJ_5000/erp/lfp (Table(1002L,)) '' description := { "signal": Float32Col(shape=(3

Re: [Pytables-users] help, error

2009-02-20 Thread Francesc Alted
A Friday 20 February 2009, Gabriel Beckers escrigué: > Hi, > > I can't create a table, which (I think) I could before updating my > hdf5 and pytables versions (both self compiled). > > The attached code is a minimal example that on my machine (Linux) > results in the error message below. > > Any id

[Pytables-users] help, error

2009-02-20 Thread Gabriel Beckers
Hi, I can't create a table, which (I think) I could before updating my hdf5 and pytables versions (both self compiled). The attached code is a minimal example that on my machine (Linux) results in the error message below. Any ideas about what is wrong? All the best, Gabriel Error output: =

[Pytables-users] Help testing forthcoming 1.3.2

2006-06-19 Thread Francesc Altet
Hi List, Due to some problems that appeared with the LRU cache that shows in scenarios where you handle lots of nodes (see [1]), I'd like to release 1.3.2 with a cure for this anytime soon. Also, we've addressed most of the problems that have been reported in the Trac as well as this list. So, pl

Re: [Pytables-users] Help with performance

2006-05-16 Thread Francesc Altet
Pepe, A Divendres 12 Maig 2006 20:42, Pepe Barbe va escriure: > Hello, > > I am writing an app where I am processing a some genetic information. > I have already placed all my information in a H5 DB. Currently the > information that I am interested resides in a Table that contains a > String for t

[Pytables-users] Help with performance

2006-05-16 Thread Pepe Barbe
Hello, I am writing an app where I am processing a some genetic information. I have already placed all my information in a H5 DB. Currently the information that I am interested resides in a Table that contains a String for the Gene Name, a long string with Gene Genetic Sequence and a a 1x7 vector