Re: [Pytables-users] Pytables file reading

2012-08-06 Thread Juan Manuel Vázquez Tovar
Hi Antonio, Last question about this, from pytables point of view and based on your experience, is it better to manage a table with 3 million rows and multidimensional cells or a table with 300 million rows and plain cells? Thank you, Juanma El Aug 5, 2012, a las 17:32, Antonio Valentino es

Re: [Pytables-users] Pytables file reading

2012-08-05 Thread Juan Manuel Vázquez Tovar
Thank you Antonio, I will try Cheers Juanma El Aug 5, 2012, a las 17:32, Antonio Valentino escribió: > Hi Juan Manuel, > > Il 05/08/2012 22:52, Juan Manuel Vázquez Tovar ha scritto: >> Hi Antonio, >> >> This is the piece of code I use to read the part of the table I need: >> >> data = [cas

Re: [Pytables-users] Pytables file reading

2012-08-05 Thread Antonio Valentino
Hi Juan Manuel, Il 05/08/2012 22:52, Juan Manuel Vázquez Tovar ha scritto: > Hi Antonio, > > This is the piece of code I use to read the part of the table I need: > > data = [case[´loads´][i] for case in table] > > where i is the index of the row that I need to read from the matrix (133x6) > st

Re: [Pytables-users] Pytables file reading

2012-08-05 Thread Juan Manuel Vázquez Tovar
Hi Antonio, This is the piece of code I use to read the part of the table I need: data = [case[´loads´][i] for case in table] where i is the index of the row that I need to read from the matrix (133x6) stored in each cell of the column "loads". Juanma 2012/8/5 Antonio Valentino > Hi Juan Man

Re: [Pytables-users] Pytables file reading

2012-08-05 Thread Antonio Valentino
Hi Juan Manuel, Il 05/08/2012 22:28, Juan Manuel Vázquez Tovar ha scritto: > Hi Antonio, > > You are right, I don´t need to load the entire table into memory. > The fourth column has multidimensional cells and when I read a single row > from every cell in the column, I almost fill the workstation

Re: [Pytables-users] Pytables file reading

2012-08-05 Thread Juan Manuel Vázquez Tovar
Hi Antonio, You are right, I don´t need to load the entire table into memory. The fourth column has multidimensional cells and when I read a single row from every cell in the column, I almost fill the workstation memory. I didn´t expect that process to use so much memory, but the fact is that it u

Re: [Pytables-users] Pytables file reading

2012-08-05 Thread Antonio Valentino
Hi Juan Manuel, Il 04/08/2012 01:55, Juan Manuel Vázquez Tovar ha scritto: > Hello all, > > I´m managing a file close to 26 Gb size. It´s main structure is a table > with a bit more than 8 million rows. The table is made by four columns, the > first two columns store names, the 3rd one has a 53