Re: [Pytables-users] Adding ability to extend EArray without explicitly generating data

Francesc Alted wrote: > Well, the elegant way to solve this is to not allow such a big slices to > happen. But I recognize that sometimes this can be inconvenient. To me, HDF5/PyTables is supposed to be (and almost always succeeds at being) an elegant way of letting me work with massive datase

[Pytables-users] Adding ability to extend EArray without explicitly generating data

Hi, I have a similar problem to this one from 2007: http://article.gmane.org/gmane.comp.python.pytables.user/533/ I am trying to add to an enormous EArray in the extensible direction, but doing this is very slow since it requires that an entire slice be generated in memory and then stored to d

[Pytables-users] Tarball filename doesn't work with easy_install

I am trying to install PyTables with easy_install. It doesn't work out of the box: """ $ easy_install tables Searching for tables Reading http://pypi.python.org/simple/tables/ Reading http://www.pytables.org/ No local packages or download links found for tables error: Could not find suitable dist

[Pytables-users] Ticket #176: dflt values ignored in CArray

I am trying to add a comment to , which was reported by someone else, but I cannot seem to figure out how to do so. I also have this problem. Looking at the source to hdf5Extension.pyx , I

Re: [Pytables-users] [#152: creating a custom filter]

Ivan Vilata i Balaguer wrote: > - Forwarded message from PyTables <[EMAIL PROTECTED]> - > > #152: creating a custom filter > -+-- > Reporter: [EMAIL PROTECTED] | Owner: somebody > Type: enhancemen

Re: [Pytables-users] Exceeding the recommended maximum number of children

Francesc Altet wrote: > Hi James, > > A Monday 04 February 2008, James Philbin escrigué: >> Hi, >> >> I'm planning on using pytables for storing data on large image >> datasets (1M+) and while playing around with some code, came across a >> warning saying I had exceeded the maximum number of child

Re: [Pytables-users] Citing PyTables

Francesc Altet wrote: > A Tuesday 13 November 2007, Michael Hoffman escrigué: >> Is there a preferred citation for PyTables in a scientific paper? > > Well, although it is not properly a FAQ, I've added an entry in the FAQ > about this: > > http://w

[Pytables-users] Citing PyTables

Is there a preferred citation for PyTables in a scientific paper? - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using

Re: [Pytables-users] Error message from hdf5

Anand Patil wrote: > Hi all, > > Any hints as to how I can track down the source of this error? It's just > displayed, no Python exceptions are raised and execution of my program > continues. > > Thanks, > Anand > > HDF5-DIAG: Error detected in HDF5 (1.8.0-beta3) thread 0: You're using a beta o

Re: [Pytables-users] File.walkNodes() performance

Francesc Altet wrote: > A Monday 24 September 2007, Michael Hoffman escrigué: >> Francesc Altet wrote: >>> A Monday 24 September 2007, Francesc Altet escrigué: >>>> A Monday 24 September 2007, Michael Hoffman escrigué: >>>>> Perhaps it would still take

Re: [Pytables-users] File.walkNodes() performance

Francesc Altet wrote: > A Monday 24 September 2007, Francesc Altet escrigué: >> A Monday 24 September 2007, Michael Hoffman escrigué: >>> Perhaps it would still take the same time over the whole file, but >>> I think that by doing a depth-first search I can get to the

Re: [Pytables-users] File.walkNodes() performance

Hi Francesc. Thanks for the explanation. Francesc Altet wrote: >> Additionally, what would you think about allowing the user to specify >> a depth-first iteration in the walk functions? That is how I will >> work around the problem unless you think a fix to this issue will be >> forthcoming very

[Pytables-users] File.walkNodes() performance

Thanks again for providing PyTables, which is a big help in my research. I am now dealing with files of tens of gigabytes which would probably be unthinkable to manage without PyTables. But using such large files brings some performance issues. I have a 26 GiB PyTables file which has a hierarch

Re: [Pytables-users] ANN: PyTables and PyTables Pro 2.0.1 available

Great, I look forward to using this release. Francesc Altet wrote: > Also, binaries have been compiled against the latest stable > version of HDF5, 1.6.6, released during the past August. Is HDF5 1.6.6 a requirement or will it still work with 1.6.5?

Re: [Pytables-users] [ANN] PyTables 2.0 released

Congratulations guys! I have been using your pre-final release since the beginning of the month and it is indeed much faster than PyTables 1.4, while all my old code seems to work fine. - This SF.net email is sponsored by D

Re: [Pytables-users] New 2.0 pre-final micro-release available

Brian Granger wrote: >>> > [...] HDF5 version: 1.6.4 >>> PyTables 2.0 requires HDF5 1.6.5. Perhaps this should also be warned. >> Sigh, which means I won't be able to use it on Ubuntu Dapper. Unless I get >> them to backport HDF5. :) > > But building HDF5 from scratch is very simple -

Re: [Pytables-users] New 2.0 pre-final micro-release available

Joshua J. Kugler wrote: > The tests are getting better. The build to an egg was flawless, and it > installed, unzipped this time. :) A few errors though. > > [...] > > HDF5 version: 1.6.4 PyTables 2.0 requires HDF5 1.6.5. Perhaps this should also be warned. -

Re: [Pytables-users] Why setup.py build_ext --inplace?

Francesc Altet wrote: > El dl 02 de 07 del 2007 a les 12:41 +0100, en/na Michael Hoffman va > escriure: >> The instructions indicate that one should use python setup.py build_ext >> --inplace. Contrary to my initial belief, using python setup.py build >> seems to work.

[Pytables-users] Why setup.py build_ext --inplace?

The instructions indicate that one should use python setup.py build_ext --inplace. Contrary to my initial belief, using python setup.py build seems to work. Using python setup.py build is the usual idiom, and allows things like python setup.py clean to work. -- Michael --

Re: [Pytables-users] New 2.0 pre-final micro-release available

Vicent Mas (V+) wrote: > El Sunday, 1 de July de 2007 17:36 Michael Hoffman escribió: >> Francesc Altet wrote: >>> Hi List, >>> >>> We are slowly but firmly approaching the final date for releasing >>> PyTables 2.0 final (serious!). The new release d

Re: [Pytables-users] New 2.0 pre-final micro-release available

t www.pytables.org seems to be down at the moment. -- Michael Hoffman - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just

[Pytables-users] Advantages of Array over CArray?

Are there any reasons one would choose to use an Array rather than a CArray? - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Ju

Re: [Pytables-users] I/O block size (for better Lustre performance)

Francesc Altet wrote: > El dc 18 de 04 del 2007 a les 11:38 +0100, en/na Michael Hoffman va > escriure: >> What is the I/O block size that PyTables uses? I ask because on my >> Lustre system, reading blocks of less than 2 MB results in degraded >> performance. > >

[Pytables-users] I/O block size (for better Lustre performance)

ile system is striped across. Many thanks, -- Michael Hoffman - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to g

Re: [Pytables-users] Efficient access to large numbers of datasets

Francesc Altet wrote: > A Dijous 12 Abril 2007 18:18, Michael Hoffman escrigué: >> Francesc Altet wrote: >>> A Dilluns 09 Abril 2007 15:57, Michael Hoffman escrigué: >>>> As a followup to my previous message, I have realized that I am supposed >>>> to

Re: [Pytables-users] Efficient access to large numbers of datasets

Francesc Altet wrote: > A Dilluns 09 Abril 2007 15:57, Michael Hoffman escrigué: >> As a followup to my previous message, I have realized that I am supposed >> to tune the lustre filesystem for large files. Hopefully that will solve >> my performance problems. > > May

Re: [Pytables-users] Efficient access to large numbers of datasets

As a followup to my previous message, I have realized that I am supposed to tune the lustre filesystem for large files. Hopefully that will solve my performance problems. -- Michael Hoffman - Take Surveys. Earn Cash

Re: [Pytables-users] Efficient access to large numbers of datasets

Francesc Altet wrote: > A Dissabte 07 Abril 2007 13:55, Michael Hoffman escrigué: >> PyTables has been a great help to my research. I was wondering if I >> could make my use somewhat more efficient. >> >> For a particular project, I produce about 22000 tables of 2

Re: [Pytables-users] Packet Table Pyrex Ext. Help

Dieter wrote: > Pyrex doesn't allow qualifiers in front of prototypes. All of the > functions in hdf's high level interface have a macro definition > (H5_HLDLL) that expands to __declspec() for that crappy Windows > operating system's export/import mechanism. > > I tried removing the all the macr

[Pytables-users] Efficient access to large numbers of datasets

once suggested as the max) or data size per file? Are there any facilities within PyTables or elsewhere to make this easier? Many thanks, -- Michael Hoffman - Take Surveys. Earn Cash. Influence the Future of IT