Hello David,
A Saturday 11 August 2007, David Worrall escrigué:
> Hello All,
> I was glad to have found Pytables. Thanks to all involved. I hope
> someone more experienced than I can offer some advice.
> My Setup: on OSX 10.4.10, Pytables 2.0, python 2.4.
>
> I'm getting a Segmentation Fault. I'll outline the structure FYI and
> perhaps someone can suggest a better approach:
> DB Structure: Parallel (3500+) group nodes off the root node, each
> with 10 sub-group nodes from which hang data leaves defined with
> Class (tables.IsDescription) as per the tutorial.
>
> The data (time ordered & multiplexed) is read sequentially from a
> flat file.The 3500+ nodes created on-the-fly and before any leaf data
> is appended.
> These nodes are created without error.
>
> The Seg. Fault occurs at some point in the leaf creation process. I'm
> using
> table = self.h5fileID.getNode() and then table.row['xxx']=data.
> table.row.append() and table.flush() are executed after the addition
> of each row.
Despite that your description is pretty accurate, in order to easy the
life of we, poor developers, it is always better if you can send a
minimal script that can reproduce the issue. That way we can focus
quickly into the problem.
Having said that, why are you saving just one row per table flush?
This is very inneficient and will consume a lot of resources (not only
memory and I/O but also CPU). It is always useful to write rows by
bunches and then, do a flush. When doing this, it is also more
efficient to use:
row = table.row
for i in xrange(1000):
row.append()
table.flush()
than:
for i in xrange(1000):
table.row.append()
table.flush()
because in the latter a new Row object is instanciated on each
iteration, but in the former only once (see tutorials).
Cheers,
--
>0,0< Francesc Altet http://www.carabos.com/
V V Cárabos Coop. V. Enjoy Data
"-"
-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
