A Thursday 13 January 2011 16:37:35 Ben Kraft escrigué:
[clip]
> The test works for me if the where condition only returns a small
> number of rows (~40), but fails for larger queries (14000 rows). In
> these cases, the query will will finish on the main process, but the
> forked process hangs afte
My test code (modified from Mario's),
=
#!/usr/bin/env python
from services.tables_settings import composite_h5_filename
import tables
import multiprocessing as mp
def _worker(qout = None):
fn = composite_h5_filename
fp = tables.openFile
A Wednesday 12 January 2011 19:30:22 Ben Kraft escrigué:
> Resurrecting an old thread - I think my problem is similar to
> Mario's.
>
> I'm trying to create and use a where iterator in a forked subprocess.
> The iterator initializes, and I am able to loop through its items,
> but hangs when 'next'
Resurrecting an old thread - I think my problem is similar to Mario's.
I'm trying to create and use a where iterator in a forked subprocess. The
iterator initializes, and I am able to loop through its items, but hangs
when 'next' is called on the last item.
I installed a new version of numexpr wi
A Sunday 26 September 2010 19:24:30 Mario Juric escrigué:
> Hi Francesc,
> Thank you for the quick response (and the excellent code!).
>
> I thought the processes forked by multiprocessing.Process shared
no
> state, except explicitly through IPC (which is how they sidestep the
> issue
On 09/26/2010 08:28 AM, Francesc Alted wrote:
>
> You are trying to use different where iterators from two processes and
> this is not supported (to start with, you need to compile HDF5 in
> thread-safe mode).
>
For what it's worth, I just recompiled/reinstalled HDF5 1.8.5-patch1
with threadin
On 09/26/2010 08:28 AM, Francesc Alted wrote:
>
> You are trying to use different where iterators from two processes and
> this is not supported (to start with, you need to compile HDF5 in
> thread-safe mode).
>
Hi Francesc,
Thank you for the quick response (and the excellent code!).
Hi Mario,
A Sunday 26 September 2010 04:34:00 Mario Juric escrigué:
> Hi everyone,
> I'm evaluating PyTables as a backend for data storage in large
> astronomical surveys. So far the results have been fantastic, except
> for the following issue: if a table is opened and iterated on from
> wi
Hi everyone,
I'm evaluating PyTables as a backend for data storage in large
astronomical surveys. So far the results have been fantastic, except for
the following issue: if a table is opened and iterated on from within a
subprocess instantiated with multiprocessing.Process, the program hang
