Hi all,

> Hi Anthony,
> 
> Il giorno 16/ott/2012, alle ore 02:04, Anthony Scopatz <scop...@gmail.com> ha 
> scritto:
> 
> > Hello Ernesto,
> >
> > So you are actually asking two different questions, one on reading and the 
> > other on writing.  In general reading, or querying, with multiprocessing 
> > works very well.  Writing to a single file with multiple processes is 
> > destined to failure though.  So the strategy that many people have adopted 
> > is to have multiple processes create the data and then have a master 
> > process which acts as a queue for writing out the data.  Please see the 
> > example here for more inspiration [1].  Note that we have been having 
> > problems recently with multiprocess writing out to multiple files, but that 
> > is not what you want to do.
> >
> > Be Well
> > Anthony
> >
> > 1. 
> > https://github.com/PyTables/PyTables/blob/develop/examples/multiprocess_access_queues.py
> 
> It seems that the topic PyTables + multiprocessing became very popular since 
> some time.
> 
> Probably we should add a FAQ entry and provide a more extended tutorial based 
> on the example provided by Josh.
> I agree.  This is something that we should advertise a little more.

I think that this could be very useful especially for non computer scientists 
as me !

Best,
Ernesto


> Be Well
> Anthony
>  
> 
> 
> cheers
> 
> --
> Antonio Valentino
> 
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_sfd2d_oct
> _______________________________________________
> Pytables-users mailing list
> Pytables-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/pytables-users
> 
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_sfd2d_oct_______________________________________________
> Pytables-users mailing list
> Pytables-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/pytables-users

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_sfd2d_oct
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to