Howdy, On Fri, Jan 27, 2012 at 6:44 AM, Andreas <[email protected]> wrote: > At the moment all parallelism is handled by joblib. On the other hand it > seems > IPython can talk to the SGE scheduling. > So I would love to have a way for joblib to talk to IPython.
just to say that I'm sorry not to jump in the discussion, but I have a trip coming up and I'm super time-limited for the next couple of days. But I'm following this conversation carefully and also pinged Min and Brian about it; I hope at the pycon sprint we'll be able to dig into these ideas further, but any progress that can be made now in terms of clearing out the mental models will be extremely valuable. And just to state what is probably obvious, we're more than happy to adjust the apis in ipython as necessary to reduce the impedance mismatches between tools. We're also finding our way through the fairly complex mess that is wanting to scale smoothly from interactive experimentation in a multicore local box to systems with their own queue/batch/job management (SGE/Condor/etc) to cloud (EC2-type) environments... Cheers, f ------------------------------------------------------------------------------ Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
