On 02/01/2012 03:05 PM, Andreas wrote: > I started working with IPython.parallel for training the trees using joblib. > It works in principal, but it is SLOW. > The time between starting and the jobs arriving at the engines is really > long. > I'm sending around 20.000x2000 float64 matrices, but this is gigabit > ethernet and I wouldn't > expect it to take like 10-20 seconds (haven't measured exactly). > > Is there any thing that I might have done wrong? Should the data really > take that long? > Is there some compression available? > Any hints would be very welcome. > The machines are actually connected with 20Gbit lan. That makes me wonder even more....
------------------------------------------------------------------------------ Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
