I started working with IPython.parallel for training the trees using joblib. It works in principal, but it is SLOW. The time between starting and the jobs arriving at the engines is really long. I'm sending around 20.000x2000 float64 matrices, but this is gigabit ethernet and I wouldn't expect it to take like 10-20 seconds (haven't measured exactly).
Is there any thing that I might have done wrong? Should the data really take that long? Is there some compression available? Any hints would be very welcome. ------------------------------------------------------------------------------ Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
