Generic python cannot use all cores efficiently when using threads because of the Global Interpreter Lock [1]. This is why people use multiprocessing instead of threading.
multiprocessing can be quite complex to use properly though. I would advise you to use the joblib wrapper instead. Please see the documentation here: https://pythonhosted.org/joblib/parallel.html That will require you to reorganize your code a bit though. [1] http://en.wikipedia.org/wiki/Global_Interpreter_Lock -- Olivier ------------------------------------------------------------------------------ Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
