In particular, it seems that when I've got matrices which are too big, the
forked processes will hang and never finish (aka, they take up 0 computing
time and remain that way indefinitely).
In particular, I've noticed this problem when using cross_val_score with
Ridge regression. This isn't a problem when I have input matrices on the
order of 800,000 by 100, but it does hang when they're on the order of
800,000 by 800. If I don't use parallel, then it fits fine, but setting
n_jobs > 1 will create a hang.
I'm using anaconda on CentOS, and I've tried this both with and without MKL
optimizations.
Anyone experience anything like this?
(if you'd like more detail, I also opened this as an issue on the sklearn
repo)
Chris
--
_____________________________________
PhD Candidate in Neuroscience | UC Berkeley <http://hwni.org/>
Editor and Web Master | Berkeley Science
Review<http://sciencereview.berkeley.edu/>
_____________________________________
------------------------------------------------------------------------------
The best possible search technologies are now affordable for all companies.
Download your FREE open source Enterprise Search Engine today!
Our experts will assist you in its installation for $59/mo, no commitment.
Test it for FREE on our Cloud platform anytime!
http://pubads.g.doubleclick.net/gampad/clk?id=145328191&iu=/4140/ostg.clktrk
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general