2013/8/14 Peter Prettenhofer <peter.prettenho...@gmail.com>
> The coef matrix is allocated before the sub processes are forked so you
will need (n_jobs + 1) * 12 gb just for the coefs.

Worse, it turns out these huge matrices may get pickled and sent to the
child process over a pipe.

> The systemerror is quite strange though... I would expect a memory
error... Lars, do you have any thoughts on this?

http://stackoverflow.com/questions/15118344/system-error-while-running-subprocesses-using-multiprocessing

--
Lars Buitinck
Scientific programmer, ILPS
University of Amsterdam
------------------------------------------------------------------------------
Get 100% visibility into Java/.NET code with AppDynamics Lite!
It's a free troubleshooting tool designed for production.
Get down to code-level detail for bottlenecks, with <2% overhead. 
Download for free and get started troubleshooting in minutes. 
http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk
_______________________________________________
Scikit-learn-general mailing list
Scikit-learn-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general

Reply via email to