Or perhaps since it's a bug in multiprocessing's queuing protocol, joblib
could handle it by writing oversize object to disk, assuming there's enough
free space in $TMPDIR.


On Thu, Aug 15, 2013 at 5:32 PM, Joel Nothman
<jnoth...@student.usyd.edu.au>wrote:

> I've been getting "SystemError: NULL result without error in
> PyObject_Call" when trying to perform a parallel grid search (with logistic
> regression, n_jobs>=2) with a very large matrix.
>
> So it comes down to http://bugs.python.org/issue17560. It would be good
> if we could make the error a little less opaque.
>
>
> On Tue, Aug 13, 2013 at 5:59 PM, Lars Buitinck <l.j.buiti...@uva.nl>wrote:
>
>> 2013/8/13 A <4rk....@gmail.com>:
>> > On another note, n_jobs > 1 for SGDClassifier seems to return
>> SystemError.
>> > Is this a known issue?
>> > Traceback/output is as :
>> > ---------------------------------------------------------------
>> > 2992 labels to train on.
>> [snip]
>> > SystemError: NULL result without error in PyObject_Call
>>
>> I've never seen this one, but SGD isn't really built for massively
>> multiclass problems, so this may be a memory issue. How many features
>> do you have?
>>
>> --
>> Lars Buitinck
>> Scientific programmer, ILPS
>> University of Amsterdam
>>
>>
>> ------------------------------------------------------------------------------
>> Get 100% visibility into Java/.NET code with AppDynamics Lite!
>> It's a free troubleshooting tool designed for production.
>> Get down to code-level detail for bottlenecks, with <2% overhead.
>> Download for free and get started troubleshooting in minutes.
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Scikit-learn-general mailing list
>> Scikit-learn-general@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>>
>
>
------------------------------------------------------------------------------
Get 100% visibility into Java/.NET code with AppDynamics Lite!
It's a free troubleshooting tool designed for production.
Get down to code-level detail for bottlenecks, with <2% overhead. 
Download for free and get started troubleshooting in minutes. 
http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk
_______________________________________________
Scikit-learn-general mailing list
Scikit-learn-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general

Reply via email to