Re: MLlib OneVsRest causing intermittent exceptions

2016-01-27 Thread David Brooks
why should it throw an exception? if it does, then i would think we >> need to fix the issue in the underlying algorithm instead of the >> reduction somehow knowing that the binary classifier is sampling from the >> training dataset. >> >> Or am I misunderstanding the iss

Re: MLlib OneVsRest causing intermittent exceptions

2016-01-26 Thread David Brooks
he labels? > > Ram > > On Mon, Jan 25, 2016 at 3:06 PM, David Brooks <da...@whisk.co.uk> wrote: > >> Hi, >> >> I've run into an exception using MLlib OneVsRest with logistic regression >> (v1.6.0, but also in previous versions). >> &g

Re: MLlib OneVsRest causing intermittent exceptions

2016-01-26 Thread David Brooks
the label metadata as a shortcut. Do you agree that there is an issue here? Would you accept contributions to the code to remedy it? I'd gladly take a look if I can be of help. Many thanks, David On Tue, Jan 26, 2016 at 1:29 PM David Brooks <da...@whisk.co.uk> wrote: > Hi Ram, > > I

Re: MLlib OneVsRest causing intermittent exceptions

2016-01-26 Thread David Brooks
it. We can help review it and pull in the fix... happy to accept >> contributions! >> ccing Joseph who is one of the maintainers of MLLib as well.. when >> creating the JIRA can you attach a simple test case? >> >> On Tue, Jan 26, 2016 at 2:59 PM, David Brooks <d

MLlib OneVsRest causing intermittent exceptions

2016-01-25 Thread David Brooks
Hi, I've run into an exception using MLlib OneVsRest with logistic regression (v1.6.0, but also in previous versions). The issue is intermittent. When running multiclass classification with K-fold cross validation, there are scenarios where the split does not contain instances for every target