Re: [Scikit-learn-general] ROC curve

2012-04-19 Thread Alexandre Gramfort
> Thank's Immanuel, would like to use python, but I study this alternative. my feeling is that it is not that hard to reimplement so if you do, please do not hesite to share the code with a gist or better a pull request. Alex --

Re: [Scikit-learn-general] ROC curve

2012-04-19 Thread Paulo Henrique Junqueira Amorim
Yes! Olivier, as the Immanuel said. There is already a multi-class approach to. Thank's Immanuel, would like to use python, but I study this alternative. Regards, On 19 April 2012 12:56, Immanuel B wrote: > Hi, > > the ROC curve has indeed been extended to the multiclass case. > for example:

Re: [Scikit-learn-general] ROC curve

2012-04-19 Thread Immanuel B
Hi, the ROC curve has indeed been extended to the multiclass case. for example: A simplified extension of the Area under the ROC to the multiclass domain http://homepage.tudelft.nl/a9p19/papers/prasa_06_vuc.pdf I have used the R pROC package for that, maybe that’s an option.

Re: [Scikit-learn-general] ROC curve

2012-04-19 Thread Olivier Grisel
Le 19 avril 2012 07:32, Paulo Henrique Junqueira Amorim a écrit : > Hi, > > I'm trying to plot ROC curve from multiple multiclass. It seems to me that > the library does not, how could get around it? the data I have are these: > > precision    recall  f1-score   support > 0  

[Scikit-learn-general] ROC curve

2012-04-19 Thread Paulo Henrique Junqueira Amorim
Hi, I'm trying to plot ROC curve from multiple multiclass. It seems to me that the library does not, how could get around it? the data I have are these: precisionrecall f1-score support 0 0.00 0.00 0.00 1 1 1.00 1.00 1.

Re: [Scikit-learn-general] ROC curve

2011-12-30 Thread adnan rajper
Thanks millions to Paolo, Gael and everybody. Adnan -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops

Re: [Scikit-learn-general] ROC curve

2011-12-30 Thread Paolo Losi
Hi Gael, On Thu, Dec 29, 2011 at 11:06 PM, Gael Varoquaux < [email protected]> wrote: > > To the other developers: is their a reason/difficulty for not having > Platt's method (implemented for SVC, AFAIK) for LinearSVC? > I've got a "draft" Platt's calibration implementation on a bran

Re: [Scikit-learn-general] ROC curve

2011-12-30 Thread Gael Varoquaux
On Fri, Dec 30, 2011 at 11:28:39AM +0100, Andreas Mueller wrote: > It might be that I haven't really understood the meaning of ROC > curves, but I thought it worked like @ogrisel said. > Whatever the correct method to produce a ROC curve > from a linear classifier, I'm pretty sure that using the de

Re: [Scikit-learn-general] ROC curve

2011-12-30 Thread Andreas Mueller
On 12/30/2011 10:15 AM, Gael Varoquaux wrote: > On Fri, Dec 30, 2011 at 10:09:59AM +0100, Olivier Grisel wrote: >>> * You could use the decision function, (decision_function method of the >>>LinearSVC) although this is clearly a hack. >> Why is this a hack? ROC is only concerned with the rela

Re: [Scikit-learn-general] ROC curve

2011-12-30 Thread Gael Varoquaux
On Fri, Dec 30, 2011 at 10:09:59AM +0100, Olivier Grisel wrote: > >  * You could use the decision function, (decision_function method of the > >   LinearSVC) although this is clearly a hack. > Why is this a hack? ROC is only concerned with the relative positions > of the decision threshold, not th

Re: [Scikit-learn-general] ROC curve

2011-12-30 Thread Olivier Grisel
2011/12/29 Gael Varoquaux : > On Thu, Dec 29, 2011 at 12:46:36PM -0800, adnan rajper wrote: >>    I use LinearSVC for text classification. My problem is that I want to >>    generate ROC curve for LinearSVC. Since LinearSVC does not output >>    probabilties. Is there any other way to  generate ROC

Re: [Scikit-learn-general] ROC curve

2011-12-29 Thread Paolo Losi
Hi Adnan, probability=True performs a probability calibration on the decision function. In order to generate the ROC curve you could directly use the output of decision_function method and obtain exactly the same result as if you used probability calibration (this is because calibration is a stric

Re: [Scikit-learn-general] ROC curve

2011-12-29 Thread Gael Varoquaux
On Thu, Dec 29, 2011 at 12:46:36PM -0800, adnan rajper wrote: >I use LinearSVC for text classification. My problem is that I want to >generate ROC curve for LinearSVC. Since LinearSVC does not output >probabilties. Is there any other way to  generate ROC curve for LinearSVC? >I have

[Scikit-learn-general] ROC curve

2011-12-29 Thread adnan rajper
hi everybody, I use LinearSVC for text classification. My problem is that I want to generate ROC curve for LinearSVC. Since LinearSVC does not output probabilties. Is there any other way to  generate ROC curve for LinearSVC? I have tried svm.SVC(kernel='linear', probabilities=True) but it gets