Re: [scikit-learn] top N accuracy classification metric

2017-01-26 Thread Johnson, Jeremiah
/jwjohnson314 From: scikit-learn <scikit-learn-bounces+jeremiah.johnson=unh@python.org> on behalf of Joel Nothman <joel.noth...@gmail.com> Sent: Saturday, January 21, 2017 5:52 AM To: Scikit-learn user and developer mailing list Subject: Re: [scikit-

Re: [scikit-learn] top N accuracy classification metric

2017-01-21 Thread Joel Nothman
There are metrics with that kind of input in sklearn.metrics.ranking. I don't have the time to look them up now, but there have been proposals and PRs for similar ranking metrics. Please search the issue tracker for related issues. Thanks, Joel On 21 January 2017 at 06:16, Johnson, Jeremiah

[scikit-learn] top N accuracy classification metric

2017-01-20 Thread Johnson, Jeremiah
Hi all, It's common to use a top-n accuracy metric for multi-class classification problems, where for each observation the prediction is the set of probabilities for each of the classes, and a prediction is top-N accurate if the correct class is among the N highest predicted probability