Re: [Scikit-learn-general] Suggestion: break up the metrics module

2014-11-02 Thread Andy
On 10/15/2014 04:59 AM, Michael Eickenberg wrote: > +1 for what Gaël and Arnaud say. > > In addition to that, I don't know if a distinction between two groups > of metrics is necessarily straightforward. At which number of > properties would one draw the line? Triangular inequality? Is KL > dive

Re: [Scikit-learn-general] Suggestion: break up the metrics module

2014-10-15 Thread Michael Eickenberg
+1 for what Gaël and Arnaud say. In addition to that, I don't know if a distinction between two groups of metrics is necessarily straightforward. At which number of properties would one draw the line? Triangular inequality? Is KL divergence an "evaluation metric" or a "distance metric"? It almost

Re: [Scikit-learn-general] Suggestion: break up the metrics module

2014-10-15 Thread Arnaud Joly
I totally agree with Gael. I would welcome improvements in the narrative documentation of http://scikit-learn.org/stable/modules/metrics.html about distances and kernels. It feels empty compare to http://scikit-learn.org/stable/modules/model_evaluation.html Best regards, Arnaud On 14 Oct 2014,

Re: [Scikit-learn-general] Suggestion: break up the metrics module

2014-10-15 Thread Daniel Vainsencher
Google is nice and I certainly use it, but I also often use - IPython autocomplete - Browsing the file system and when they work, they are less of a distraction than Google. So having *casual user discoverable* categories really is an actual benefit. Of course breakage is cost, so changes should

Re: [Scikit-learn-general] Suggestion: break up the metrics module

2014-10-14 Thread Gael Varoquaux
On Wed, Oct 15, 2014 at 06:53:35AM +1100, Robert Layton wrote: > Currently the word "metrics" is overloaded with at least two type of > algorithms in that module. The first is evaluation metrics and the > second is functions dealing with distance metrics. Please, let's just try as much as possible

Re: [Scikit-learn-general] Suggestion: break up the metrics module

2014-10-14 Thread Joel Nothman
We had a plan to move out the model selection stuff. Presently that talked about moving scorers, but not necessarily the metrics underlying them On 15 October 2014 07:16, Lars Buitinck wrote: > 2014-10-14 21:53 GMT+02:00 Robert Layton : > > Currently the word "metrics" is overloaded with at

Re: [Scikit-learn-general] Suggestion: break up the metrics module

2014-10-14 Thread Lars Buitinck
2014-10-14 21:53 GMT+02:00 Robert Layton : > Currently the word "metrics" is overloaded with at least two type of > algorithms in that module. The first is evaluation metrics and the second is > functions dealing with distance metrics. > > My suggestion is to: > 1) Move the evaluation metrics to a