Re: [Scikit-learn-general] pruning trees

2011-12-06 Thread James Bergstra
On Tue, Dec 6, 2011 at 10:37 AM, Peter Prettenhofer wrote: > 2011/12/6 James Bergstra : >> On Fri, Dec 2, 2011 at 12:54 PM, Peter Prettenhofer >> wrote: >>> [...] >>> >> >> How does the current tree implementation support boosting? I don't see >> anything in the code about weighted samples. >> >>

Re: [Scikit-learn-general] pruning trees

2011-12-06 Thread Peter Prettenhofer
2011/12/6 James Bergstra : > On Fri, Dec 2, 2011 at 12:54 PM, Peter Prettenhofer > wrote: >> [...] >> > > How does the current tree implementation support boosting? I don't see > anything in the code about weighted samples. > > - James You're right - we don't support sample weights at the moment

Re: [Scikit-learn-general] pruning trees

2011-12-06 Thread James Bergstra
On Fri, Dec 2, 2011 at 12:54 PM, Peter Prettenhofer wrote: > 2011/12/2 James Bergstra : >> I'm looking at the decision tree code and I'm not seeing any pruning >> logic, or other logic to prevent over-fitting (other than requiring >> that leaf nodes be sufficiently populated).  Decision trees are

Re: [Scikit-learn-general] pruning trees

2011-12-02 Thread Peter Prettenhofer
2011/12/2 James Bergstra : > I'm looking at the decision tree code and I'm not seeing any pruning > logic, or other logic to prevent over-fitting (other than requiring > that leaf nodes be sufficiently populated).  Decision trees are not my > specialty, but pruning / early stopping seem often to be

[Scikit-learn-general] pruning trees

2011-12-02 Thread James Bergstra
I'm looking at the decision tree code and I'm not seeing any pruning logic, or other logic to prevent over-fitting (other than requiring that leaf nodes be sufficiently populated). Decision trees are not my specialty, but pruning / early stopping seem often to be mentioned in connection with trees