Re: [Scikit-learn-general] Trees with unbalanced classes

2013-11-19 Thread Michael Lovell
Sergey Feldman sergeyfeldman@... writes: Hi Sergey, I am having the exact same issue with my data set except its 80 dimensional and I only have two classes where the classes are unbalanced about 5:1. I am also using random forest in sklearn. Just curious how well did using Manish's

[Scikit-learn-general] Trees with unbalanced classes

2013-07-12 Thread Sergey Feldman
I'm dealing with a 50-class classification problem with extremely unbalanced classes. The smallest class has about 1000 samples and the largest has 500,000. The random forest I've trained is being heavily skewed towards the big classes. Is there a good way to deal with this kind of problem in

Re: [Scikit-learn-general] Trees with unbalanced classes

2013-07-12 Thread Manish Amde
Hi Sergey, There is a sample_weights option (not very well documented) in the random forest classifier that might help. You might want to check out the SVC example to see the sample_weights format. http://scikit-learn.org/stable/auto_examples/svm/plot_weighted_samples.html You can provide

Re: [Scikit-learn-general] Trees with unbalanced classes

2013-07-12 Thread Sergey Feldman
Thanks, Manish! Exactly what I was looking for. On Fri, Jul 12, 2013 at 4:52 PM, Manish Amde manish...@gmail.com wrote: Hi Sergey, There is a sample_weights option (not very well documented) in the random forest classifier that might help. You might want to check out the SVC example to