Re: [Scikit-learn-general] Hyperparameter optimization

2013-02-10 Thread Wei LI
In my point of view, to optimize the hyperparameters can not use standard optimization techniques(or else it will become a parameters and cannot be set empirically?) So some heuristic in brute force searching maybe a good idea. I am thinking another heuristic to accelerate such process: maybe a war

Re: [Scikit-learn-general] Hyperparameter optimization

2013-02-10 Thread Ronnie Ghose
just an idea. what about a gridsearch using multidim optimization? As in compute a heuristic and try to converge to an exact number On Sun, Feb 10, 2013 at 10:03 PM, wrote: > I have a pull request for randomized seaech but I need to update it as it > is quite old... > > > > Ronnie Ghose

Re: [Scikit-learn-general] Hyperparameter optimization

2013-02-10 Thread amueller
I have a pull request for randomized seaech but I need to update it as it is quite old... Ronnie Ghose schrieb: >afaik yes. Please tell me if i'm wrong, more experienced scikitters :) > > >On Sun, Feb 10, 2013 at 9:23 PM, Yaser Martinez >wrote: > >> Any further development on this? Is a "brut

Re: [Scikit-learn-general] Hyperparameter optimization

2013-02-10 Thread Ronnie Ghose
afaik yes. Please tell me if i'm wrong, more experienced scikitters :) On Sun, Feb 10, 2013 at 9:23 PM, Yaser Martinez wrote: > Any further development on this? Is a "brute force" grid search the only > alternative to the problem of parameter selection for lets say SVMs? > > > > > -

Re: [Scikit-learn-general] Hyperparameter optimization

2013-02-10 Thread Yaser Martinez
Any further development on this? Is a "brute force" grid search the only alternative to the problem of parameter selection for lets say SVMs? -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall be

Re: [Scikit-learn-general] Python 2.x & 3.x under one code base

2013-02-10 Thread Lars Buitinck
2013/2/10 Olivier Grisel : > I see that setup.py still does 2to3 translation in the build folder in > that branch. Have you tried to get rid of it? I didn't even try running it under Py3 yet. The problem is that mock_urllib2 is replaced by something called UrlopenMock (for obvious reasons), and I

[Scikit-learn-general] help scikit-learn random forest ntrees

2013-02-10 Thread Hossein Bashashati
Hi all, I have trained a a Random Forest with 10K trees but I am not sure this is the right number of trees for my datatset. I'd like to tune the right number of trees using the oob score. However, from the solution I see that the oob_score_ is just a float number. Which I guess is the average of

Re: [Scikit-learn-general] Python 2.x & 3.x under one code base

2013-02-10 Thread Olivier Grisel
2013/2/10 Olivier Grisel : > 2013/2/10 Lars Buitinck : >> Hi all, >> >> An update regarding Python 3.x compatibility. >> >> * I'm done rebasing Olivier's changes. I pushed the innocuous ones to >> master, including some six-related stuff (and, accidentally, a change >> that broke some tests, but th

Re: [Scikit-learn-general] Python 2.x & 3.x under one code base

2013-02-10 Thread Olivier Grisel
2013/2/10 Lars Buitinck : > Hi all, > > An update regarding Python 3.x compatibility. > > * I'm done rebasing Olivier's changes. I pushed the innocuous ones to > master, including some six-related stuff (and, accidentally, a change > that broke some tests, but that's been reverted). I managed to sa

Re: [Scikit-learn-general] Python 2.x & 3.x under one code base

2013-02-10 Thread Lars Buitinck
Hi all, An update regarding Python 3.x compatibility. * I'm done rebasing Olivier's changes. I pushed the innocuous ones to master, including some six-related stuff (and, accidentally, a change that broke some tests, but that's been reverted). I managed to salvage most of the changes, though not

[Scikit-learn-general] [off-topic] help solve a game theory/math challenge

2013-02-10 Thread Satrajit Ghosh
a friend of mine organized a challenge to determine strategies for winning in a game which simulates (at a very simplistic level) natural disasters. he asked me to see if a collaborative solution could be faster and better than the targeted solutions he is getting from people. i've summarized the

Re: [Scikit-learn-general] Bugfix release 0.13.1

2013-02-10 Thread Ronnie Ghose
+1. train_test_split is important On Sun, Feb 10, 2013 at 12:21 PM, Gael Varoquaux < [email protected]> wrote: > Excellent idea. I would also like to include an important joblib fix. I'll > try to do this tomorrow. > > - Original message - > > Hey everybody. > > I think it mi

Re: [Scikit-learn-general] Bugfix release 0.13.1

2013-02-10 Thread Gael Varoquaux
Excellent idea. I would also like to include an important joblib fix. I'll try to do this tomorrow. - Original message - > Hey everybody. > I think it might be worth considering a bug-fix release. > There was a problem with the nosetests and train_test_split on older > nose versions (I t

[Scikit-learn-general] Bugfix release 0.13.1

2013-02-10 Thread Andreas Mueller
Hey everybody. I think it might be worth considering a bug-fix release. There was a problem with the nosetests and train_test_split on older nose versions (I think) and a bug in MiniBatchKMeans for sparse matrices. These just cherry picking these and doing a quick release wouldn't be much trouble