Hi Vlad, when using randomized grid search, does sklearn look into intermediate values, or does it samples from the values provided in the parameter grid?
Thank you, ________________________________________ From: Vlad Niculae [zephy...@gmail.com] Sent: Monday, April 20, 2015 12:50 PM To: scikit-learn-general@lists.sourceforge.net Subject: Re: [Scikit-learn-general] randomized grid search Hi Roberto > what does None do for max_depth? Copy-pasted from http://scikit-learn.org/stable/modules/generated/sklearn.tree.DecisionTreeClassifier.html "If None, then nodes are expanded until all leaves are pure or until all leaves contain less than min_samples_split samples.” > In particular, if lists are provided, does randomized grid search construct a > uniform probability distribution? Yes > If that's the case, I presume there is no advantage over GridSearchCV? You still get roughly the same advantages (if some parameters matter way more than others, you can get the good scores faster), as long as the grid you’re randomly sampling from is large enough. But if you have more informed distributions to specify, that’s even better. For convenience, when I have computing power and time to spare, I often run a few tens/hundreds iterations of RandomSearch on large discrete grids, and if it seems promising, I run a full GridSearch overnight with minimal changes to the code. For practical purposes, it would probably be a better use of the time to just do more random search, but if this would go into a paper, for some audiences it can be more convincing to say you searched a grid thoroughly. Hope this makes sense, Vlad > > Thank you, > > ------------------------------------------------------------------------------ > BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT > Develop your own process in accordance with the BPMN 2 standard > Learn Process modeling best practices with Bonita BPM through live exercises > http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ > source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF_______________________________________________ > Scikit-learn-general mailing list > Scikit-learn-general@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general ------------------------------------------------------------------------------ BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF _______________________________________________ Scikit-learn-general mailing list Scikit-learn-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/scikit-learn-general ------------------------------------------------------------------------------ BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF _______________________________________________ Scikit-learn-general mailing list Scikit-learn-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
