Re: [scikit-learn] Retracting model from the 'blackbox' SVM

2018-05-04 Thread Sebastian Raschka
Dear Wouter, for the SVM, scikit-learn wraps the LIBSVM and LIBLINEAR. I think the scikit-learn class SVC uses LIBSVM for every kernel. Since you are using the linear kernel, you could use the more efficient LinearSVC scikit-learn class to get similar results. I guess this in turn is easier to

Re: [scikit-learn] Retracting model from the 'blackbox' SVM (Sebastian Raschka)

2018-05-04 Thread David Burns
Hi Sebastian, If you are looking to reduce the feature space for your model, I suggest you look at the scikit-learn page on doing just that http://scikit-learn.org/stable/modules/feature_selection.html David On 2018-05-04 12:00 PM, scikit-learn-requ...@python.org wrote: Send scikit-learn m

[scikit-learn] Breiman vs. scikit-learn definition of Feature Importance

2018-05-04 Thread Niyaghi, Faraz
Greetings, This is Faraz Niyaghi from Oregon State University. I research on variable selection using random forest. To the best of my knowledge, there is a difference between scikit-learn's and Breiman's definition of feature importance. Breiman uses out of bag (oob) cases to calculate feature i

Re: [scikit-learn] Breiman vs. scikit-learn definition of Feature Importance

2018-05-04 Thread Sebastian Raschka
Not sure how it compares in practice, but it's certainly more efficient to rank the features by impurity decrease rather than by OOB permutation performance you wouldn't need to a) compute the OOB performance (an extra pass inference step) b) permute a feature column and do another inference pas

Re: [scikit-learn] Breiman vs. scikit-learn definition of Feature Importance

2018-05-04 Thread Johnson, Jeremiah
Faraz, take a look at the discussion of this issue here: http://parrt.cs.usfca.edu/doc/rf-importance/index.html Best, Jeremiah = Jeremiah W. Johnson, Ph.D Asst. Professor of Data Science Program Coordinator, B.S. in Analytics & Data Science University of Ne

[scikit-learn] Multi learn error.

2018-05-04 Thread aijaz qazi
Dear developers of Scikit , I am working on web page categorization with http://scikit.ml/ . *Question*: I am not able to execute MLkNN code on the link http://scikit.ml/api/classify.html. I have installed py 3.6. I found scipy versions not compatible with scikit.ml 0.0.5. Which version of s

Re: [scikit-learn] Multi learn error.

2018-05-04 Thread Roman Yurchak
Hi Aijaz, On 05/05/18 07:31, aijaz qazi wrote: > Dear developers of Scikit , Scikit is short for SciPy Toolkits (https://www.scipy.org/scikits.html); there is a number of those. Scikit-learn started as one (and this is the scikit-learn mailing list). The package you are refering is based on