2012/12/11 hannithebunny <[email protected]>:
> in the DecisionTreeClassifier one can choose either gini- or
> entropy-criterion. Actually the entropy value is calculated not
> correctly, because log (i.e. the natural logarithm) is applied instead
> of log2. Of course, the result is the same for both cases, but the
> definition of entropy applies log2.

Depends on whether entropy is measured in bits or in nats [1]. We use
log base-e throughout.

[1] https://en.wikipedia.org/wiki/Nat_(information)

-- 
Lars Buitinck
Scientific programmer, ILPS
University of Amsterdam

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general

Reply via email to