GitHub user holdenk opened a pull request:
https://github.com/apache/spark/pull/7205
[SPARK-8069][ML][WIP] add cutoff aka thresholds to random forest
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/holdenk/spark
SPARK-8069-add-cutoff-aka-threshold-to-random-forest
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7205.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7205
----
commit f79a8abf8dec03ca915c728bd35cfeac4829cb04
Author: Holden Karau <[email protected]>
Date: 2015-07-01T22:26:29Z
Add hasthresholds
commit ebba11568d21964657113cf7efe46cea9512d887
Author: Holden Karau <[email protected]>
Date: 2015-07-01T23:05:24Z
Start threading the threshold info through
commit 3b76f2a430f3896a75727cbf9fae058c9e95ef62
Author: Holden Karau <[email protected]>
Date: 2015-07-02T00:08:08Z
Use thresholds to scale scores in random forest classifcation
commit 4efcd6f147da5b6988de0da1d5385266866c1b97
Author: Holden Karau <[email protected]>
Date: 2015-07-02T01:06:51Z
Some more progress, start adding a test (maybe try and see if we can find a
better thing to use for the base of the test)
commit 471e2ab7c8008030b21d37e544c81317e1d31bd5
Author: Holden Karau <[email protected]>
Date: 2015-07-02T23:03:29Z
Move thresholding into Classifier trait
commit d6503766757079f5e44b754c1793eebcdb572df6
Author: Holden Karau <[email protected]>
Date: 2015-07-02T23:44:15Z
Fix test compile issues
commit 1b7b5436368ee461faf650c76109bd9a5572ca75
Author: Holden Karau <[email protected]>
Date: 2015-07-02T23:57:16Z
Start adding a classifiersuite
commit 6fa4a3859f9c2ba98e55975aae3ed35095245b7b
Author: Holden Karau <[email protected]>
Date: 2015-07-03T00:23:59Z
Move thresholds around some more (set on model not trainer)
commit 63a2169c2d6e5633f0651ba1e47c60d24d512223
Author: Holden Karau <[email protected]>
Date: 2015-07-03T01:14:51Z
Test passes again... little fnur
commit f8538a65a265e86724922aa63b0cc602a3c7603f
Author: Holden Karau <[email protected]>
Date: 2015-07-03T01:34:03Z
Some progress towards unifying threshold and thresholds
commit 98da200c2ef23d152a127fff7e7868af13750b0c
Author: Holden Karau <[email protected]>
Date: 2015-07-03T01:34:08Z
Wait that wasn't a good idea, Revert "Some progress towards unifying
threshold and thresholds"
This reverts commit f8538a65a265e86724922aa63b0cc602a3c7603f.
commit 6890d3b665a9d515bb4dc46c51c2da832ba75fb1
Author: Holden Karau <[email protected]>
Date: 2015-07-03T01:38:46Z
Add a global default of null for thresholds param
commit 10c2b8ead9bf3ddfbcfc6f0aab5644ad86425c47
Author: Holden Karau <[email protected]>
Date: 2015-07-03T01:42:39Z
Setting the thresholds only makes sense if the underlying class hasn't
overridden predict, so lets push it down.
commit 2bd3bdc3511a35b1ac349b700817e9dab825b5da
Author: Holden Karau <[email protected]>
Date: 2015-07-03T02:06:40Z
Fix creation of vote array
commit 860db3d09b3f38df1e0839d75cdcfade216c1d0e
Author: Holden Karau <[email protected]>
Date: 2015-07-03T02:07:01Z
Add a test with thresholding for the RFCS
commit aa572fb9ff41590c1175493b87473c32a5d44323
Author: Holden Karau <[email protected]>
Date: 2015-07-03T02:13:43Z
move setThresholds only to where its used
commit 90ef80fbc7b1b55bdce24c107a0a30603ceb6f9a
Author: Holden Karau <[email protected]>
Date: 2015-07-03T02:32:13Z
try and hide threshold but chainges the API so no dice there
commit a4e33eed3ea3b7c6ca3c912c177cc219dd3c19f7
Author: Holden Karau <[email protected]>
Date: 2015-07-03T02:32:19Z
Revert "try and hide threshold but chainges the API so no dice there"
This reverts commit 90ef80fbc7b1b55bdce24c107a0a30603ceb6f9a.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
