GitHub user hhbyyh opened a pull request:
https://github.com/apache/spark/pull/16158
[SPARK-18724][ML] Add TuningSummary for TrainValidationSplit
## What changes were proposed in this pull request?
jira: https://issues.apache.org/jira/browse/SPARK-18724
Currently TrainValidationSplitModel only provides tuning metrics in the
format of Array[Double], which makes it harder for tying the metrics back to
the paramMap generating them and affects the usefulness for the tuning
framework.
Add a Tuning Summary to provide better presentation for the tuning metrics,
for now the idea is to use a DataFrame listing all the params and corresponding
metrics.
The Tuning Summary Class can be further extended for CrossValidator.
## How was this patch tested?
existing and new unit tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/hhbyyh/spark tuningsummary
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16158.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16158
----
commit d1e22d58f5ecb5972f2ea528dc18d1230d678424
Author: Yuhao <[email protected]>
Date: 2016-12-03T00:49:29Z
tuning summary
commit a7cfa63c755c5760af1bd706f71a930d742a21ad
Author: Yuhao <[email protected]>
Date: 2016-12-05T18:50:41Z
Merge remote-tracking branch 'upstream/master' into tuningsummary
commit ad73c12fedbfd0b2348515c6b96766b5fa55c52a
Author: Yuhao <[email protected]>
Date: 2016-12-05T22:06:32Z
add ut
commit 425a41990b813dd68479c73249ebb7790e6f331e
Author: Yuhao <[email protected]>
Date: 2016-12-05T22:19:55Z
add comments
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
