GitHub user sethah opened a pull request:
https://github.com/apache/spark/pull/15574
[SPARK-18019][ML] Add instrumentation to GBTs
## What changes were proposed in this pull request?
Add instrumentation for logging in ML GBT, part of umbrella ticket
[SPARK-14567](https://issues.apache.org/jira/browse/SPARK-14567)
## How was this patch tested?
Tested locally:
````
16/10/20 10:24:51 INFO Instrumentation:
GBTRegressor-gbtr_2b460d3e2e93-1207021668-45: training: numPartitions=1
storageLevel=StorageLevel(1 replicas)
16/10/20 10:24:51 INFO Instrumentation:
GBTRegressor-gbtr_2b460d3e2e93-1207021668-45: {"maxIter":1}
16/10/20 10:24:51 INFO Instrumentation:
GBTRegressor-gbtr_2b460d3e2e93-1207021668-45: {"numFeatures":2}
16/10/20 10:24:51 INFO Instrumentation:
GBTRegressor-gbtr_2b460d3e2e93-1207021668-45: {"numClasses":0}
...
16/10/20 15:54:21 INFO Instrumentation:
GBTRegressor-gbtr_065fad465377-1922077832-22: training finished
````
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sethah/spark gbt_instr
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15574.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15574
----
commit 2daba5fe042330ea1060f4f5c48b84d225739b82
Author: sethah <[email protected]>
Date: 2016-10-20T16:54:53Z
add instr to gbt
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
