Joseph K. Bradley created SPARK-3723:
----------------------------------------
Summary: DecisionTree, RandomForest: Add more instrumentation
Key: SPARK-3723
URL: https://issues.apache.org/jira/browse/SPARK-3723
Project: Spark
Issue Type: Improvement
Components: MLlib
Reporter: Joseph K. Bradley
Priority: Minor
Some simple instrumentation would help advanced users understand performance,
and to check whether parameters (such as maxMemoryInMB) need to be tuned.
Most important instrumentation (simple):
* min, avg, max nodes per group
* number of groups (passes over data)
More advanced instrumentation:
* For each tree (or averaged over trees), training set accuracy after training
each level. This would be useful for visualizing learning behavior (to
convince oneself that model selection was being done correctly).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
