CacheCheck created SPARK-31216:
----------------------------------
Summary: RDDs in GradientBoostedTress can be unpersisted earlier
for saving memory
Key: SPARK-31216
URL: https://issues.apache.org/jira/browse/SPARK-31216
Project: Spark
Issue Type: Improvement
Components: ML, MLlib
Affects Versions: 2.4.5
Reporter: CacheCheck
In ml.tree.impl.GradientBoostedTrees.boost(), _predErrorCheckpointer_ and
_input_ are unpersisted at last. Actually, they can be unpersisted before the
if(validate) block, so it can save memory for the computation in if block.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
