Jim Carroll created SPARK-7100:
----------------------------------
Summary: GradientBoostTrees leaks a persisted RDD
Key: SPARK-7100
URL: https://issues.apache.org/jira/browse/SPARK-7100
Project: Spark
Issue Type: Bug
Components: MLlib
Affects Versions: 1.3.1, 1.2.2
Reporter: Jim Carroll
Fix For: 1.4.0
It appears GradientBoostedTrees.scala can call 'persist' on an RDD and never
unpersist it.
In the master branch it's in GradientBoostedTrees.boost method. It "persists"
the input RDD if it's not already persisted but doesn't unpersist it.
I'll be submitting a PR with a fix.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
