[GitHub] spark issue #19288: [SPARK-22075][ML] GBTs unpersist datasets cached by Peri...
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/19288 @srowen I check `LDA` : although `unpersistDataSet` is not called in it, no intermediate cached rdds is generated after `fit()`. Then I check `Pregel`, and find that each call of `connectedComponents` will add two intermediate cached rdds. So I call `unpersistDataSet` in it and the issue is fixed. There is no other places using checkpointer. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19288: [SPARK-22075][ML] GBTs unpersist datasets cached by Peri...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19288 **[Test build #81982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81982/testReport)** for PR 19288 at commit [`723c449`](https://github.com/apache/spark/commit/723c44965bc502333aef4f1c5108d487c0facc50). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19288: [SPARK-22075][ML] GBTs unpersist datasets cached by Peri...
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/19288 @srowen In MLlib, `PeriodicRDDCheckpointer` is only used in `GradientBoostedTrees`. I just find that there is another checkpointer `PeriodicGraphCheckpointer`, I will check it. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19288: [SPARK-22075][ML] GBTs unpersist datasets cached by Peri...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19288 **[Test build #81975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81975/testReport)** for PR 19288 at commit [`d39b028`](https://github.com/apache/spark/commit/d39b028a30f4cf5a63156b18fccce00c8165ac9a). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19288: [SPARK-22075][ML] GBTs unpersist datasets cached by Peri...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19288 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19288: [SPARK-22075][ML] GBTs unpersist datasets cached by Peri...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19288 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81970/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19288: [SPARK-22075][ML] GBTs unpersist datasets cached by Peri...
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/19288 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19288: [SPARK-22075][ML] GBTs unpersist datasets cached by Peri...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19288 **[Test build #81970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81970/testReport)** for PR 19288 at commit [`d39b028`](https://github.com/apache/spark/commit/d39b028a30f4cf5a63156b18fccce00c8165ac9a). * This patch **fails due to an unknown error code, -9**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
