[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-04-14 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/855#discussion_r28363963 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDDCheckpointData.scala --- @@ -92,8 +92,13 @@ private[spark] class RDDCheckpointData[T:

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/855 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-04-14 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-93040724 Merging this into master thanks @witgo --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-03-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-78057557 [Test build #28430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28430/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-03-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-78075491 [Test build #28430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28430/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-78075511 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-25 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-76114183 @andrewor14 @tdas The code has been updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-76114203 [Test build #27975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27975/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-76114680 [Test build #27976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27976/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-76120081 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-76120505 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-76120498 [Test build #27976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27976/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-76120078 [Test build #27975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27975/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-22 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/855#discussion_r25144332 --- Diff: core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala --- @@ -206,6 +206,38 @@ class ContextCleanerSuite extends ContextCleanerSuiteBase {

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-22 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-75490741 @andrewor14 Yes, this is a good feature to have. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-75153316 @witgo @tdas This seems like a good feature to have. However, the PR has mostly gone stale at this point. Would you mind updating this to master? After you do that I

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2015-02-19 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/855#discussion_r25033376 --- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala --- @@ -32,6 +32,7 @@ private sealed trait CleanupTask private case class

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-61223905 [Test build #22601 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22601/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-61228046 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-61228040 [Test build #22601 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22601/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-09-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-54776809 @tdas this has gone stale - can you take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-50853335 QA tests have started for PR 855. This patch merges cleanly. brView progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17654/consoleFull ---

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-50853502 QA results for PR 855:br- This patch FAILED unit tests.br- This patch merges cleanlybr- This patch adds no public classesbrbrFor more information see test

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-5085 QA results for PR 855:br- This patch PASSES unit tests.br- This patch merges cleanlybr- This patch adds no public classesbrbrFor more information see test

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-50870292 This is definitely better. Can you make add the documentation for this property in the configuration page? --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/855#discussion_r15690169 --- Diff: core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala --- @@ -206,6 +206,33 @@ class ContextCleanerSuite extends ContextCleanerSuiteBase {

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/855#discussion_r15690254 --- Diff: core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala --- @@ -206,6 +206,33 @@ class ContextCleanerSuite extends ContextCleanerSuiteBase {

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/855#discussion_r15690344 --- Diff: core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala --- @@ -206,6 +206,33 @@ class ContextCleanerSuite extends ContextCleanerSuiteBase {

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-50891048 QA tests have started for PR 855. This patch merges cleanly. brView progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17673/consoleFull ---

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-50895949 This definitely is much better, thanks for the PR ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-50897414 QA results for PR 855:br- This patch PASSES unit tests.br- This patch merges cleanlybr- This patch adds no public classesbrbrFor more information see test

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-07-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-49192571 QA tests have started for PR 855. This patch merges cleanly. brView progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16731/consoleFull ---

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-07-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-49205391 QA results for PR 855:br- This patch PASSES unit tests.br- This patch merges cleanlybr- This patch adds no public classesbrbrFor more information see test