[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159096459 **[Test build #46561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46561/consoleFull)** for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159145470 **[Test build #46571 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46571/consoleFull)** for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159145524 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159145523 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159149102 If anything, this seemed to make thing slower. Closing for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread JoshRosen
Github user JoshRosen closed the pull request at: https://github.com/apache/spark/pull/5622 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159121936 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159121935 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159123420 **[Test build #46571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46571/consoleFull)** for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-159121850 **[Test build #46561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46561/consoleFull)** for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-155844652 **[Test build #45642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45642/consoleFull)** for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-155844842 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-155844838 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-155806567 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-11 Thread JoshRosen
GitHub user JoshRosen reopened a pull request: https://github.com/apache/spark/pull/5622 [SPARK-7041] Avoid writing empty files in BypassMergeSortShuffleWriter In BypassMergeSortShuffleWriter, we may end up opening disk writers files for empty partitions; this occurs because we

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-155806597 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-11-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-155807725 **[Test build #45642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45642/consoleFull)** for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-29 Thread JoshRosen
Github user JoshRosen closed the pull request at: https://github.com/apache/spark/pull/5622 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110465743 [Test build #34520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34520/console) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110467184 looks like a real failure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110445615 [Test build #34520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34520/consoleFull) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110465759 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5622#discussion_r32042266 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/BypassMergeSortShuffleWriter.java --- @@ -107,6 +107,14 @@ public void

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/5622#discussion_r32041847 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/BypassMergeSortShuffleWriter.java --- @@ -107,6 +107,14 @@ public void

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110445404 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110445427 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110482220 Yeah, I know how to fix it and will do so in a bit. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110090152 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110090346 [Test build #34454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34454/consoleFull) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-08 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110089961 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110090122 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110114768 [Test build #34454 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34454/console) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-110114776 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109447727 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109447841 [Test build #34314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34314/consoleFull) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109447713 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109485938 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109481263 [Test build #34314 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34314/console) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109481267 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109485948 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109485393 [Test build #34311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34311/consoleFull) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109485688 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109485413 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109486106 [Test build #34340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34340/consoleFull) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109498580 [Test build #34340 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34340/console) for PR 5622 at commit

[GitHub] spark pull request: [SPARK-7041] Avoid writing empty files in Bypa...

2015-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5622#issuecomment-109498608 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your