[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-12-04 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-65734742 This looks good to me, since I think that there's no reason to download the temporary file to a different directory than its intended destination. I'd like to be able

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-30 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-65015813 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-65016199 [Test build #23968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23968/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-65019860 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-65019858 [Test build #23968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23968/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-21 Thread preaudc
Github user preaudc commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-63969515 I have no clue what could bring this MiMa test failure, and how to fix it. Can anybody give me a hand? --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-63698467 [Test build #23617 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23617/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-63712137 [Test build #23617 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23617/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-63712145 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-07 Thread preaudc
Github user preaudc commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-62119248 As @ryan-williams pointed out, this is initially only a workaround to SPARK-3967. I have still no idea why the move fails (with a {{Permission denied}}) when the

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-06 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-62072713 Hey @preaudc can you explain how this fixes SPARK-3967? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-06 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-62073026 Also, how does this relate to #2848? Can you and @ryan-williams sort out which PR makes more sense? --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-06 Thread ryan-williams
Github user ryan-williams commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-62076919 #2484 seems beneficial no matter what; why would we ever copy a JAR we've just confirmed is identical to the thing already at the destination? --- If your project

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-06 Thread ryan-williams
Github user ryan-williams commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-62077177 I don't think these two PRs are necessarily that related though, other than each having been borne as a workaround to the same stack-trace. There may be a common

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-61476791 [Test build #22815 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22815/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-61478546 [Test build #22816 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22816/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-03 Thread preaudc
Github user preaudc commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-61479433 I've just resync my local fork so that the patch merges cleanly (i.e. there are no other modifications compared to the initial patch) --- If your project is set up for

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-61489693 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-61489683 [Test build #22815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22815/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-61491002 [Test build #22816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22816/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-61491020 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-10-28 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-60823800 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-10-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-60824330 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22374/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-10-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-60838290 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22374/consoleFull) for PR 2855 at commit

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-10-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-60838296 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-10-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-60014023 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-10-20 Thread preaudc
GitHub user preaudc opened a pull request: https://github.com/apache/spark/pull/2855 [SPARK-3967] Ensure that files are fetched atomically tempFile is created in the same directory than targetFile, so that the move from tempFile to targetFile is always atomic You can merge this

[GitHub] spark pull request: [SPARK-3967] Ensure that files are fetched ato...

2014-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2855#issuecomment-59722947 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your