Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/16432
so the changes look good. I just thought of one other thing though and
that is really the name and description of spark.yarn.access.namenodes is off.
I'll file a separate jira for that though
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71199/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #71199 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71199/testReport)**
for PR 16432 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #71199 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71199/testReport)**
for PR 16432 at commit
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/16432
@tgravescs , would you please review again, thanks a lot.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71065/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #71065 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71065/testReport)**
for PR 16432 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #71065 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71065/testReport)**
for PR 16432 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71056/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #71056 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71056/testReport)**
for PR 16432 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71054/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #71054 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71054/testReport)**
for PR 16432 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #71056 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71056/testReport)**
for PR 16432 at commit
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/16432
@tgravescs thanks for your comments, I also tested with webhdfs with
configuration like:
```
--conf spark.yarn.access.namenodes=webhdfs://c6402.ambari.apache.org:50070/
```
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #71054 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71054/testReport)**
for PR 16432 at commit
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/16432
few minor doc comments, otherwise looks good.
Could you also please test with webhdfs.
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70910/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #70910 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70910/testReport)**
for PR 16432 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #70910 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70910/testReport)**
for PR 16432 at commit
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/16432
Ok can we change the name of this from FileSystem to be HadoopFileSystem or
HadoopFs to be a bit more clear and then update the docs accordingly to make
sure we specify what the requirements are
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/16432
Thanks @tgravescs for your comments. Yes actually it should be Hadoop
compatible file systems, or in other words should be Hadoop `FileSystem` API
supported FS. I tested with kerberized HDFS and
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/16432
what kind of testing have you done on this?
A couple of concerns:
1) FileSystem is kind of obscure, really I think it means hadoop
filesystems. It won't work for just any
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70715/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #70715 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70715/testReport)**
for PR 16432 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #70715 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70715/testReport)**
for PR 16432 at commit
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/16432
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16432
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70712/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16432
**[Test build #70712 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70712/testReport)**
for PR 16432 at commit
35 matches
Mail list logo
