Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58359605
test failure is in streaming-flume, totally unrelated to this.
changes look good, thanks @vanzin
---
If your project is set up for it, you can reply to this
Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58359865
changes look good.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/2649
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58407077
I merged this into branch-1.1 a few hours ago.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user vanzin closed the pull request at:
https://github.com/apache/spark/pull/2650
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58407924
Hmm, wonder why it wasn't closed then.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58224804
Jenkins, test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58225142
Ah so you really mean when using viewFS. You can use federation without
viewfs.
---
If your project is set up for it, you can reply to this email and have your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58226025
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21387/consoleFull)
for PR 2650 at commit
Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58227159
No necessarily; this affects HA too, which uses the hdfs protocol, not
viewfs.
---
If your project is set up for it, you can reply to this email and have your
reply
Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58235841
right what I meant to say was it affects HA and ViewFs. it doesn't affect
all federated hdfs clusters as I can use federation without Viewfs.Its not
a big deal as
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58239708
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21392/consoleFull)
for PR 2649 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58239739
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21391/consoleFull)
for PR 2650 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58240899
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58240880
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21387/consoleFull)
for PR 2650 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58248860
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21392/consoleFull)
for PR 2649 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58248876
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58252910
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21391/consoleFull)
for PR 2650 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-58252919
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58023951
The changes look fine, although I don't think this applies to federation.
My understanding of federation was the namespace wasn't viewable on the client
side. The
Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-58047851
The default FS on a federated HDFS would be something like
viewfs://namespace; so when deciding whether to upload files, the two URIs
would have that at the start, so
GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/2649
[SPARK-3788] [yarn] Fix compareFs to do the right thing for HA, federati...
...on.
HA and federation use namespaces instead of host names, so you can't
resolve them since that will fail.
Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-57880944
I tested this on both regular and federated HDFS, verified that the Upload
foo... message in the logs does not show up in either while it would show up
for federated HDFS
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-57881327
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21280/consoleFull)
for PR 2649 at commit
GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/2650
[SPARK-3788] [yarn] Fix compareFs to do the right thing for HA, federati...
...on (1.1 version).
HA and federation use namespaces instead of host names, so you can't
resolve them since
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-57882214
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21281/consoleFull)
for PR 2650 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-57888034
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21282/consoleFull)
for PR 2650 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-57888024
[QA tests have
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21283/consoleFull)
for PR 2649 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-57888370
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-57888369
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21280/consoleFull)
for PR 2649 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-57890530
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21281/consoleFull)
for PR 2650 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-57890533
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-57891421
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21283/consoleFull)
for PR 2649 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2649#issuecomment-57891422
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-57891483
[QA tests have
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21282/consoleFull)
for PR 2650 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2650#issuecomment-57891486
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
36 matches
Mail list logo
