Github user WangTaoTheTonic commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-142156332
@JoshRosen @andrewor14 @srowen @pfxuan
As the network related configurations need to be considered globally, I
will close this for now.
---
If your project
Github user WangTaoTheTonic closed the pull request at:
https://github.com/apache/spark/pull/4505
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the featur
Github user pfxuan commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-137005239
@WangTaoTheTonic , this could be a useful feature for further integration
with other systems:
http://hortonworks.com/blog/multihoming-on-hadoop-yarn-clusters/
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-136918445
@WangTaoTheTonic let's close this patch since I don't think there is
sufficient interest in this feature to warrant the additional complexity it
introduces.
---
If
Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-91971035
@WangTaoTheTonic, to clarify the use-case, is the goal here to _prevent_
requests on certain network interfaces from being able to access Spark
components?
Thi
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-75911609
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/27
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-75911600
[Test build #27940 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27940/consoleFull)
for PR 4505 at commit
[`5520c70`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-75905956
[Test build #27940 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27940/consoleFull)
for PR 4505 at commit
[`5520c70`](https://githu
Github user WangTaoTheTonic commented on a diff in the pull request:
https://github.com/apache/spark/pull/4505#discussion_r25316462
--- Diff:
core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala ---
@@ -23,46 +23,56 @@ import org.apache.spark.util.{IntParam, Mem
Github user WangTaoTheTonic commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-75891305
Assume that machines in our cluster have two network interfaces, one is
used for management mainly while the other is used for business. Spark is the
only one of
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-75106654
@WangTaoTheTonic what is the motivation for binding to a different host
other than `0.0.0.0`? IIUC binding to `0.0.0.0` means you bind to all local
interfaces. If we m
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/4505#discussion_r25010835
--- Diff:
core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala ---
@@ -23,46 +23,56 @@ import org.apache.spark.util.{IntParam, MemoryPa
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/4505#discussion_r25010786
--- Diff:
core/src/main/scala/org/apache/spark/deploy/worker/WorkerArguments.scala ---
@@ -23,46 +23,56 @@ import org.apache.spark.util.{IntParam, MemoryPa
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73752506
[Test build #27212 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27212/consoleFull)
for PR 4505 at commit
[`3a768d4`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73752518
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/27
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73738163
[Test build #27212 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27212/consoleFull)
for PR 4505 at commit
[`3a768d4`](https://githu
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73733355
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/27
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73733352
[Test build #27210 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27210/consoleFull)
for PR 4505 at commit
[`c71f838`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73732948
[Test build #27210 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27210/consoleFull)
for PR 4505 at commit
[`c71f838`](https://githu
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73710867
[Test build #27206 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27206/consoleFull)
for PR 4505 at commit
[`1442447`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73710872
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/27
Github user WangTaoTheTonic commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73703993
As now we have these configs, is it necessary to keep `SPARK_PUBLIC_DNS`?
If yes, in which order should we place it?
---
If your project is set up for i
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/4505#issuecomment-73701822
[Test build #27206 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27206/consoleFull)
for PR 4505 at commit
[`1442447`](https://githu
GitHub user WangTaoTheTonic opened a pull request:
https://github.com/apache/spark/pull/4505
[SPARK-5719]allow daemons to bind to specified host
https://issues.apache.org/jira/browse/SPARK-5719
Add four config items to specify the host that daemons bind to:
spark.ma
24 matches
Mail list logo
