Github user WangTaoTheTonic commented on the pull request:
https://github.com/apache/spark/pull/5657#issuecomment-96377454
Considering one condition: user submit apps to master with a port config,
let's say `spark://somehost:7077`, and let workers connect to master same way.
Once master open another port, for instance 7078, it will be unavailable to
submit apps or accept works' registeration.
I know that retrying policy decrease probability of failing when launching
master but in the meantime it increase the chance for others to connect it.
Besides I have taken a look at start-all.sh, and it pass one specify port
to slave node to launch worker. Obviously worker could not take to master when
master take a different port with the passed one.
@srowen I thought it must make some trouble if we take that retries on
"public" port unless we found other way to solve it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
