GitHub user bjornjon opened a pull request:
https://github.com/apache/spark/pull/11644
[SPARK-13810] [CORE] Add Port Configuration Suggestions on Bind Exceptions
## What changes were proposed in this pull request?
Currently, when a java.net.BindException is thrown, it displays the
following message, irrespective of the port being used:
java.net.BindException: Address already in use: Service '$serviceName'
failed after 16 retries!
The changes here add port configuration suggestions for spark.ui.port,
spark.driver.port and spark.blockManager.port. For example, if the Spark UI
exceeds spark.port.maxRetries, users will see:
java.net.BindException: Address already in use: Service 'SparkUI' failed
after 16 retries! Consider setting spark.ui.port to an available port or
increasing spark.port.maxRetries.
## How was this patch tested?
Manual tests for SparkUI, sparkDriver and NettyBlockTransferService port
bind exceptions.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bjornjon/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11644.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11644
----
commit d815d8a9f7b97921fa93e9c35c114275bae715b3
Author: Bjorn Jonsson <[email protected]>
Date: 2016-03-11T02:06:23Z
Optional Parameter to Allow Port Configuration Suggestions on Bind Collision
commit 8993cec1e895762ba8f991bff8c5037949457945
Author: Bjorn Jonsson <[email protected]>
Date: 2016-03-11T02:19:43Z
Bind Collision Error Message for spark.ui.port
commit ecddc9d8ba6a57665b29073712ae0b90c82ab5f7
Author: Bjorn Jonsson <[email protected]>
Date: 2016-03-11T02:23:51Z
Bind Collision Error Message for spark.blockManager.port
commit ca140d417e36b991caf8afb7b43ede406810c27a
Author: Bjorn Jonsson <[email protected]>
Date: 2016-03-11T02:40:29Z
Bind Collision Error Message for spark.driver.port
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
