[ https://issues.apache.org/jira/browse/SPARK-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264191#comment-14264191 ]
Reynold Xin commented on SPARK-5007: ------------------------------------ [~yantangzhai] making it trying random ports makes it harder to configure firewalls. Maybe what you want is to allow a higher number of retries? > Try random port when startServiceOnPort to reduce the chance of port collision > ------------------------------------------------------------------------------ > > Key: SPARK-5007 > URL: https://issues.apache.org/jira/browse/SPARK-5007 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Reporter: YanTang Zhai > Priority: Minor > > When multiple Spark programs are submitted at the same node (called > springboard machine). The ports (default 4040) of these SparkUIs are from > 4040 to 4056. Then the Spark programs submitted later would fail because of > SparkUI port collision. > The chance of port collision could be reduced by setting spark.ui.port or > spark.port.maxRetries. > However, I think it's better to try random port when startServiceOnPort to > reduce the chance of port collision. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org