[
https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14362907#comment-14362907
]
Saisai Shao commented on SPARK-6304:
------------------------------------
Hi [~msoutier], seldom user will set this {{spark.driver.port}}, Spark itself
will randomly choose a port and set it to SparkConf, so according to this,
Spark Streaming will remove previously set port when recovering from checkpoint.
Basically why {{spark.driver.port}} need to be fixed? And potentially it needs
to be fixed when {{spark.driver.*}} is set by user.
> Checkpointing doesn't retain driver port
> ----------------------------------------
>
> Key: SPARK-6304
> URL: https://issues.apache.org/jira/browse/SPARK-6304
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.2.1
> Reporter: Marius Soutier
>
> In a check-pointed Streaming application running on a fixed driver port, the
> setting "spark.driver.port" is not loaded when recovering from a checkpoint.
> (The driver is then started on a random port.)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
