[
https://issues.apache.org/jira/browse/SPARK-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-4253:
-----------------------------------
Description:
We actually don't know where driver will be before it is launched in
yarn-cluster mode. If we set spark.driver.host property, Spark will create
Actor on the hostname or ip as setted, which will leads an error.
So we should ignore this config item in yarn-cluster mode.
As [~joshrosen]] pointed, we also ignore it in standalone cluster mode.
was:
We actually don't know where driver will be before it is launched in
yarn-cluster mode. If we set spark.driver.host property, Spark will create
Actor on the hostname or ip as setted, which will leads an error.
So we should ignore this config item in yarn-cluster mode.
> Ignore spark.driver.host in yarn-cluster mode
> ---------------------------------------------
>
> Key: SPARK-4253
> URL: https://issues.apache.org/jira/browse/SPARK-4253
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Reporter: WangTaoTheTonic
> Priority: Minor
> Attachments: Cannot assign requested address.txt
>
>
> We actually don't know where driver will be before it is launched in
> yarn-cluster mode. If we set spark.driver.host property, Spark will create
> Actor on the hostname or ip as setted, which will leads an error.
> So we should ignore this config item in yarn-cluster mode.
> As [~joshrosen]] pointed, we also ignore it in standalone cluster mode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
