[
https://issues.apache.org/jira/browse/SPARK-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yuemeng updated SPARK-7094:
---------------------------
Description:
Run a application with yarn-client mode base on spark on yarn.During the
application is running, if the network status of driver has down, then the
driver process will be hung and not exit ever.
Reproduce Steps:
1.The client machine have two IP(IP_A,IP_B),IP_A is used for spark dirver host,
IP_B is used for check the status of driver.
2.Login this machine with IP_A，submmit SparkPI with yarn-client mode base on
spark on yarn.
3.When SparkPI is running, login this machine with IP_B, use command : ifconfig
eth IP_A down
4.We will see the process of SparkPI will be hung and not exit ever.
was:
Run a application with yarn-client mode base on spark on yarn.During the
application is running, if the network status of driver has down, then the
driver process will be hung and not exit ever.
Reproduce Step:
1.The client machine have two IP(IP_A,IP_B),IP_A is used for spark dirver host,
IP_B is used for check the status of driver.
2.Login this machine with IP_A，submmit SparkPI with yarn-client mode base on
spark on yarn.
3.When SparkPI is running, login this machine with IP_B, use command : ifconfig
eth IP_A down
4.We will see the process of SparkPI will be hung and not exit ever.
> driver process will be suspend when driver network has down
> -----------------------------------------------------------
>
> Key: SPARK-7094
> URL: https://issues.apache.org/jira/browse/SPARK-7094
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.1.1, 1.2.2, 1.3.1
> Environment: suse
> Reporter: yuemeng
> Labels: patch
> Fix For: 1.3.2, 1.4.0
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> Run a application with yarn-client mode base on spark on yarn.During the
> application is running, if the network status of driver has down, then the
> driver process will be hung and not exit ever.
> Reproduce Steps:
> 1.The client machine have two IP(IP_A,IP_B),IP_A is used for spark dirver
> host, IP_B is used for check the status of driver.
> 2.Login this machine with IP_A，submmit SparkPI with yarn-client mode base on
> spark on yarn.
> 3.When SparkPI is running, login this machine with IP_B, use command :
> ifconfig eth IP_A down
> 4.We will see the process of SparkPI will be hung and not exit ever.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
