[
https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035752#comment-15035752
]
Jaromir Vanek edited comment on SPARK-10911 at 12/2/15 1:04 PM:
----------------------------------------------------------------
{quote}
why isn't YARN killing the executors?
{quote}
It's because in YARN there is also bug that prevents container from being
killed by process signal. Will be fixed in Hadoop 2.8.0
https://issues.apache.org/jira/browse/HADOOP-12441
was (Author: vanekjar):
{{quote}}
why isn't YARN killing the executors?
{{quote}}
It's because in YARN there is also bug that prevents container from being
killed by process signal. Will be fixed in Hadoop 2.8.0
https://issues.apache.org/jira/browse/HADOOP-12441
> Executors should System.exit on clean shutdown
> ----------------------------------------------
>
> Key: SPARK-10911
> URL: https://issues.apache.org/jira/browse/SPARK-10911
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.5.1
> Reporter: Thomas Graves
> Assignee: Zhuo Liu
> Priority: Minor
>
> Executors should call System.exit on clean shutdown to make sure all user
> threads exit and jvm shuts down.
> We ran into a case where an Executor was left around for days trying to
> shutdown because the user code was using a non-daemon thread pool and one of
> those threads wasn't exiting. We should force the jvm to go away with
> System.exit.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
