[
https://issues.apache.org/jira/browse/SPARK-27228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805398#comment-16805398
]
Sean Owen commented on SPARK-27228:
-----------------------------------
(Please don't reopen unless the info or discussion has materially changed.)
I'm also not sure what's going on here, but 2.3.0 is fairly old now, and I can
imagine a number of fixes that could be relevant since then. You'd need to
reproduce against something newer, as 2.3.x will soon be EOL. I don't think
anyone would investigate further as is.
It could also be an env problem between Spark and YARN, etc.
> Spark long delay on close, possible problem with killing executors
> ------------------------------------------------------------------
>
> Key: SPARK-27228
> URL: https://issues.apache.org/jira/browse/SPARK-27228
> Project: Spark
> Issue Type: Bug
> Components: Block Manager
> Affects Versions: 2.3.0
> Reporter: Lukas Waldmann
> Priority: Major
> Attachments: log.html
>
>
> When using dynamic allocations after all jobs finishes spark delays for
> several minutes before finally finishes. Log suggest that executors are not
> cleared up properly.
> See the attachment for log
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
