[
https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xing Lin updated SPARK-41313:
-----------------------------
Description: spark-3900 fixed the illegalStateException in
cleanupStagingDir in ApplicationMaster's shutdownhook. However, spark-21138
reverted that change when fixing the "Wrong FS" bug. We need both fixes.
(was: spark-3900 fixed the illegalStateException in cleanupStagingDir in
ApplicationMaster's shutdownhook. However, spark-21138 reverted that fix for
fixing "Wrong FS" bug. We need both fixes. )
> Combine fixes for SPARK-3900 and SPARK-21138
> --------------------------------------------
>
> Key: SPARK-41313
> URL: https://issues.apache.org/jira/browse/SPARK-41313
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, YARN
> Affects Versions: 3.4.0
> Reporter: Xing Lin
> Priority: Major
>
> spark-3900 fixed the illegalStateException in cleanupStagingDir in
> ApplicationMaster's shutdownhook. However, spark-21138 reverted that change
> when fixing the "Wrong FS" bug. We need both fixes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
