Chandni Singh created SPARK-36255:
-------------------------------------
Summary: FileNotFound exceptions in the Shuffle-push-thread can
cause the executor to fail
Key: SPARK-36255
URL: https://issues.apache.org/jira/browse/SPARK-36255
Project: Spark
Issue Type: Bug
Components: Shuffle
Affects Versions: 3.1.0
Reporter: Chandni Singh
When the shuffle files are cleaned up the executors once a job completes, the
push of the shuffle data will throw FileNotFound exceptions. This exception
when thrown from the {{shuffle-block-push-thread}} still causes the executor to
fail.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
