Chandni Singh created SPARK-36255:
-------------------------------------

             Summary: FileNotFound exceptions in the Shuffle-push-thread can 
cause the executor to fail
                 Key: SPARK-36255
                 URL: https://issues.apache.org/jira/browse/SPARK-36255
             Project: Spark
          Issue Type: Bug
          Components: Shuffle
    Affects Versions: 3.1.0
            Reporter: Chandni Singh


When the shuffle files are cleaned up the executors once a job completes, the 
push of the shuffle data will throw FileNotFound exceptions. This exception 
when thrown from the {{shuffle-block-push-thread}} still causes the executor to 
fail. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to