[
https://issues.apache.org/jira/browse/SPARK-48956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867668#comment-17867668
]
xuanzhiang commented on SPARK-48956:
------------------------------------
I found out that the mission failed because of shuffle. Because the task failed
with a shuffle data fetch failure, so the previous stage needs to be re-run.
!image-2024-07-22-14-47-50-773.png!
> Spark Repartition Task Field Retry Cause Data Duplication
> ---------------------------------------------------------
>
> Key: SPARK-48956
> URL: https://issues.apache.org/jira/browse/SPARK-48956
> Project: Spark
> Issue Type: Bug
> Components: Shuffle
> Affects Versions: 3.2.1
> Reporter: xuanzhiang
> Priority: Major
> Attachments: image-2024-07-21-18-21-33-888.png,
> image-2024-07-21-18-22-04-665.png, image-2024-07-22-10-00-45-793.png,
> image-2024-07-22-14-47-50-773.png
>
>
> The question seems like
> [SPARK-23207|https://issues.apache.org/jira/browse/SPARK-23207]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
