cloud-fan commented on issue #22806: [SPARK-25250][CORE] : On successful completion of a task attempt on a parti… URL: https://github.com/apache/spark/pull/22806#issuecomment-450545776 > Stage 4.1 now spawns task with index 2000 on the same partition id 9000. This task fails due to CommitDeniedException and since, it does not see the corresponding partition id as been marked successful, it keeps retrying multiple times until the job finally succeeds. Can you explain the code path that does it? This part is a little convoluted...
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
