Github user klion26 commented on the issue:
https://github.com/apache/spark/pull/19145
sorry for the late response, IIUC, in MR, this case handled by below
1. AM received the container failed message
2. AM will check whether there are any attempts of the same task is RUNNING
or SUCCEED
2.1 If step 2 returns true, then MR ignores the failed message
2.2 if step 2 returns false, then MR will request a new container and run
the specified task
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
