Ngone51 commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/26975#issuecomment-569375217 For case 1, if T2 successfully completed after T1, will T2 overriders T1's `MapStatus`? For case 2, I haven't understand yet: > since T2 is still running the partition will not be marked as not successful. So, the partition has marked as successful by T1? > After a while maybe another task finished and mark the TSM as finished Assuming there's a T0 from M0 finished, but mark which TSM as finished? TSM1 or TSM2 or both?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
