mridulm commented on PR #3109: URL: https://github.com/apache/celeborn/pull/3109#issuecomment-2844021535
Given this applies to indeterminate stages (and not determinate stages), in the scenario presented where stage 0 is indeterminate - we must recompute stage 2 when stage 1 suffers from a fetch failure : else the data fetched for stage 1, when stage 0.1 runs - will no longer be consistent with what was already fetched for stage 2. A variant of this is discussed here: https://github.com/apache/spark/pull/50630 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
