CodingCat commented on PR #3109: URL: https://github.com/apache/celeborn/pull/3109#issuecomment-2847409495
> What I meant was, we can simplify the code to not need to deal with running stage, etc. > > I have not validated/tested it - but this is along the lines of what I was thinking: https://github.com/mridulm/celeborn/commit/d060c293b07af806d42656142eeff3c5984b0806 > > > > (Note, this is just to illustrate the idea ... unfortunately I dont have bandwidth to complete it, so wanted to share it to help convey my idea better) i am not sure if it is the right direction to go, we already know for determinant stages we should not fail/restart certain stages in some scenario, why we fallback to a compromised solution? for indeterminate ones, since in 4.1 it will be aligned with the current version of PR, the PR just makes it future proof -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
