mridulm commented on PR #56055: URL: https://github.com/apache/spark/pull/56055#issuecomment-4608460279
@jerrypeng Everything you describe cam be entirely in the integration layer - instead of at the scheduler. Note - I am not necessarily against the idea of doing this change : but the semantics of what is being proposed is not clear, or fleshed out IMO. We are letting the implementation details for a usecase define what the scheduler should look like, and making surgical changes to adapt to it - instead of defining what the semantics need to be (perhaps this has been done : but it is unclear from this PR anyway). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
