hiboyang commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-815061331
Hi guys, thanks for the comments here! One of the purposes of this PR is to get more discussion and collect feedbacks/suggestions :) Hope it could serve as an example to show how remote shuffle service may work with Spark in Kubernetes. Putting it inside Spark repo will give people some hint about how shuffle manager interfaces may impact other shuffle solutions, and how to keep the shuffle interfaces flexible for other people to extend and implement their own shuffle algorithm. This PR is still Work In Progress and we would like to see if any other people are interested to work together. We could have a zoom meeting to discuss more details as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
