attilapiros commented on pull request #34672: URL: https://github.com/apache/spark/pull/34672#issuecomment-983826971
@tgravescs I agree with you and I would be happy to work on the ideal solution. This is why I tried to push SPARK-31801 by copying Matthew Cheah's PR as https://github.com/apache/spark/pull/30763. But it got side tracked and become stale. Based on this experience I am afraid the ideal solution is a bit far away in the future. But right now we have this class at hand which can be used by those experimental shuffle solutions. And I would not block them without having a timeline for the ideal solution. I am sure all those solutions are useful for Spark as well as they are possible source of good feedbacks (especially for the ideal API) we just let them grow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
