mridulm commented on pull request #34672: URL: https://github.com/apache/spark/pull/34672#issuecomment-983972185
Agree with @tgravescs. We are increasingly seeing external use/extensions of traits/classes explicitly marked private to spark, and changes to accommodate this pattern. This makes it more difficult to evolve the code - there is no explicit contract which we can check for while changing the code (`MapOutputTracker` is another example of this). Pushing on @attilapiros's work, working to explicitly open up subsystems with well defined contracts should help with this - instead of continuing to rely on internals. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
