Victsm commented on pull request #30163: URL: https://github.com/apache/spark/pull/30163#issuecomment-727691393
@attilapiros thanks for that feedback, and we acknowledge the sentiment for the issues with small patches in a large feature. This is an oversight on my end when initially breaking SPARK-30602 into sub-tasks. I thought SPARK-32918 could be a reasonable sized patch but it turned out to be not the case. Both SPARK-32918 and SPARK-32919 are meant to be getting some of the prerequisites in place before getting to SPARK-32920 and SPARK-32921, which are relative major changes to key Spark driver components i.e. DAGScheduler and MapOutputTracker. The original intent was to make patches for SPARK-32920 and SPARK-32921 focusing on changes to these corresponding components only, given the potentially vigorous reviews we would receive for changing these components. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
