HeartSaVioR commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-788617728
I think now this PR only has a concern on how to deal with static number of partitions when there's no required distribution. I picked repartition instead of coalesce to avoid messing up with the parallelism of computations in same stage. Picking up round-robin distribution is simply just because it looks to be the default for distribution without specific requirement of distribution. Please take a look again, and provide voices on above decision. Thanks in advance! ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
