HeartSaVioR commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-779436038
As I just commented on comment thread I'm OK to apply the parallelism regardless of requirement on distribution/sort. That sounds like a valid case, like the case the writer doesn't require any distribution/sort but wants to control the parallelism to avoid massive load on external storage. If the static parallelism applies on all cases, adding this to `RequiresDistributionAndOrdering` looks natural unless we want to open the possibility we drop the functionality. I'm open to hear more voice on this as well. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
