manuzhang commented on pull request #29540: URL: https://github.com/apache/spark/pull/29540#issuecomment-681767250
@cloud-fan Thanks for your advice and reminding me that min size of 1 will achieve the same thing as this PR. One thing I have seen different results > it won't be worse than AQE off Given a large number of initial partitions, e.g. 10000, AQE could be worse when it falls back to a larger parallelism than needed. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
