manbuyun opened a new pull request #30572: URL: https://github.com/apache/spark/pull/30572
### What changes were proposed in this pull request? When partitions are tracked by the catalog, that will compute all custom partition locations, especially when dynamic partitions, and the field staticPartitions is empty. The poor performance of the method listPartitions results in a long period of no response at the Driver. ### Why are the changes needed? 1. Improve list metastore partitions performance, 200 times better in our production environment ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? This change is already covered by existing tests ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
