yaooqinn opened a new issue #1018: URL: https://github.com/apache/incubator-kyuubi/issues/1018
### 1. Describe the feature In https://github.com/apache/spark/pull/33904, I faced a performance issue with the topK scenario where K is very large which can be avoided by setting spark.sql.execution.topKSortFallbackThreshold less than the K here. For Kyuubi users who run SQL only, improper topK SQLs will hold engines for quite a long time and they don't know why. With a proper value for spark.sql.execution.topKSortFallbackThreshold is more suite for Kyuubi's cases I'd suggest this value be set to 10000 ### 2. Motivation ### 3. Describe the solution ### 4. Additional context -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kyuubi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
