Kent Yao created SPARK-36659:
--------------------------------

             Summary: Promote spark.sql.execution.topKSortFallbackThreshold to 
user-faced config
                 Key: SPARK-36659
                 URL: https://issues.apache.org/jira/browse/SPARK-36659
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.2.0, 3.3.0
            Reporter: Kent Yao


spark.sql.execution.topKSortFallbackThreshold now is an internal config hidden 
from users Integer.MAX_VALUE - 15 as its default. In many real-world cases, if 
the K is very big,  there would be performance issues.

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to