[jira] [Commented] (SPARK-24193) Sort by disk when number of limit is big in TakeOrderedAndProjectExec

2020-05-08 Thread Xianjin YE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102458#comment-17102458 ] Xianjin YE commented on SPARK-24193: I used `df.rdd.collect` intentionally to trigger the problem as

[jira] [Commented] (SPARK-24193) Sort by disk when number of limit is big in TakeOrderedAndProjectExec

2020-05-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102439#comment-17102439 ] Wenchen Fan commented on SPARK-24193: - I think it's not a problem if you do `df.collect` instead of

[jira] [Commented] (SPARK-24193) Sort by disk when number of limit is big in TakeOrderedAndProjectExec

2020-05-08 Thread Xianjin YE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102285#comment-17102285 ] Xianjin YE commented on SPARK-24193: Hi, [~jinxing6...@126.com] [~cloud_fan] the fallback config has

[jira] [Commented] (SPARK-24193) Sort by disk when number of limit is big in TakeOrderedAndProjectExec

2018-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465192#comment-16465192 ] Apache Spark commented on SPARK-24193: -- User 'jinxing64' has created a pull request for this issue: