subject:"\[GitHub\] \[spark\] prog012 commented on issue #27077\: \[SPARK\-30408\]\[SQL\] Should not remove orderBy in sortBy clause in Optimizer"

[GitHub] [spark] prog012 commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox

prog012 commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573484402 @dongjoon-hyun I can close this PR but I still think this is a defect because it is about optimizer not

[GitHub] [spark] prog012 commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox

prog012 commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573399776 @dongjoon-hyun Yes, the dataset is partitioned as following in the example: ``` partition 0: