subject:"\[GitHub\] \[spark\] ulysses\-you commented on pull request #28900\: \[SPARK\-32056\]\[SQL\] Coalesce partitions for repartition by expressions when AQE is enabled"

[GitHub] [spark] ulysses-you commented on pull request #28900: [SPARK-32056][SQL] Coalesce partitions for repartition by expressions when AQE is enabled

2020-06-23 Thread GitBox

ulysses-you commented on pull request #28900: URL: https://github.com/apache/spark/pull/28900#issuecomment-648591126 > Seems currently the COALESCE hint doesn't allow default partition number usage. I'm not sure the reason about it. I mean the repartition, such as this sql `select

[GitHub] [spark] ulysses-you commented on pull request #28900: [SPARK-32056][SQL] Coalesce partitions for repartition by expressions when AQE is enabled

2020-06-23 Thread GitBox

ulysses-you commented on pull request #28900: URL: https://github.com/apache/spark/pull/28900#issuecomment-648564896 Can we add the feature in `ResolveCoalesceHints` ? Hint can call repartition with default shuffle number.