Carson Wang created SPARK-28356:
-----------------------------------
Summary: Do not reduce the number of partitions for repartition in
adaptive execution
Key: SPARK-28356
URL: https://issues.apache.org/jira/browse/SPARK-28356
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.0
Reporter: Carson Wang
Adaptive execution reduces the number of post-shuffle partitions at runtime,
even for shuffles caused by repartition. However, the user likely wants to get
the desired number of partition when he calls repartition even in adaptive
execution. It will be good to support not changing the number of post-shuffle
partition for repartition in adaptive execution.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
