ulysses you created SPARK-34899:
-----------------------------------
Summary: Use origin plan if can not coalesce shuffle partition
Key: SPARK-34899
URL: https://issues.apache.org/jira/browse/SPARK-34899
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: ulysses you
The `CoalesceShufflePartitions` can not coalesce such case if the total shuffle
partitions of mappers are big enough. Then it's confused to use
`CustomShuffleReaderExec` which marked as `coalesced` but has no affect with
partition number.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
