[ 
https://issues.apache.org/jira/browse/SPARK-34899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ulysses you updated SPARK-34899:
--------------------------------
        Parent: SPARK-33828
    Issue Type: Sub-task  (was: Improvement)

> Use origin plan if can not coalesce shuffle partition
> -----------------------------------------------------
>
>                 Key: SPARK-34899
>                 URL: https://issues.apache.org/jira/browse/SPARK-34899
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.2.0
>            Reporter: ulysses you
>            Assignee: ulysses you
>            Priority: Minor
>             Fix For: 3.2.0
>
>
> The `CoalesceShufflePartitions` can not coalesce such case if the total 
> shuffle partitions size of mappers are big enough. Then it's confused to use 
> `CustomShuffleReaderExec` which marked as `coalesced` but has no affect with 
> partition number.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to