ulysses you created SPARK-35137:
-----------------------------------
Summary: Revise outputpartitioning number in some SparkPlan
Key: SPARK-35137
URL: https://issues.apache.org/jira/browse/SPARK-35137
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: ulysses you
Revise the outputPartitioning number in some `SparkPlan`
* UnionExec
* RowDataSourceScanExec
* LogicalRDD
* RDDScanExec
* ExternalRDDScanExec
* ExpandExec
* BroadcastNestedLoopJoinExec
* CoGroupExec
The mian change follow the logical
1. if rdd is known, using `rdd.partitions.length`
2. using `child.outputPartitioning.numPartitions`
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
