This is an automated email from the ASF dual-hosted git repository.
lixiao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 1369a97 [SPARK-31164][SQL] Inconsistent rdd and output partitioning
for bucket table when output doesn't contain all bucket columns
add 30d9535 [SPARK-31134][SQL] optimize skew join after shuffle
partitions are coalesced
No new revisions were added by this update.
Summary of changes:
.../execution/adaptive/AdaptiveSparkPlanExec.scala | 9 +-
.../adaptive/CoalesceShufflePartitions.scala | 2 -
.../execution/adaptive/OptimizeSkewedJoin.scala | 272 ++++++++++-----------
.../execution/adaptive/ShufflePartitionsUtil.scala | 18 +-
.../sql/execution/ShufflePartitionsUtilSuite.scala | 2 -
5 files changed, 146 insertions(+), 157 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
