This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from a57afd4 [SPARK-29223][SQL][SS] New option to specify timestamp on all
subscribing topic-partitions in Kafka source
add 859a534 [SPARK-35447][SQL] Optimize skew join before coalescing
shuffle partitions
No new revisions were added by this update.
Summary of changes:
.../execution/adaptive/AdaptiveSparkPlanExec.scala | 7 +-
.../adaptive/CoalesceShufflePartitions.scala | 93 +++---
.../execution/adaptive/OptimizeSkewedJoin.scala | 131 +++-----
.../execution/adaptive/ShufflePartitionsUtil.scala | 214 ++++++++++---
.../sql/execution/ShufflePartitionsUtilSuite.scala | 349 ++++++++++++++++++++-
5 files changed, 606 insertions(+), 188 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
