This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 2c94fbc initial commit for skeleton ansible for jenkins worker config
add d46c1e3 [SPARK-35725][SQL] Support optimize skewed partitions in
RebalancePartitions
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/sql/internal/SQLConf.scala | 10 ++
.../execution/adaptive/AdaptiveSparkPlanExec.scala | 1 +
.../OptimizeSkewInRebalancePartitions.scala | 101 +++++++++++++++++++++
.../execution/adaptive/OptimizeSkewedJoin.scala | 40 +-------
.../execution/adaptive/ShufflePartitionsUtil.scala | 39 +++++++-
.../adaptive/AdaptiveQueryExecSuite.scala | 43 ++++++++-
6 files changed, 193 insertions(+), 41 deletions(-)
create mode 100644
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewInRebalancePartitions.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
