This is an automated email from the ASF dual-hosted git repository. hvanhovell pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git.
from 3c4044e [SPARK-30703][SQL][DOCS] Add a document for the ANSI mode add a4ceea6 [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations No new revisions were added by this update. Summary of changes: .../spark/sql/execution/ShuffledRowRDD.scala | 23 +- .../execution/adaptive/CustomShuffledRowRDD.scala | 113 +++++++++ .../adaptive/OptimizeLocalShuffleReader.scala | 2 +- .../execution/adaptive/OptimizeSkewedJoin.scala | 276 +++++++++++++-------- .../adaptive/ReduceNumShufflePartitions.scala | 157 ++---------- .../adaptive/ShufflePartitionsCoalescer.scala | 112 +++++++++ .../execution/adaptive/SkewedShuffledRowRDD.scala | 78 ------ .../execution/exchange/ShuffleExchangeExec.scala | 21 +- .../sql/execution/joins/SortMergeJoinExec.scala | 13 +- .../ReduceNumShufflePartitionsSuite.scala | 210 +--------------- .../ShufflePartitionsCoalescerSuite.scala | 220 ++++++++++++++++ .../adaptive/AdaptiveQueryExecSuite.scala | 219 ++++++---------- 12 files changed, 741 insertions(+), 703 deletions(-) create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CustomShuffledRowRDD.scala create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsCoalescer.scala delete mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/SkewedShuffledRowRDD.scala create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/ShufflePartitionsCoalescerSuite.scala --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org