This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 8915966 [SPARK-29473][SQL] move statement logical plans to a new file
add 9ac4b2d [SPARK-28560][SQL] Optimize shuffle reader to local shuffle
reader when smj converted to bhj in adaptive execution
No new revisions were added by this update.
Summary of changes:
.../scala/org/apache/spark/MapOutputTracker.scala | 91 +++++++++++++-
.../spark/shuffle/BlockStoreShuffleReader.scala | 19 ++-
.../org/apache/spark/shuffle/ShuffleManager.scala | 13 ++
.../spark/shuffle/sort/SortShuffleManager.scala | 21 ++++
.../org/apache/spark/sql/internal/SQLConf.scala | 8 ++
.../apache/spark/sql/execution/SparkPlanInfo.scala | 3 +-
.../execution/adaptive/AdaptiveSparkPlanExec.scala | 1 +
.../adaptive/AdaptiveSparkPlanHelper.scala | 1 +
.../execution/adaptive/LocalShuffledRowRDD.scala | 98 +++++++++++++++
.../adaptive/OptimizeLocalShuffleReader.scala | 132 +++++++++++++++++++++
.../execution/exchange/ShuffleExchangeExec.scala | 5 +
.../adaptive/AdaptiveQueryExecSuite.scala | 46 +++++--
12 files changed, 424 insertions(+), 14 deletions(-)
create mode 100644
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/LocalShuffledRowRDD.scala
create mode 100644
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeLocalShuffleReader.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
