This is an automated email from the ASF dual-hosted git repository.
yamamuro pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from a9247c3 [SPARK-32033][SS][DSTEAMS] Use new poll API in Kafka
connector executor side to avoid infinite wait
add 7b86838 [SPARK-31350][SQL] Coalesce bucketed tables for sort merge
join if applicable
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/sql/internal/SQLConf.scala | 20 +++
.../spark/sql/execution/DataSourceScanExec.scala | 29 ++-
.../spark/sql/execution/QueryExecution.scala | 2 +
.../bucketing/CoalesceBucketsInSortMergeJoin.scala | 132 ++++++++++++++
.../execution/datasources/FileSourceStrategy.scala | 1 +
.../org/apache/spark/sql/DataFrameJoinSuite.scala | 2 +-
.../scala/org/apache/spark/sql/ExplainSuite.scala | 17 ++
.../scala/org/apache/spark/sql/SubquerySuite.scala | 2 +-
.../CoalesceBucketsInSortMergeJoinSuite.scala | 194 +++++++++++++++++++++
.../spark/sql/sources/BucketedReadSuite.scala | 137 ++++++++++++++-
10 files changed, 523 insertions(+), 13 deletions(-)
create mode 100644
sql/core/src/main/scala/org/apache/spark/sql/execution/bucketing/CoalesceBucketsInSortMergeJoin.scala
create mode 100644
sql/core/src/test/scala/org/apache/spark/sql/execution/bucketing/CoalesceBucketsInSortMergeJoinSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
