This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 21450b3 [SPARK-32920][FOLLOW-UP][CORE] Shutdown
shuffleMergeFinalizeScheduler when DAGScheduler stop
add c561ee6 [SPARK-34952][SQL] DSv2 Aggregate push down APIs
No new revisions were added by this update.
Summary of changes:
.../{Expression.java => AggregateFunc.java} | 12 +-
.../expressions/{Literal.java => Aggregation.java} | 35 +--
.../expressions/{Transform.java => Count.java} | 39 ++--
.../{NamedReference.java => CountStar.java} | 23 +-
.../expressions/{Expression.java => Max.java} | 25 +-
.../expressions/{Expression.java => Min.java} | 27 ++-
.../expressions/{Literal.java => Sum.java} | 44 ++--
.../spark/sql/connector/read/ScanBuilder.java | 3 +-
.../connector/read/SupportsPushDownAggregates.java | 56 +++++
.../spark/sql/execution/DataSourceScanExec.scala | 25 +-
.../execution/datasources/DataSourceStrategy.scala | 31 +++
.../execution/datasources/jdbc/JDBCOptions.scala | 4 +
.../sql/execution/datasources/jdbc/JDBCRDD.scala | 67 +++++-
.../execution/datasources/jdbc/JDBCRelation.scala | 18 ++
.../datasources/v2/DataSourceV2Strategy.scala | 5 +-
.../execution/datasources/v2/PushDownUtils.scala | 40 ++++
.../datasources/v2/V2ScanRelationPushDown.scala | 188 +++++++++++++--
.../execution/datasources/v2/jdbc/JDBCScan.scala | 23 +-
.../datasources/v2/jdbc/JDBCScanBuilder.scala | 76 +++++-
.../org/apache/spark/sql/jdbc/JDBCV2Suite.scala | 259 ++++++++++++++++++++-
20 files changed, 873 insertions(+), 127 deletions(-)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/{Expression.java
=> AggregateFunc.java} (82%)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/{Literal.java
=> Aggregation.java} (61%)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/{Transform.java
=> Count.java} (58%)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/{NamedReference.java
=> CountStar.java} (73%)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/{Expression.java
=> Max.java} (66%)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/{Expression.java
=> Min.java} (65%)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/{Literal.java
=> Sum.java} (53%)
create mode 100644
sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/SupportsPushDownAggregates.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
