This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from f4b65d2ec7b [SPARK-41369][CONNECT] Remove unneeded connect server deps
add 96843850b4f [SPARK-41378][SQL] Support Column Stats in DS v2
No new revisions were added by this update.
Summary of changes:
.../spark/sql/connector/read/Statistics.java | 7 ++
.../connector/read/colstats/ColumnStatistics.java | 83 ++++++++++++++++++++++
.../Histogram.java} | 20 +++---
.../HistogramBin.java} | 23 +++---
.../datasources/v2/DataSourceV2Relation.scala | 52 ++++++++++++--
.../sql/connector/catalog/InMemoryBaseTable.scala | 53 ++++++++++++--
.../spark/sql/connector/DataSourceV2SQLSuite.scala | 21 ++++++
7 files changed, 232 insertions(+), 27 deletions(-)
create mode 100644
sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/colstats/ColumnStatistics.java
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/{streaming/ReportsSinkMetrics.java
=> colstats/Histogram.java} (68%)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/{streaming/ReportsSinkMetrics.java
=> colstats/HistogramBin.java} (69%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
