This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git
from 6826680393e6 [SPARK-53898][CORE] Fix race conditions between query
cancellation and task completion triggered by eager shuffle cleanup
new adfdf32b23fe [SPARK-53991][SQL] Add SQL support for KLL quantiles
functions based on DataSketches
new aa01742b31ed [SPARK-54199][SQL] Add DataFrame API support for new KLL
quantiles sketch functions
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../src/main/resources/error/error-conditions.json | 30 +
.../source/reference/pyspark.sql/functions.rst | 18 +
python/pyspark/sql/connect/functions/builtin.py | 162 +++
python/pyspark/sql/functions/__init__.py | 18 +
python/pyspark/sql/functions/builtin.py | 618 +++++++++
python/pyspark/sql/tests/test_functions.py | 156 +++
.../scala/org/apache/spark/sql/functions.scala | 300 ++++
.../sql/catalyst/analysis/FunctionRegistry.scala | 18 +
.../expressions/aggregate/kllAggregates.scala | 512 +++++++
.../sql/catalyst/expressions/kllExpressions.scala | 671 +++++++++
.../spark/sql/errors/QueryExecutionErrors.scala | 38 +
.../sql-functions/sql-expression-schema.md | 18 +
.../analyzer-results/kllquantiles.sql.out | 1336 ++++++++++++++++++
.../resources/sql-tests/inputs/kllquantiles.sql | 473 +++++++
.../sql-tests/results/kllquantiles.sql.out | 1443 ++++++++++++++++++++
.../apache/spark/sql/DataFrameAggregateSuite.scala | 164 +++
16 files changed, 5975 insertions(+)
create mode 100644
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/kllAggregates.scala
create mode 100644
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/kllExpressions.scala
create mode 100644
sql/core/src/test/resources/sql-tests/analyzer-results/kllquantiles.sql.out
create mode 100644
sql/core/src/test/resources/sql-tests/inputs/kllquantiles.sql
create mode 100644
sql/core/src/test/resources/sql-tests/results/kllquantiles.sql.out
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
