This is an automated email from the ASF dual-hosted git repository.
uros-b pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 86d4fe8b3b79 [SPARK-58625][PYTHON] Support pa.ChunkedArray columns in
PandasToArrowConversion
add f649423aa357 [SPARK-58420][SQL] Normalize map values in distinct
aggregates
No new revisions were added by this update.
Summary of changes:
docs/sql-migration-guide.md | 1 +
.../optimizer/InsertMapSortExpression.scala | 140 ++++++--
.../spark/sql/catalyst/optimizer/Optimizer.scala | 8 +-
.../org/apache/spark/sql/internal/SQLConf.scala | 11 +
.../optimizer/InsertMapSortInAggregateSuite.scala | 117 +++++++
.../distinct-map-aggregates.sql.out | 363 +++++++++++++++++++++
.../sql-tests/inputs/distinct-map-aggregates.sql | 102 ++++++
.../results/distinct-map-aggregates.sql.out | 265 +++++++++++++++
8 files changed, 977 insertions(+), 30 deletions(-)
create mode 100644
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/InsertMapSortInAggregateSuite.scala
create mode 100644
sql/core/src/test/resources/sql-tests/analyzer-results/distinct-map-aggregates.sql.out
create mode 100644
sql/core/src/test/resources/sql-tests/inputs/distinct-map-aggregates.sql
create mode 100644
sql/core/src/test/resources/sql-tests/results/distinct-map-aggregates.sql.out
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
