This is an automated email from the ASF dual-hosted git repository.
agrove pushed a change to branch df52
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
from 2dd89097b chore: [df52] fix index out of bounds for
`native_datafusion` scan (#3485)
add 7c78fef50 test: Add additional contains expression tests (#3462)
add 1e1b88d1a chore: Adjust native artifact caching key in CI (#3476)
add eccf2372c feat: add support for make_date expression (#3147)
add 4fe645264 Revert "perf: Remove mutable buffers from scan
partition/missing columns (#3411)" (#3486)
add 10d0c8d21 feat: add support for next_day expression (#3148)
add e87e1a36c perf: Improve benchmarks for native row-to-columnar used by
JVM shuffle (#3290)
add 1d4907474 chore: Add Comet writer nested types test assertion (#3480)
add f172b7c9a test: Add SQL file tests for left and right expressions
(#3463)
add 24f3e4fed Merge remote-tracking branch 'apache/main' into df52
No new revisions were added by this update.
Summary of changes:
.github/workflows/iceberg_spark_test.yml | 6 +-
.github/workflows/pr_build_linux.yml | 12 +-
.github/workflows/pr_build_macos.yml | 6 +-
.github/workflows/spark_sql_test.yml | 6 +-
.../comet/parquet/ArrowConstantColumnReader.java | 255 --------------
.../comet/parquet/ArrowRowIndexColumnReader.java | 109 ------
.../apache/comet/parquet/NativeBatchReader.java | 12 +-
native/core/benches/row_columnar.rs | 382 ++++++++++++++++++---
native/core/src/execution/jni_api.rs | 2 +
native/spark-expr/src/comet_scalar_funcs.rs | 3 +-
native/spark-expr/src/datetime_funcs/date_diff.rs | 15 +-
native/spark-expr/src/datetime_funcs/make_date.rs | 236 +++++++++++++
native/spark-expr/src/datetime_funcs/mod.rs | 2 +
native/spark-expr/src/lib.rs | 4 +-
native/spark-expr/tests/spark_expr_reg.rs | 43 +++
.../org/apache/comet/serde/QueryPlanSerde.scala | 2 +
.../scala/org/apache/comet/serde/datetime.scala | 6 +-
.../org/apache/spark/sql/comet/operators.scala | 2 -
.../sql-tests/expressions/datetime/make_date.sql | 178 ++++++++++
.../sql-tests/expressions/datetime/next_day.sql | 76 ++++
.../sql-tests/expressions/string/left.sql | 27 ++
.../sql-tests/expressions/string/right.sql | 96 ++++++
.../org/apache/comet/CometExpressionSuite.scala | 132 +------
.../comet/parquet/CometParquetWriterSuite.scala | 30 +-
24 files changed, 1067 insertions(+), 575 deletions(-)
delete mode 100644
common/src/main/java/org/apache/comet/parquet/ArrowConstantColumnReader.java
delete mode 100644
common/src/main/java/org/apache/comet/parquet/ArrowRowIndexColumnReader.java
create mode 100644 native/spark-expr/src/datetime_funcs/make_date.rs
create mode 100644
spark/src/test/resources/sql-tests/expressions/datetime/make_date.sql
create mode 100644
spark/src/test/resources/sql-tests/expressions/datetime/next_day.sql
create mode 100644
spark/src/test/resources/sql-tests/expressions/string/right.sql
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
