This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/cargo/main/proto-5f30c81d2c in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit aacc714c1b chore(deps): bump the proto group with 2 updates add 9463cf6792 Fix incorrect `NULL IN ()` optimization (#17092) add 876b504cb0 Simplify comparisons and binary operations involving NULL (#17088) add c7d5904f01 Add `prettier` to the devcontainer (GitHub codespaces) (#17019) add c4f0375686 Set a lower threshold for clippy to flag large error variants (#17109) add ff9db020d7 chore(deps): bump rustyline from 16.0.0 to 17.0.0 (#17116) add 14fb4a3c7d feat: Use Cached Metadata for ListingTable Statistics (#17022) add ff77b70200 Add dynamic filter (bounds) pushdown to HashJoinExec (#16445) add d375bfed45 Remove the "extended workflow" github action (#17119) add f0e9334848 feat(spark): implement Spark math function mod/pmod (#16829) add c5cb6f4ad7 feat(spark): implement Spark math function bit_get/bit_count (#16942) add ceab1e1653 feat: add `isodow` (ISO day-of-week) support to date_part (Monday = 0) (#17112) add 28e042dd47 feat(spark): implement spark datetime function date_add/date_sub (#17024) add 8494a3967a Derive `WindowUDFImpl` equality, hash from `Eq`, `Hash` traits (#17081) add 80d105840d chore(deps): bump sysinfo from 0.36.1 to 0.37.0 (#17124) add a1431e2371 chore(deps): bump libc from 0.2.174 to 0.2.175 (#17121) add 7d52145127 Preserve equivalence properties during projection pushdown (#17129) add 833a321693 chore(deps): bump the proto group with 2 updates This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (aacc714c1b) \ N -- N -- N refs/heads/dependabot/cargo/main/proto-5f30c81d2c (833a321693) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .devcontainer/Dockerfile | 8 +- .github/workflows/extended.yml | 38 -- .github/workflows/pr_comment_commands.yml | 89 --- Cargo.lock | 15 +- clippy.toml | 12 +- datafusion-cli/Cargo.toml | 2 +- datafusion-examples/examples/advanced_udwf.rs | 4 +- datafusion/common/Cargo.toml | 2 +- datafusion/core/Cargo.toml | 2 +- .../core/src/datasource/file_format/parquet.rs | 287 +++++++--- datafusion/core/tests/parquet/custom_reader.rs | 7 +- datafusion/core/tests/parquet/page_pruning.rs | 2 +- .../physical_optimizer/filter_pushdown/mod.rs | 382 ++++++++++++- .../user_defined/user_defined_window_functions.rs | 61 +- datafusion/datasource-parquet/src/file_format.rs | 91 ++- datafusion/datasource-parquet/src/mod.rs | 2 +- datafusion/datasource-parquet/src/reader.rs | 64 ++- datafusion/datasource/src/source.rs | 35 +- datafusion/expr-common/src/dyn_eq.rs | 64 +++ datafusion/expr-common/src/lib.rs | 1 + datafusion/expr-common/src/operator.rs | 54 ++ datafusion/expr/src/expr_fn.rs | 2 - datafusion/expr/src/udf_eq.rs | 15 +- datafusion/expr/src/udwf.rs | 70 +-- datafusion/ffi/src/udwf/mod.rs | 3 - datafusion/functions-window/src/cume_dist.rs | 2 +- datafusion/functions-window/src/lead_lag.rs | 6 +- datafusion/functions-window/src/macros.rs | 14 +- datafusion/functions-window/src/nth_value.rs | 6 +- datafusion/functions-window/src/ntile.rs | 2 +- datafusion/functions-window/src/rank.rs | 5 +- datafusion/functions-window/src/row_number.rs | 2 +- datafusion/functions/src/datetime/date_part.rs | 4 +- .../src/simplify_expressions/expr_simplifier.rs | 293 ++++------ .../src/simplify_expressions/unwrap_cast.rs | 14 +- .../physical-expr-common/src/physical_expr.rs | 31 +- datafusion/physical-plan/Cargo.toml | 1 + datafusion/physical-plan/src/joins/hash_join.rs | 149 ++++- datafusion/proto/tests/cases/mod.rs | 2 - .../proto/tests/cases/roundtrip_logical_plan.rs | 2 +- datafusion/spark/src/function/bitwise/bit_count.rs | 319 +++++++++++ datafusion/spark/src/function/bitwise/bit_get.rs | 287 ++++++++++ datafusion/spark/src/function/bitwise/mod.rs | 20 +- datafusion/spark/src/function/datetime/date_add.rs | 129 +++++ datafusion/spark/src/function/datetime/date_sub.rs | 123 ++++ datafusion/spark/src/function/datetime/mod.rs | 16 +- datafusion/spark/src/function/math/mod.rs | 7 +- datafusion/spark/src/function/math/modulus.rs | 617 +++++++++++++++++++++ datafusion/sqllogictest/data/1.parquet | Bin 0 -> 1258 bytes datafusion/sqllogictest/data/2.parquet | Bin 0 -> 1273 bytes .../src/engines/datafusion_engine/error.rs | 2 +- datafusion/sqllogictest/test_files/errors.slt | 3 +- .../sqllogictest/test_files/expr/date_part.slt | 20 + datafusion/sqllogictest/test_files/parquet.slt | 3 +- .../test_files/parquet_filter_pushdown.slt | 32 ++ datafusion/sqllogictest/test_files/predicates.slt | 67 +++ .../test_files/spark/bitwise/bit_count.slt | 204 ++++++- .../test_files/spark/bitwise/bit_get.slt | 51 +- .../test_files/spark/bitwise/getbit.slt | 52 +- .../test_files/spark/datetime/date_add.slt | 45 +- .../test_files/spark/datetime/date_sub.slt | 50 +- .../test_files/spark/datetime/dateadd.slt | 36 +- .../sqllogictest/test_files/spark/math/mod.slt | 221 +++++++- .../sqllogictest/test_files/spark/math/pmod.slt | 320 ++++++++++- .../test_files/spark/predicate/ilike.slt | 2 +- .../tests/cases/roundtrip_logical_plan.rs | 2 +- docs/source/contributor-guide/testing.md | 18 +- docs/source/library-user-guide/upgrading.md | 8 + docs/source/user-guide/sql/scalar_functions.md | 3 +- 69 files changed, 3821 insertions(+), 681 deletions(-) delete mode 100644 .github/workflows/pr_comment_commands.yml create mode 100644 datafusion/expr-common/src/dyn_eq.rs create mode 100644 datafusion/spark/src/function/bitwise/bit_count.rs create mode 100644 datafusion/spark/src/function/bitwise/bit_get.rs create mode 100644 datafusion/spark/src/function/datetime/date_add.rs create mode 100644 datafusion/spark/src/function/datetime/date_sub.rs create mode 100644 datafusion/spark/src/function/math/modulus.rs create mode 100644 datafusion/sqllogictest/data/1.parquet create mode 100644 datafusion/sqllogictest/data/2.parquet --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@datafusion.apache.org For additional commands, e-mail: commits-h...@datafusion.apache.org