This is an automated email from the ASF dual-hosted git repository.
jonah pushed a change to branch dependabot/cargo/main/flate2-1.1.0
in repository https://gitbox.apache.org/repos/asf/datafusion.git
from 8ce3e6dcef chore(deps): bump flate2 from 1.0.35 to 1.1.0
add 1fedb4e000 Counting elapsed_compute in BoundedWindowAggExec (#14869)
add f1f6e5e463 Optimize `gcd` for array and scalar case by avoiding
`make_scalar_function` where has unnecessary conversion between scalar and
array (#14834)
add adad8a4912 refactor: replace OnceLock with LazyLock (#14870)
add fcaefccedf Add polygon.io to user list (#14871)
add 3a1d9477b0 Workaround for compilation error due to rkyv#434. (#14863)
add fc2f9dd8cc fix(substrait): Do not add implicit groupBy expressions in
`LogicalPlanBuilder` or when building logical plans from Substrait (#14860)
add b7d9c78a81 chore(deps): bump uuid from 1.13.2 to 1.14.0 (#14866)
add e0da97ba6b Update dft in intro "Known Users" (#14875)
add 679737517e fix: use `return_type_from_args` and mark nullable if any
of the input is nullable (#14841)
add 2d57a0bb0a refactor: replace OnceLock with LazyLock (#14880)
add ce14fbccda Add `statistics_truncate_length` parquet writer config
(#14782)
add 18e54f2773 chore: migrate to `invoke_with_args` for datetime functions
(#14876)
add 3193014da7 Fix sqllogictest runner regeneration logic (#14881)
add 212f4245c9 Move `FileFormat` and related pieces to
`datafusion-datasource` (#14873)
add 9278233e9f fix duplicated schema name error from count wildcard
(#14824)
add f2cdc14896 replace TypeSignature::String with TypeSignature::Coercible
for trim functions (#14865)
add ea0686b8ce Window Functions Order Conservation -- Follow-up On Set
Monotonicity (#14813)
add 7119ee8cd2 Implement builder style API for ParserOptions (#14887)
add 111ff7eddc minor: Update docs and error messages about what SQL
dialects are supported (#14893)
add a49d54370b chore: Attach Diagnostic to "function x does not exist"
error (#14849)
add 99c811a3bf Fix: External sort failing on `StringView` due to shared
buffers (#14823)
add 3d64de4c47 refactor: make SqlToRel::new derive the parser options from
the context provider (#14822)
add 53fc94f22f Datafusion-cli: Redesign the datafusion-cli execution and
print, make it totally streaming printing without memory overhead (#14877)
add b3407f9201 Minor: Add Development Environment to Documentation Index
(#14890)
add 99b830c716 chore: Strip debuginfo symbols for release (#14843)
add dd7fe8f402 chore(deps): bump zstd from 0.13.2 to 0.13.3 (#14889)
add f51cd6e789 Add DataFrame fill_null (#14769)
add 21fa511543 Benchmark query cancellation (#14818)
add f5b7affecd Include struct name on FileScanConfig debug impl (#14883)
add 8d2d495785 Preserve the name of grouping sets in SimplifyExpressions
(#14888)
add d47f7fb00f Require `Debug` for `DataSource` (#14882)
add fb40506b3f Update regenerate sql dep, revert runner changes. (#14901)
add 93afc48eb5 Merge branch 'main' into dependabot/cargo/main/flate2-1.1.0
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 11 +-
Cargo.toml | 3 +-
benchmarks/Cargo.toml | 3 +
benchmarks/bench.sh | 29 +-
benchmarks/src/bin/dfbench.rs | 20 +-
benchmarks/src/cancellation.rs | 329 +++++
benchmarks/src/lib.rs | 1 +
datafusion-cli/src/exec.rs | 73 +-
datafusion-cli/src/print_format.rs | 477 ++++++
datafusion-cli/src/print_options.rs | 201 ++-
datafusion-examples/Cargo.toml | 2 +-
datafusion-testing | 2 +-
datafusion/common/src/config.rs | 6 +-
.../common/src/file_options/parquet_writer.rs | 4 +
datafusion/core/Cargo.toml | 2 +-
datafusion/core/src/dataframe/mod.rs | 103 +-
datafusion/core/src/datasource/file_format/json.rs | 3 +-
datafusion/core/src/datasource/file_format/mod.rs | 394 +----
.../core/src/datasource/file_format/parquet.rs | 154 +-
.../src/datasource/physical_plan/parquet/opener.rs | 2 +-
datafusion/core/src/execution/session_state.rs | 4 +-
.../core/tests/dataframe/dataframe_functions.rs | 6 +-
datafusion/core/tests/dataframe/mod.rs | 106 +-
datafusion/core/tests/fuzz_cases/pruning.rs | 102 +-
datafusion/core/tests/memory_limit/mod.rs | 69 +-
.../tests/physical_optimizer/enforce_sorting.rs | 1543 +++++++++++++++++---
.../core/tests/physical_optimizer/test_utils.rs | 68 +-
datafusion/core/tests/sql/explain_analyze.rs | 18 +-
datafusion/datasource/src/file_format.rs | 227 +++
datafusion/datasource/src/file_scan_config.rs | 4 +-
datafusion/datasource/src/memory.rs | 2 +-
datafusion/datasource/src/mod.rs | 1 +
datafusion/datasource/src/source.rs | 10 +-
datafusion/expr/src/expr_rewriter/mod.rs | 1 +
datafusion/expr/src/lib.rs | 2 +-
datafusion/expr/src/logical_plan/builder.rs | 121 +-
datafusion/expr/src/logical_plan/mod.rs | 2 +-
datafusion/expr/src/logical_plan/plan.rs | 6 +-
datafusion/expr/src/udaf.rs | 13 +-
datafusion/expr/src/udf.rs | 12 +-
datafusion/expr/src/udwf.rs | 14 +-
.../functions-aggregate/src/bit_and_or_xor.rs | 62 +-
datafusion/functions-aggregate/src/count.rs | 196 +--
datafusion/functions-aggregate/src/planner.rs | 87 +-
datafusion/functions-aggregate/src/regr.rs | 118 +-
datafusion/functions-window/src/lead_lag.rs | 54 +-
datafusion/functions-window/src/nth_value.rs | 78 +-
datafusion/functions-window/src/planner.rs | 90 +-
datafusion/functions-window/src/rank.rs | 50 +-
datafusion/functions/Cargo.toml | 7 +-
datafusion/functions/benches/gcd.rs | 92 ++
datafusion/functions/src/datetime/current_date.rs | 5 +-
datafusion/functions/src/datetime/current_time.rs | 5 +-
datafusion/functions/src/datetime/date_bin.rs | 179 ++-
datafusion/functions/src/datetime/date_part.rs | 10 +-
datafusion/functions/src/datetime/date_trunc.rs | 44 +-
datafusion/functions/src/datetime/from_unixtime.rs | 42 +-
datafusion/functions/src/datetime/make_date.rs | 125 +-
datafusion/functions/src/datetime/now.rs | 5 +-
datafusion/functions/src/datetime/to_char.rs | 93 +-
datafusion/functions/src/datetime/to_date.rs | 89 +-
datafusion/functions/src/datetime/to_local_time.rs | 17 +-
datafusion/functions/src/datetime/to_timestamp.rs | 76 +-
datafusion/functions/src/datetime/to_unixtime.rs | 23 +-
datafusion/functions/src/math/gcd.rs | 135 +-
datafusion/functions/src/math/monotonicity.rs | 474 +++---
datafusion/functions/src/string/btrim.rs | 24 +-
datafusion/functions/src/string/ltrim.rs | 26 +-
datafusion/functions/src/string/rtrim.rs | 26 +-
datafusion/functions/src/unicode/strpos.rs | 39 +-
.../src/simplify_expressions/simplify_exprs.rs | 48 +-
.../optimizer/tests/optimizer_integration.rs | 15 +-
datafusion/physical-expr-common/src/sort_expr.rs | 5 +
datafusion/physical-expr/src/equivalence/class.rs | 43 +-
.../physical-expr/src/equivalence/ordering.rs | 78 +
.../physical-expr/src/equivalence/properties.rs | 10 +-
.../src/enforce_sorting/sort_pushdown.rs | 17 +-
.../physical-plan/src/aggregates/no_grouping.rs | 13 +-
datafusion/physical-plan/src/sorts/sort.rs | 131 +-
.../src/windows/bounded_window_agg_exec.rs | 7 +
datafusion/physical-plan/src/windows/mod.rs | 185 ++-
.../proto-common/proto/datafusion_common.proto | 4 +
datafusion/proto-common/src/from_proto/mod.rs | 6 +
datafusion/proto-common/src/generated/pbjson.rs | 25 +
datafusion/proto-common/src/generated/prost.rs | 9 +
datafusion/proto-common/src/to_proto/mod.rs | 1 +
.../proto/src/generated/datafusion_proto_common.rs | 9 +
datafusion/proto/src/logical_plan/file_formats.rs | 6 +
datafusion/sql/src/expr/function.rs | 17 +-
datafusion/sql/src/planner.rs | 97 +-
datafusion/sql/src/select.rs | 9 +-
datafusion/sql/tests/cases/diagnostic.rs | 18 +-
datafusion/sql/tests/sql_integration.rs | 12 +-
datafusion/sqllogictest/Cargo.toml | 2 +
datafusion/sqllogictest/README.md | 8 +
.../sqllogictest/regenerate/sqllogictests.rs | 12 +-
datafusion/sqllogictest/regenerate_sqlite_files.sh | 2 +-
datafusion/sqllogictest/test_files/aggregate.slt | 140 ++
datafusion/sqllogictest/test_files/avro.slt | 16 +-
.../sqllogictest/test_files/count_star_rule.slt | 49 +-
datafusion/sqllogictest/test_files/explain.slt | 2 +-
.../sqllogictest/test_files/information_schema.slt | 4 +-
datafusion/sqllogictest/test_files/insert.slt | 24 +-
.../sqllogictest/test_files/insert_to_external.slt | 16 +-
datafusion/sqllogictest/test_files/joins.slt | 36 +-
datafusion/sqllogictest/test_files/json.slt | 16 +-
datafusion/sqllogictest/test_files/limit.slt | 51 +-
datafusion/sqllogictest/test_files/math.slt | 4 +-
.../test_files/optimizer_group_by_constant.slt | 16 +-
datafusion/sqllogictest/test_files/select.slt | 28 +-
.../sqllogictest/test_files/string/string_view.slt | 12 +-
datafusion/sqllogictest/test_files/subquery.slt | 91 +-
.../sqllogictest/test_files/tpch/plans/q1.slt.part | 10 +-
.../test_files/tpch/plans/q13.slt.part | 10 +-
.../test_files/tpch/plans/q21.slt.part | 10 +-
.../test_files/tpch/plans/q22.slt.part | 10 +-
.../sqllogictest/test_files/tpch/plans/q4.slt.part | 10 +-
datafusion/sqllogictest/test_files/union.slt | 26 +-
datafusion/sqllogictest/test_files/window.slt | 46 +-
datafusion/substrait/src/logical_plan/consumer.rs | 18 +-
datafusion/substrait/src/logical_plan/producer.rs | 11 +-
.../substrait/tests/cases/consumer_integration.rs | 26 +-
datafusion/substrait/tests/cases/logical_plans.rs | 18 +
.../tests/cases/roundtrip_logical_plan.rs | 117 +-
.../test_plans/multilayer_aggregate.substrait.json | 213 +++
docs/source/index.rst | 2 +-
docs/source/user-guide/configs.md | 3 +-
docs/source/user-guide/introduction.md | 3 +-
128 files changed, 5870 insertions(+), 2378 deletions(-)
create mode 100644 benchmarks/src/cancellation.rs
create mode 100644 datafusion/datasource/src/file_format.rs
create mode 100644 datafusion/functions/benches/gcd.rs
create mode 100644
datafusion/substrait/tests/testdata/test_plans/multilayer_aggregate.substrait.json
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
