This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/main/hashbrown-0.15.1
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit ddd9f88d8f Update hashbrown requirement from 0.14.5 to 0.15.1
add a6586ccfff Example: FFI Table Provider as dynamic module loading
(#13183)
add 32266c2676 typo fix (#13269)
add 6612d7ce0d Fix incorrect `... LIKE '%'` simplification with NULLs
(#13259)
add 39aa15e074 Change `schema_infer_max_rec ` config to use
`Option<usize>` rather than `usize` (#13250)
add 07e8793e62 allow passing in metadata_size_hint on a per-file basis
(#13213)
add 6a02384d19 Deprecate `PhysicalSortRequirement::from_sort_exprs` and
`PhysicalSortRequirement::to_sort_exprs` (#13222)
add ca59c72183 Ensure schema and data have the same size (#13264)
add c3a984708b Update thiserror requirement from 1.0.44 to 2.0.0 (#13273)
add 345117baf0 Support vectorized append and compare for multi group by
(#12996)
add 6686e034dd Use LogicalType for TypeSignature `Numeric` and `String`,
`Coercible` (#13240)
add ba094e7292 Minor: Clarify use of infallable APIs (#13217)
add 34d9d3a698 feat: basic support for executing prepared statements
(#13242)
add 1094651cd0 chore: Move `OptimizeAggregateOrder` from core to optimizer
crate (#13284)
add ddee4717af Fix license header (#12008)
add b0b6e4427f Introduce `INFORMATION_SCHEMA.ROUTINES` table (#13255)
add 40ba092a6e minor docs (#13281)
add 3930830706 Minor: improve `LogicalPlanBuilder::join_with_expr_keys`
docs (#13276)
add 316e64af4d Test LIKE with implicit `\` escape (#13288)
add c1b6f78128 Enable `clone_on_ref_ptr` clippy lint on
physical-expr-common crate (#13295)
add d00a085d5a chore: Move `CoalesceBatches` from core to optimizer crate
(#13283)
add 545976f194 Minor: Document how to test for trailing whitespace in
`slt` / sqllogictests (#13215)
add 192079e4a7 Improve documentation on start_demuxer_task and
file_extension (#13216)
add f190fc6de6 feat: Updating flamegraph docs (#13299)
add 667b302b08 Expand LIKE simplification: cover `NULL` pattern/expression
and constant (#13260)
add c10a4cada8 join_with_expr_keys to support expressions with both
unqualified and qualified column names (#13182)
add d77af59500 Derive Eq, Hash, Ord for ResolvedTableReference to be
capable of map key (#13303)
add 7a7c8cb6b0 refactor: move PREPARE/EXECUTE into
`LogicalPlan::Statement` (#13311)
add 0f584c8db1 Fixes for 43.0.0 release (#13319)
add ee56d6a710 Implement get_possible_types for Uniform, Coercible,
Variadic, Numeric and String (#13313)
add 1557fce891 Support `Utf8View` for string function `bit_length()`
(#13221)
add 31d27c2e65 feat: Added Timestamp/Binary/Float to fuzz (#13280)
add 36e3415215 Optimize `replace_params_with_values` (#13308)
add c48f12d27c Remove warning logs during the document build process
(#13324)
add 619fa938e2 minor: include datafusion-ffi in publishing instructions
(#13333)
add e6ad9d6493 Update dev script to publish FFI crate (#13322)
add 221c85f4e4 minor(docs): Add docs for `regen.sh` (#13321)
add a20b3183b3 feat: support `DEALLOCATE` to remove prepared statements
(#13327)
add 7ebd993fe4 Fix `scalar_functions.md` for CI (#13340)
add be19afca4c Fix ExprSchema extraction of metadata for Cast expressions.
(#13305)
add 5309d83e31 refactor: replace `instant` with `web-time` (#13355)
new d8538db80b Update hashbrown requirement from 0.14.5 to 0.15.1
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ddd9f88d8f)
\
N -- N -- N refs/heads/dependabot/cargo/main/hashbrown-0.15.1
(d8538db80b)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/dev.yml | 14 +-
.github/workflows/rust.yml | 8 +
Cargo.toml | 4 +-
benchmarks/compare.py | 29 +-
datafusion-cli/Cargo.lock | 25 +-
datafusion-examples/examples/ffi/README.md | 48 +
.../ffi/ffi_example_table_provider}/Cargo.toml | 22 +-
.../ffi/ffi_example_table_provider/src/lib.rs | 66 +
.../examples/ffi/ffi_module_interface/Cargo.toml | 12 +-
.../examples/ffi/ffi_module_interface/src/lib.rs | 49 +
.../examples/ffi/ffi_module_loader}/Cargo.toml | 14 +-
.../examples/ffi/ffi_module_loader/src/main.rs | 63 +
datafusion/common-runtime/src/lib.rs | 1 +
datafusion/common/Cargo.toml | 2 +-
datafusion/common/src/config.rs | 6 +-
datafusion/common/src/instant.rs | 4 +-
datafusion/common/src/lib.rs | 1 +
datafusion/common/src/table_reference.rs | 2 +-
datafusion/common/src/types/logical.rs | 6 +
datafusion/common/src/types/native.rs | 45 +-
datafusion/common/src/utils/memory.rs | 2 +-
datafusion/core/Cargo.toml | 1 -
datafusion/core/benches/sql_planner.rs | 29 +
.../core/src/catalog_common/information_schema.rs | 303 +++-
datafusion/core/src/datasource/file_format/csv.rs | 24 +-
.../file_format/file_compression_type.rs | 12 +-
datafusion/core/src/datasource/file_format/json.rs | 11 +-
datafusion/core/src/datasource/file_format/mod.rs | 1 +
.../core/src/datasource/file_format/write/demux.rs | 40 +-
datafusion/core/src/datasource/listing/helpers.rs | 1 +
datafusion/core/src/datasource/listing/mod.rs | 13 +
datafusion/core/src/datasource/listing/url.rs | 11 +
.../core/src/datasource/listing_table_factory.rs | 2 +-
.../datasource/physical_plan/file_scan_config.rs | 1 +
.../src/datasource/physical_plan/file_stream.rs | 1 +
.../core/src/datasource/physical_plan/mod.rs | 4 +
.../src/datasource/physical_plan/parquet/mod.rs | 137 +-
.../src/datasource/physical_plan/parquet/opener.rs | 4 +-
datafusion/core/src/datasource/schema_adapter.rs | 1 +
datafusion/core/src/execution/context/mod.rs | 84 +-
datafusion/core/src/execution/session_state.rs | 64 +-
datafusion/core/src/lib.rs | 1 +
.../src/physical_optimizer/enforce_distribution.rs | 5 +-
.../core/src/physical_optimizer/enforce_sorting.rs | 8 +-
datafusion/core/src/physical_optimizer/mod.rs | 3 +-
.../core/src/physical_optimizer/sanity_checker.rs | 2 +-
.../core/src/physical_optimizer/sort_pushdown.rs | 27 +-
.../core/src/physical_optimizer/test_utils.rs | 8 +-
datafusion/core/src/physical_optimizer/utils.rs | 5 +-
datafusion/core/src/physical_planner.rs | 9 -
datafusion/core/src/test/object_store.rs | 2 +
datafusion/core/src/test_util/parquet.rs | 1 +
datafusion/core/tests/fuzz_cases/aggregate_fuzz.rs | 20 +-
.../aggregation_fuzzer/data_generator.rs | 156 +-
.../core/tests/fuzz_cases/equivalence/utils.rs | 2 +-
datafusion/core/tests/macro_hygiene/mod.rs | 2 +
datafusion/core/tests/parquet/custom_reader.rs | 1 +
datafusion/core/tests/parquet/page_pruning.rs | 1 +
datafusion/core/tests/sql/select.rs | 30 +-
datafusion/core/tests/sql/sql_api.rs | 24 +
.../tests/user_defined/user_defined_aggregates.rs | 1 +
datafusion/execution/src/lib.rs | 1 +
datafusion/execution/src/task.rs | 19 +-
datafusion/expr-common/Cargo.toml | 1 -
datafusion/expr-common/src/signature.rs | 185 ++-
.../expr-common/src/type_coercion/aggregates.rs | 3 +-
datafusion/expr/src/expr.rs | 19 +-
datafusion/expr/src/expr_rewriter/mod.rs | 2 +-
datafusion/expr/src/expr_schema.rs | 7 +-
datafusion/expr/src/lib.rs | 1 +
datafusion/expr/src/logical_plan/builder.rs | 47 +-
datafusion/expr/src/logical_plan/display.rs | 27 +-
datafusion/expr/src/logical_plan/mod.rs | 10 +-
datafusion/expr/src/logical_plan/plan.rs | 138 +-
datafusion/expr/src/logical_plan/statement.rs | 175 ++-
datafusion/expr/src/logical_plan/tree_node.rs | 54 +-
datafusion/expr/src/type_coercion/functions.rs | 149 +-
datafusion/expr/src/udf.rs | 13 +
datafusion/ffi/README.md | 119 +-
datafusion/ffi/src/lib.rs | 1 +
datafusion/ffi/src/table_provider.rs | 38 +
datafusion/functions-aggregate-common/Cargo.toml | 1 -
.../functions-aggregate-common/src/tdigest.rs | 24 +-
datafusion/functions-aggregate/src/first_last.rs | 24 +-
datafusion/functions-aggregate/src/lib.rs | 1 +
datafusion/functions-aggregate/src/min_max.rs | 1 +
.../src/min_max/min_max_bytes.rs | 1 +
datafusion/functions-aggregate/src/stddev.rs | 5 +-
datafusion/functions-aggregate/src/variance.rs | 5 +-
datafusion/functions-nested/src/lib.rs | 1 +
datafusion/functions-nested/src/map.rs | 55 +-
datafusion/functions/src/lib.rs | 1 +
datafusion/functions/src/math/abs.rs | 2 +-
datafusion/functions/src/string/bit_length.rs | 5 +-
datafusion/functions/src/string/concat.rs | 2 +-
datafusion/functions/src/string/concat_ws.rs | 2 +-
datafusion/functions/src/string/lower.rs | 2 +-
datafusion/functions/src/string/octet_length.rs | 2 +-
datafusion/functions/src/string/repeat.rs | 16 +-
datafusion/functions/src/string/upper.rs | 2 +-
.../functions/src/unicode/character_length.rs | 2 +-
datafusion/functions/src/unicode/lpad.rs | 2 +-
datafusion/optimizer/Cargo.toml | 1 +
.../optimizer/src/common_subexpr_eliminate.rs | 4 +-
datafusion/optimizer/src/filter_null_join_keys.rs | 28 +
datafusion/optimizer/src/lib.rs | 1 +
.../optimizer/src/optimize_projections/mod.rs | 7 +-
datafusion/optimizer/src/push_down_filter.rs | 3 +
.../src/simplify_expressions/expr_simplifier.rs | 300 +++-
datafusion/physical-expr-common/src/binary_map.rs | 2 +-
.../physical-expr-common/src/binary_view_map.rs | 2 +-
datafusion/physical-expr-common/src/datum.rs | 2 +-
datafusion/physical-expr-common/src/lib.rs | 3 +
datafusion/physical-expr-common/src/sort_expr.rs | 29 +-
datafusion/physical-expr-common/src/tree_node.rs | 2 +-
datafusion/physical-expr-common/src/utils.rs | 2 +-
datafusion/physical-expr/src/equivalence/class.rs | 4 +-
.../physical-expr/src/equivalence/properties.rs | 12 +-
.../physical-expr/src/intervals/cp_solver.rs | 2 +-
.../physical-expr/src/intervals/test_utils.rs | 2 +-
datafusion/physical-expr/src/intervals/utils.rs | 2 +-
.../src}/coalesce_batches.rs | 20 +-
datafusion/physical-optimizer/src/lib.rs | 3 +
.../physical-optimizer/src/output_requirements.rs | 6 +-
.../src}/update_aggr_exprs.rs | 34 +-
.../src/aggregates/group_values/column.rs | 1498 ++++++++++++++++++--
.../src/aggregates/group_values/group_column.rs | 985 +++++++++++--
.../src/aggregates/group_values/mod.rs | 15 +-
.../src/aggregates/group_values/null_builder.rs | 18 +
datafusion/physical-plan/src/aggregates/mod.rs | 6 +-
.../physical-plan/src/aggregates/row_hash.rs | 2 +-
.../physical-plan/src/joins/sort_merge_join.rs | 10 +-
.../physical-plan/src/joins/symmetric_hash_join.rs | 10 +-
.../src/sorts/sort_preserving_merge.rs | 5 +-
datafusion/physical-plan/src/windows/mod.rs | 5 +-
.../proto-common/proto/datafusion_common.proto | 4 +-
datafusion/proto-common/src/from_proto/mod.rs | 4 +-
datafusion/proto-common/src/generated/pbjson.rs | 20 +-
datafusion/proto-common/src/generated/prost.rs | 99 +-
datafusion/proto-common/src/lib.rs | 1 +
datafusion/proto-common/src/to_proto/mod.rs | 4 +-
.../proto/src/generated/datafusion_proto_common.rs | 12 +-
datafusion/proto/src/lib.rs | 1 +
datafusion/proto/src/logical_plan/file_formats.rs | 8 +-
datafusion/proto/src/logical_plan/mod.rs | 9 +-
datafusion/proto/src/physical_plan/from_proto.rs | 1 +
datafusion/proto/src/physical_plan/mod.rs | 10 +-
datafusion/proto/src/physical_plan/to_proto.rs | 3 +-
.../proto/tests/cases/roundtrip_logical_plan.rs | 3 +-
datafusion/sql/src/expr/mod.rs | 2 +-
datafusion/sql/src/lib.rs | 1 +
datafusion/sql/src/statement.rs | 30 +-
datafusion/sql/src/unparser/plan.rs | 2 -
datafusion/sql/tests/sql_integration.rs | 6 +-
datafusion/sqllogictest/Cargo.toml | 2 +-
datafusion/sqllogictest/README.md | 33 +
datafusion/sqllogictest/test_files/errors.slt | 7 +
datafusion/sqllogictest/test_files/expr.slt | 10 +-
datafusion/sqllogictest/test_files/functions.slt | 21 +
.../sqllogictest/test_files/information_schema.slt | 33 +
.../information_schema_multiple_catalogs.slt | 4 +
.../test_files/information_schema_table_types.slt | 1 +
datafusion/sqllogictest/test_files/math.slt | 9 +-
datafusion/sqllogictest/test_files/metadata.slt | 69 +
datafusion/sqllogictest/test_files/prepare.slt | 240 +++-
datafusion/sqllogictest/test_files/scalar.slt | 6 +-
.../test_files/string/dictionary_utf8.slt | 2 +
.../test_files/string/init_data.slt.part | 3 +
.../test_files/string/large_string.slt | 4 +
.../sqllogictest/test_files/string/string.slt | 18 +
.../test_files/string/string_literal.slt | 843 +++++++++++
.../test_files/string/string_query.slt.part | 170 ++-
.../sqllogictest/test_files/string/string_view.slt | 7 +-
datafusion/sqllogictest/test_files/timestamps.slt | 7 +
datafusion/substrait/src/physical_plan/consumer.rs | 1 +
.../tests/cases/roundtrip_logical_plan.rs | 1 +
datafusion/wasmtest/src/lib.rs | 1 +
dev/create_license.py | 28 +-
dev/release/README.md | 2 +
dev/release/check-rat-report.py | 3 +-
dev/release/create-tarball.sh | 3 -
dev/release/download-python-wheels.py | 29 +-
dev/release/generate-changelog.py | 27 +-
dev/release/run-rat.sh | 43 -
dev/update_arrow_deps.py | 29 +-
dev/update_datafusion_versions.py | 30 +-
docs/source/conf.py | 6 +
docs/source/contributor-guide/howtos.md | 17 +-
docs/source/library-user-guide/profiling.md | 36 +-
docs/source/library-user-guide/query-optimizer.md | 2 +-
docs/source/user-guide/sql/scalar_functions.md | 52 +-
dev/depcheck/Cargo.toml => licenserc.toml | 17 +-
test-utils/src/array_gen/binary.rs | 94 ++
test-utils/src/array_gen/mod.rs | 2 +
test-utils/src/array_gen/primitive.rs | 7 +-
test-utils/src/array_gen/random_data.rs | 9 +-
196 files changed, 6479 insertions(+), 1334 deletions(-)
create mode 100644 datafusion-examples/examples/ffi/README.md
copy {test-utils =>
datafusion-examples/examples/ffi/ffi_example_table_provider}/Cargo.toml (71%)
create mode 100644
datafusion-examples/examples/ffi/ffi_example_table_provider/src/lib.rs
copy rustfmt.toml =>
datafusion-examples/examples/ffi/ffi_module_interface/Cargo.toml (84%)
create mode 100644
datafusion-examples/examples/ffi/ffi_module_interface/src/lib.rs
copy {dev/depcheck =>
datafusion-examples/examples/ffi/ffi_module_loader}/Cargo.toml (72%)
create mode 100644
datafusion-examples/examples/ffi/ffi_module_loader/src/main.rs
rename datafusion/{core/src/physical_optimizer =>
physical-optimizer/src}/coalesce_batches.rs (88%)
rename datafusion/{core/src/physical_optimizer =>
physical-optimizer/src}/update_aggr_exprs.rs (85%)
delete mode 100755 dev/release/run-rat.sh
copy dev/depcheck/Cargo.toml => licenserc.toml (79%)
create mode 100644 test-utils/src/array_gen/binary.rs
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
