This is an automated email from the ASF dual-hosted git repository.
alamb pushed a change to branch dependabot/cargo/main/env_logger-0.11
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
from ad3aa4c407 Merge remote-tracking branch 'apache/main' into
dependabot/cargo/main/env_logger-0.11
add 903ef94a47 Deprecate make_scalar_function (#8878)
add 827668ab3d Update project links (#8954)
add 31b9b48b08 fix issue #8922 make row group test more readable (#8941)
add 084fdfbeb7 feat:implement sql style 'ends_with' and 'instr' string
function (#8862)
add 04e147b18c [MINOR]: Extract aggregate topk function to
`aggregate_topk.slt` (#8948)
add 558b3d6cbe Combine multiple `IN` lists in `ExprSimplifier` (#8949)
add ee7ab0b83f Fix clippy failures (#8972)
add 19ca7d2341 feat: Support parquet bloom filter pruning for decimal128
(#8930)
add b5db718776 [MINOR]: Update create_window_expr to refer only input
schema (#8945)
add 78ca43c9a6 Don't error in simplify_expressions rule (#8957)
add 2b848778ad avoid unwrap (#8956)
add 5d70c32a9a Change `Accumulator::evaluate` and `Accumulator::state` to
take `&mut self` (#8925)
add bc0ba6a724 Enhance simplifier by adding Canonicalize (#8780)
add 7ad929a117 Find the correct fields when using page filter on `struct`
fields in parquet (#8848)
add 94a6192f6b fix: allow placeholders to be substited when coercible
(#8977)
add 90e61c7aab Minor: improve CatalogProvider documentation with rationale
(#8968)
add d81c82de44 Improve to_timestamp docs (#8981)
add d6ab343791 Add helper function for processing scalar function input
(#8962)
add 4ac7de17ca Fix optimize projections bug (#8960)
add 4a3986aca9 NOT operator not return internal error when args are not
boolean value (#8982)
add 928162fd85 Minor: Add new Extended ClickBench benchmark queries (#8950)
add 80a42bf7f6 Minor: Add comments to MSRV CI check to help if it fails
(#8995)
add 7a0af5be23 Minor: Document memory management design on MemoryPool
(#8966)
add 5e9c9a1f7c Fix LEAD/LAG window functions when default value null
(#8989)
add eb6d63fb93 Optimize MIN/MAX when relation is empty (#8940)
add b97daf7fc8 [task #8203] Port tests in joins.rs to sqllogictest (#8996)
add fa65c68b50 [task #8213]Port tests in select.rs to sqllogictest (#8967)
add 6e4abf5177 test: Port (last) `repartition.rs` query to sqllogictest
(#8936)
add 4d02cc0114 Update to sqlparser `0.42.0` (#9000)
add 8a4bad4654 Add new test (#8992)
add bee7136a04 Make Topk aggregate tests deterministic (#8998)
add bd38142de4 Add support for Postgres LIKE operators (#8894)
add 35c7b2c85b bug: Datafusion doesn't respect case sensitive table
references (#8964)
add 7005e2ede6 Document parallelism and thread scheduling in the
architecture guide (#8986)
add ec6abece2d Fix None Projections in Projection Pushdown (#9005)
add b3fe6aa68a Lead and Lag window functions should support default value
with data type other than Int64 (#9001)
add c42bf4842b chore: fix license badge in README (#9008)
add fc75255720 Minor: fix: #9010 - Optimizer schema change assert error is
incorrect (#9012)
add 095e228090 docs: fix array_position docs (#9003)
add ed24539019 Rename `CatalogList` to `CatalogProviderList` (#9002)
add a7a74fa522 Safeguard against potential inexact row count being smaller
than exact null count (#9007)
add a6cdd0d77f Recursive CTEs: Stage 3 - add execution support (#8840)
add 7a5f205430 test: move the creation of the nan_table to slt (#9022)
add 9c4affe785 TreeNode refactor code deduplication: Part 3 (#8817)
add ff7dfc3787 feat: Disable client console highlight by default (#9013)
add a668abf8d1 [task #8917] Implement information_schema.schemata (#8993)
add 51b8982888 Properly encode STRING_AGG, NTH_VALUE in physical plan
protobufs (#9027)
add f4fc2639f1 [task #8201] Port tests in expr.rs to sqllogictest, finish
the left c… (#9014)
add 1097dc0345 Fix the clippy error of use of deprecated method (#9034)
add fffc8bef30 feat: support the ergonomics of getting list slice with
stride (#8946)
add a57e270088 Cache common referred expression at the window input (#9009)
add af0e8a95ca Optimize `COUNT( DISTINCT ...)` for strings (up to 9x
faster) (#8849)
add 9bf0f68b36 feat: Parallel Arrow file format reading (#8897)
add 92104a5446 Change remove from swap to shift in index map (#9049)
add d594e6257b Relax join keys constraint from Column to any physical
expression for physical join operators (#8991)
add d2625c35d1 Minor: Improve memory helper trait documentaiton (#9025)
add 90a821a061 Docs: improve contributor guide to explain how to work with
tickets (#8999)
add 8326f577bc upper and lower functions only work correctly on ascii
character #9053 (#9054)
add 724a8e8d5b spelling etc (#9035)
add 851bc7de85 explicitly list out all Expr types (#9038)
add 3eb7080671 Minor: improve scalar functions document (#9029)
add 488cfe117c Minor: alter a test to support new functionality (#9065)
add ee9736fc81 Remove some recursive clones (#9050)
add cea211d218 minor: remove useless macro (#8979)
add 8dee7bbb66 Causality Analysis for Builtin Window Functions (#9048)
add c3f6c0f079 Minor: add doc examples for RawTableAllocExt (#9059)
add 228c88f565 Update substrait requirement from 0.23.0 to 0.24.0 (#9067)
add 4d389c2590 Remove single_file_output option from FileSinkConfig and
Copy statement (#9041)
add 78447d6081 Add a make_date function (#9040)
add d6f7c1623e Speedup `DFSchema::merge` using HashSet indices (#9020)
add 7fb83cc318 Document minimum required rust version (#9071)
add efd2fd2e26 Return proper number of expressions for nth_value_agg
(#9044)
add 85ceb9db7a ScalarUDF with zero arguments should be provided with one
null array as parameter (#9031)
add 262d093976 Update strum requirement from 0.25.0 to 0.26.1 (#9046)
add d6d35f7c2b Create `datafusion-functions` crate, extract encode and
decode to (#8705)
add 0414b9f1a0 Add documentation for streaming usecase (#9070)
add feeee04601 fix: unambiguously truncate time in date_trunc function
(#9068)
add 15f59d9861 feat: support array_reverse (#9023)
add ec8ea7adf7 prettier to_timestamp_invoke (#9078)
add 9fbea3c97d Handle invalid types for negation (#9066)
add 47809d9bb4 Minor: reduce unwraps in datetime_expressions.rs (#9072)
add f2ac2c6afb Remove custom doubling strategy + add examples to
`VecAllocEx` (#9058)
add f8495a7f3f Split physical_plan_tpch into separate benchmarks (#9043)
add ad1e0b872e Minor: Add ParadeDB to the list of users (#9018)
add 5c48a21ad0 add check for unnecessary projection (#9079)
add 7ab03e7e23 chore(placeholder): update error message and add tests
(#9073)
add f22b33c49f refer to #8781, convert the internal_err! in
datetime_expression.rs to exec_err! (#9083)
add 0ca7f55ebb Add benchmarks for to_timestamp and make_date functions
(#9086)
add 102fbb439b Clarify ParadeDB branding (#9088)
add c843226d84 doc: Add example how to include latest datafusion (#9076)
add 1f70823cfc Update minimum rust version to 1.72 (#8997)
add 402625f035 . (#9099)
add a9fda5eb91 Update InfluxDB links in Known Users (#9092)
add c0636e8a2b Merge remote-tracking branch 'apache/main' into
dependabot/cargo/main/env_logger-0.11
No new revisions were added by this update.
Summary of changes:
.github/workflows/rust.yml | 22 +-
CONTRIBUTING.md | 2 +-
Cargo.toml | 9 +-
README.md | 25 +-
benchmarks/Cargo.toml | 2 +-
benchmarks/bench.sh | 17 +-
benchmarks/queries/clickbench/README.md | 176 +++-
benchmarks/queries/clickbench/extended.sql | 4 +-
datafusion-cli/Cargo.lock | 145 ++-
datafusion-cli/Cargo.toml | 3 +-
datafusion-cli/src/catalog.rs | 11 +-
datafusion-cli/src/exec.rs | 1 +
datafusion-cli/src/helper.rs | 15 +-
datafusion-cli/src/highlighter.rs | 10 +-
datafusion-cli/src/lib.rs | 3 +-
datafusion-cli/src/main.rs | 18 +-
datafusion-cli/src/print_options.rs | 1 +
datafusion-examples/README.md | 3 +
datafusion-examples/examples/advanced_udaf.rs | 4 +-
datafusion-examples/examples/csv_sql_streaming.rs | 74 ++
.../examples/external_dependency/catalog.rs | 14 +-
datafusion-examples/examples/make_date.rs | 120 +++
datafusion-examples/examples/simple_udaf.rs | 4 +-
datafusion-examples/examples/simple_udf.rs | 15 +-
.../{dataframe_to_timestamp.rs => to_timestamp.rs} | 37 +-
datafusion/common/src/dfschema.rs | 16 +-
datafusion/common/src/param_value.rs | 24 +-
datafusion/common/src/scalar.rs | 10 +
datafusion/common/src/stats.rs | 7 +-
datafusion/common/src/test_util.rs | 20 +
datafusion/common/src/tree_node.rs | 137 ++-
datafusion/core/Cargo.toml | 8 +-
datafusion/core/benches/sql_planner.rs | 72 +-
datafusion/core/src/catalog/information_schema.rs | 140 ++-
datafusion/core/src/catalog/mod.rs | 103 +-
datafusion/core/src/catalog/schema.rs | 34 +-
datafusion/core/src/dataframe/mod.rs | 4 +-
datafusion/core/src/dataframe/parquet.rs | 1 -
datafusion/core/src/datasource/cte_worktable.rs | 10 +-
.../core/src/datasource/file_format/arrow.rs | 1 -
.../core/src/datasource/file_format/parquet.rs | 1 -
.../core/src/datasource/file_format/write/demux.rs | 2 +-
.../datasource/file_format/write/orchestration.rs | 2 -
datafusion/core/src/datasource/listing/table.rs | 1 -
.../src/datasource/physical_plan/arrow_file.rs | 159 ++-
.../core/src/datasource/physical_plan/csv.rs | 4 +-
.../core/src/datasource/physical_plan/json.rs | 4 +-
.../core/src/datasource/physical_plan/mod.rs | 4 -
.../src/datasource/physical_plan/parquet/mod.rs | 84 +-
.../physical_plan/parquet/page_filter.rs | 39 +-
.../datasource/physical_plan/parquet/row_groups.rs | 80 +-
datafusion/core/src/datasource/statistics.rs | 4 +-
datafusion/core/src/execution/context/mod.rs | 33 +-
datafusion/core/src/lib.rs | 45 +-
.../src/physical_optimizer/aggregate_statistics.rs | 98 +-
.../src/physical_optimizer/enforce_distribution.rs | 1058 +++++++++-----------
.../core/src/physical_optimizer/enforce_sorting.rs | 897 ++++++++---------
.../core/src/physical_optimizer/join_selection.rs | 346 ++++---
.../src/physical_optimizer/pipeline_checker.rs | 67 +-
.../src/physical_optimizer/projection_pushdown.rs | 81 +-
.../replace_with_order_preserving_variants.rs | 324 +++---
.../core/src/physical_optimizer/sort_pushdown.rs | 201 ++--
.../core/src/physical_optimizer/test_utils.rs | 27 +-
datafusion/core/src/physical_optimizer/utils.rs | 29 +-
datafusion/core/src/physical_planner.rs | 45 +-
datafusion/core/src/prelude.rs | 1 +
.../core/tests/data/recursive_cte/balance.csv | 5 +
.../core/tests/data/recursive_cte/growth.csv | 4 +
.../core/tests/data/recursive_cte/prices.csv | 101 ++
datafusion/core/tests/data/recursive_cte/sales.csv | 10 +
.../core/tests/data/recursive_cte/salespersons.csv | 8 +
datafusion/core/tests/data/recursive_cte/time.csv | 5 +
.../core/tests/dataframe/dataframe_functions.rs | 99 +-
datafusion/core/tests/dataframe/mod.rs | 133 ++-
.../tests/fuzz_cases/distinct_count_string_fuzz.rs | 211 ++++
datafusion/core/tests/fuzz_cases/join_fuzz.rs | 8 +-
datafusion/core/tests/fuzz_cases/mod.rs | 1 +
datafusion/core/tests/fuzz_cases/window_fuzz.rs | 289 +++---
datafusion/core/tests/parquet/mod.rs | 28 +
datafusion/core/tests/parquet/row_group_pruning.rs | 873 ++++++++--------
datafusion/core/tests/sql/expr.rs | 413 --------
datafusion/core/tests/sql/joins.rs | 59 --
datafusion/core/tests/sql/mod.rs | 103 +-
datafusion/core/tests/sql/repartition.rs | 59 --
datafusion/core/tests/sql/select.rs | 660 +++---------
.../tests/user_defined/user_defined_aggregates.rs | 12 +-
.../user_defined/user_defined_scalar_functions.rs | 162 ++-
datafusion/execution/src/memory_pool/mod.rs | 81 +-
datafusion/execution/src/memory_pool/proxy.rs | 104 +-
datafusion/execution/src/registry.rs | 62 +-
datafusion/expr/Cargo.toml | 4 +-
datafusion/expr/src/accumulator.rs | 23 +-
datafusion/expr/src/built_in_function.rs | 104 +-
datafusion/expr/src/columnar_value.rs | 12 +
datafusion/expr/src/expr.rs | 39 +-
datafusion/expr/src/expr_fn.rs | 49 +-
datafusion/expr/src/expr_schema.rs | 9 +-
datafusion/expr/src/field_util.rs | 13 +-
datafusion/expr/src/logical_plan/builder.rs | 4 +-
datafusion/expr/src/logical_plan/dml.rs | 4 -
datafusion/expr/src/logical_plan/plan.rs | 85 +-
datafusion/expr/src/operator.rs | 24 +
datafusion/expr/src/partition_evaluator.rs | 5 +
datafusion/expr/src/tree_node/expr.rs | 193 ++--
datafusion/expr/src/tree_node/plan.rs | 64 +-
datafusion/expr/src/type_coercion/binary.rs | 7 +
datafusion/expr/src/utils.rs | 2 +-
datafusion/{expr => functions}/Cargo.toml | 32 +-
datafusion/{common => functions}/README.md | 5 +-
.../src/encoding/inner.rs} | 116 ++-
.../user_defined => functions/src/encoding}/mod.rs | 19 +-
datafusion/functions/src/lib.rs | 109 ++
datafusion/functions/src/macros.rs | 123 +++
datafusion/optimizer/src/analyzer/rewrite_expr.rs | 2 +-
datafusion/optimizer/src/analyzer/type_coercion.rs | 29 +-
.../optimizer/src/common_subexpr_eliminate.rs | 79 +-
datafusion/optimizer/src/eliminate_outer_join.rs | 5 +-
datafusion/optimizer/src/optimize_projections.rs | 72 +-
datafusion/optimizer/src/optimizer.rs | 30 +-
datafusion/optimizer/src/push_down_filter.rs | 117 +--
datafusion/optimizer/src/push_down_limit.rs | 106 +-
.../src/simplify_expressions/expr_simplifier.rs | 388 +++++--
.../src/simplify_expressions/inlist_simplifier.rs | 136 +++
.../optimizer/src/simplify_expressions/mod.rs | 1 +
.../simplify_expressions/or_in_list_simplifier.rs | 12 +-
.../src/simplify_expressions/simplify_exprs.rs | 103 +-
.../optimizer/src/unwrap_cast_in_comparison.rs | 4 +-
datafusion/optimizer/src/utils.rs | 3 +-
datafusion/physical-expr/Cargo.toml | 9 +
datafusion/physical-expr/benches/make_date.rs | 115 +++
datafusion/physical-expr/benches/to_timestamp.rs | 125 +++
.../physical-expr/src/aggregate/approx_distinct.rs | 4 +-
.../src/aggregate/approx_percentile_cont.rs | 4 +-
.../approx_percentile_cont_with_weight.rs | 4 +-
.../physical-expr/src/aggregate/array_agg.rs | 4 +-
.../src/aggregate/array_agg_distinct.rs | 4 +-
.../src/aggregate/array_agg_ordered.rs | 4 +-
datafusion/physical-expr/src/aggregate/average.rs | 8 +-
.../physical-expr/src/aggregate/bit_and_or_xor.rs | 16 +-
.../physical-expr/src/aggregate/bool_and_or.rs | 8 +-
.../physical-expr/src/aggregate/correlation.rs | 6 +-
datafusion/physical-expr/src/aggregate/count.rs | 4 +-
.../{count_distinct.rs => count_distinct/mod.rs} | 138 +--
.../src/aggregate/count_distinct/strings.rs | 490 +++++++++
.../physical-expr/src/aggregate/covariance.rs | 6 +-
.../physical-expr/src/aggregate/first_last.rs | 8 +-
.../src/aggregate/groups_accumulator/adapter.rs | 4 +-
.../physical-expr/src/aggregate/hyperloglog.rs | 8 +-
datafusion/physical-expr/src/aggregate/median.rs | 7 +-
datafusion/physical-expr/src/aggregate/min_max.rs | 16 +-
.../physical-expr/src/aggregate/nth_value.rs | 13 +-
datafusion/physical-expr/src/aggregate/regr.rs | 4 +-
datafusion/physical-expr/src/aggregate/stddev.rs | 6 +-
.../physical-expr/src/aggregate/string_agg.rs | 4 +-
datafusion/physical-expr/src/aggregate/sum.rs | 8 +-
.../physical-expr/src/aggregate/sum_distinct.rs | 4 +-
datafusion/physical-expr/src/aggregate/utils.rs | 2 +-
datafusion/physical-expr/src/aggregate/variance.rs | 6 +-
datafusion/physical-expr/src/array_expressions.rs | 69 ++
.../physical-expr/src/datetime_expressions.rs | 500 ++++++++-
datafusion/physical-expr/src/equivalence/class.rs | 26 +-
.../physical-expr/src/equivalence/properties.rs | 79 +-
datafusion/physical-expr/src/expressions/binary.rs | 105 +-
datafusion/physical-expr/src/expressions/case.rs | 10 +
.../src/expressions/get_indexed_field.rs | 85 +-
.../physical-expr/src/expressions/negative.rs | 28 +-
datafusion/physical-expr/src/expressions/not.rs | 11 +-
datafusion/physical-expr/src/functions.rs | 568 +++++++----
.../physical-expr/src/intervals/cp_solver.rs | 2 +-
datafusion/physical-expr/src/lib.rs | 2 -
datafusion/physical-expr/src/planner.rs | 45 +-
datafusion/physical-expr/src/regex_expressions.rs | 6 +-
datafusion/physical-expr/src/scalar_function.rs | 17 +-
datafusion/physical-expr/src/sort_properties.rs | 68 +-
datafusion/physical-expr/src/string_expressions.rs | 76 +-
datafusion/physical-expr/src/tree_node.rs | 71 +-
datafusion/physical-expr/src/udf.rs | 1 +
datafusion/physical-expr/src/utils/mod.rs | 53 +-
datafusion/physical-expr/src/window/built_in.rs | 7 +-
datafusion/physical-expr/src/window/lead_lag.rs | 20 +-
datafusion/physical-expr/src/window/rank.rs | 4 +
datafusion/physical-expr/src/window/row_number.rs | 5 +
datafusion/physical-plan/src/aggregates/mod.rs | 6 +-
.../physical-plan/src/aggregates/no_grouping.rs | 13 +-
datafusion/physical-plan/src/filter.rs | 2 +-
datafusion/physical-plan/src/joins/hash_join.rs | 197 ++--
.../physical-plan/src/joins/sort_merge_join.rs | 152 +--
.../physical-plan/src/joins/symmetric_hash_join.rs | 84 +-
datafusion/physical-plan/src/joins/test_utils.rs | 12 +-
datafusion/physical-plan/src/joins/utils.rs | 381 ++++---
datafusion/physical-plan/src/lib.rs | 2 +
datafusion/physical-plan/src/recursive_query.rs | 377 +++++++
datafusion/physical-plan/src/tree_node.rs | 70 +-
datafusion/physical-plan/src/windows/mod.rs | 9 +-
datafusion/physical-plan/src/work_table.rs | 192 ++++
datafusion/proto/Cargo.toml | 5 +-
datafusion/proto/gen/Cargo.toml | 2 +-
datafusion/proto/proto/datafusion.proto | 14 +-
datafusion/proto/src/bytes/mod.rs | 3 +-
datafusion/proto/src/generated/pbjson.rs | 88 +-
datafusion/proto/src/generated/prost.rs | 30 +-
datafusion/proto/src/logical_plan/from_proto.rs | 51 +-
datafusion/proto/src/logical_plan/mod.rs | 3 -
datafusion/proto/src/logical_plan/to_proto.rs | 25 +-
datafusion/proto/src/physical_plan/from_proto.rs | 29 +-
datafusion/proto/src/physical_plan/mod.rs | 73 +-
datafusion/proto/src/physical_plan/to_proto.rs | 26 +-
.../proto/tests/cases/roundtrip_logical_plan.rs | 54 +-
.../proto/tests/cases/roundtrip_physical_plan.rs | 91 +-
datafusion/proto/tests/cases/serialize.rs | 12 +-
datafusion/sql/src/expr/binary_op.rs | 4 +
datafusion/sql/src/expr/mod.rs | 53 +-
datafusion/sql/src/parser.rs | 12 +-
datafusion/sql/src/planner.rs | 4 +-
datafusion/sql/src/query.rs | 1 -
datafusion/sql/src/statement.rs | 65 +-
datafusion/sql/tests/sql_integration.rs | 8 +-
datafusion/sqllogictest/Cargo.toml | 1 +
datafusion/sqllogictest/src/test_context.rs | 43 +-
datafusion/sqllogictest/test_files/aggregate.slt | 269 ++---
.../sqllogictest/test_files/aggregates_topk.slt | 214 ++++
datafusion/sqllogictest/test_files/array.slt | 79 ++
.../sqllogictest/test_files/arrow_typeof.slt | 4 +-
datafusion/sqllogictest/test_files/clickbench.slt | 3 +
datafusion/sqllogictest/test_files/copy.slt | 34 +-
datafusion/sqllogictest/test_files/csv_files.slt | 4 +-
datafusion/sqllogictest/test_files/cte.slt | 632 ++++++++++++
datafusion/sqllogictest/test_files/expr.slt | 751 ++++++++++++++
datafusion/sqllogictest/test_files/functions.slt | 57 +-
datafusion/sqllogictest/test_files/group_by.slt | 8 +-
.../sqllogictest/test_files/information_schema.slt | 17 +
.../information_schema_multiple_catalogs.slt | 4 +
.../test_files/information_schema_table_types.slt | 1 +
datafusion/sqllogictest/test_files/joins.slt | 76 +-
datafusion/sqllogictest/test_files/math.slt | 38 +-
datafusion/sqllogictest/test_files/parquet.slt | 8 +-
datafusion/sqllogictest/test_files/predicates.slt | 61 ++
datafusion/sqllogictest/test_files/repartition.slt | 58 +-
.../sqllogictest/test_files/repartition_scan.slt | 19 +-
datafusion/sqllogictest/test_files/scalar.slt | 10 +-
.../sqllogictest/test_files/schema_evolution.slt | 8 +-
datafusion/sqllogictest/test_files/select.slt | 410 +++++++-
datafusion/sqllogictest/test_files/subquery.slt | 2 +-
datafusion/sqllogictest/test_files/timestamps.slt | 331 ++++++
.../sqllogictest/test_files/tpch/q12.slt.part | 6 +-
.../sqllogictest/test_files/tpch/q4.slt.part | 6 +-
datafusion/sqllogictest/test_files/window.slt | 207 ++--
datafusion/substrait/Cargo.toml | 5 +-
datafusion/substrait/src/logical_plan/producer.rs | 4 +
.../tests/cases/roundtrip_logical_plan.rs | 4 +-
datafusion/wasmtest/Cargo.toml | 2 +-
docs/Cargo.toml | 2 +-
docs/source/contributor-guide/index.md | 39 +-
docs/source/library-user-guide/adding-udfs.md | 11 +-
docs/source/library-user-guide/catalogs.md | 16 +-
docs/source/user-guide/cli.md | 3 +
docs/source/user-guide/example-usage.md | 27 +-
docs/source/user-guide/introduction.md | 3 +-
docs/source/user-guide/sql/ddl.md | 12 +-
docs/source/user-guide/sql/dml.md | 2 +-
docs/source/user-guide/sql/operators.md | 52 +
docs/source/user-guide/sql/scalar_functions.md | 276 ++++-
docs/source/user-guide/sql/write_options.md | 12 +-
263 files changed, 13280 insertions(+), 6178 deletions(-)
create mode 100644 datafusion-examples/examples/csv_sql_streaming.rs
create mode 100644 datafusion-examples/examples/make_date.rs
rename datafusion-examples/examples/{dataframe_to_timestamp.rs =>
to_timestamp.rs} (70%)
create mode 100644 datafusion/core/tests/data/recursive_cte/balance.csv
create mode 100644 datafusion/core/tests/data/recursive_cte/growth.csv
create mode 100644 datafusion/core/tests/data/recursive_cte/prices.csv
create mode 100644 datafusion/core/tests/data/recursive_cte/sales.csv
create mode 100644 datafusion/core/tests/data/recursive_cte/salespersons.csv
create mode 100644 datafusion/core/tests/data/recursive_cte/time.csv
create mode 100644
datafusion/core/tests/fuzz_cases/distinct_count_string_fuzz.rs
delete mode 100644 datafusion/core/tests/sql/expr.rs
delete mode 100644 datafusion/core/tests/sql/repartition.rs
copy datafusion/{expr => functions}/Cargo.toml (66%)
copy datafusion/{common => functions}/README.md (87%)
rename datafusion/{physical-expr/src/encoding_expressions.rs =>
functions/src/encoding/inner.rs} (82%)
copy datafusion/{core/tests/user_defined => functions/src/encoding}/mod.rs
(62%)
create mode 100644 datafusion/functions/src/lib.rs
create mode 100644 datafusion/functions/src/macros.rs
create mode 100644
datafusion/optimizer/src/simplify_expressions/inlist_simplifier.rs
create mode 100644 datafusion/physical-expr/benches/make_date.rs
create mode 100644 datafusion/physical-expr/benches/to_timestamp.rs
rename datafusion/physical-expr/src/aggregate/{count_distinct.rs =>
count_distinct/mod.rs} (89%)
create mode 100644
datafusion/physical-expr/src/aggregate/count_distinct/strings.rs
create mode 100644 datafusion/physical-plan/src/recursive_query.rs
create mode 100644 datafusion/physical-plan/src/work_table.rs
create mode 100644 datafusion/sqllogictest/test_files/aggregates_topk.slt