This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion.git
from 8615ef4a90 chore(deps-dev): bump node-forge from 1.3.1 to 1.3.2 in
/datafusion/wasmtest/datafusion-wasm-app (#18958)
add 9f725d9c70 move projection handling into FileSource (#18627)
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 1 -
.../examples/custom_data_source/csv_json_opener.rs | 28 +-
.../custom_data_source/default_column_values.rs | 2 +-
.../examples/data_io/parquet_advanced_index.rs | 2 +-
.../examples/data_io/parquet_index.rs | 2 +-
datafusion/catalog-listing/src/table.rs | 2 +-
datafusion/core/src/dataframe/parquet.rs | 2 +-
datafusion/core/src/datasource/file_format/mod.rs | 2 +-
.../core/src/datasource/physical_plan/avro.rs | 6 +-
.../core/src/datasource/physical_plan/csv.rs | 18 +-
.../core/src/datasource/physical_plan/json.rs | 3 +-
.../core/src/datasource/physical_plan/parquet.rs | 2 +
datafusion/core/src/datasource/view_test.rs | 5 +-
datafusion/core/src/test/mod.rs | 7 +-
datafusion/core/tests/parquet/schema_coercion.rs | 1 +
.../physical_optimizer/filter_pushdown/util.rs | 13 +-
.../physical_optimizer/partition_statistics.rs | 2 +-
.../physical_optimizer/projection_pushdown.rs | 51 +-
datafusion/core/tests/sql/explain_analyze.rs | 3 +-
datafusion/datasource-arrow/src/file_format.rs | 9 +-
datafusion/datasource-arrow/src/source.rs | 187 ++++-
datafusion/datasource-avro/src/file_format.rs | 8 +-
datafusion/datasource-avro/src/source.rs | 49 +-
datafusion/datasource-csv/src/mod.rs | 11 +-
datafusion/datasource-csv/src/source.rs | 47 +-
datafusion/datasource-json/src/file_format.rs | 6 -
datafusion/datasource-json/src/source.rs | 45 +-
datafusion/datasource-parquet/src/file_format.rs | 13 +-
datafusion/datasource-parquet/src/source.rs | 42 +-
datafusion/datasource/src/file.rs | 38 +-
datafusion/datasource/src/file_scan_config.rs | 935 +++++----------------
datafusion/datasource/src/file_stream.rs | 125 +--
datafusion/datasource/src/memory.rs | 10 +-
datafusion/datasource/src/mod.rs | 1 +
datafusion/datasource/src/projection.rs | 631 ++++++++++++++
datafusion/datasource/src/source.rs | 9 +-
datafusion/datasource/src/test_util.rs | 39 +-
datafusion/physical-expr/Cargo.toml | 1 -
datafusion/physical-plan/src/projection.rs | 5 +
datafusion/proto/proto/datafusion.proto | 11 +
datafusion/proto/src/generated/pbjson.rs | 217 +++++
datafusion/proto/src/generated/prost.rs | 14 +
datafusion/proto/src/physical_plan/from_proto.rs | 35 +-
datafusion/proto/src/physical_plan/mod.rs | 1 -
datafusion/proto/src/physical_plan/to_proto.rs | 30 +-
.../proto/tests/cases/roundtrip_physical_plan.rs | 4 +-
.../sqllogictest/test_files/explain_tree.slt | 20 +-
datafusion/sqllogictest/test_files/joins.slt | 9 +-
datafusion/sqllogictest/test_files/math.slt | 4 +-
.../test_files/monotonic_projection_test.slt | 8 +-
datafusion/sqllogictest/test_files/order.slt | 6 +-
.../test_files/parquet_sorted_statistics.slt | 3 +-
datafusion/sqllogictest/test_files/select.slt | 4 +-
datafusion/sqllogictest/test_files/topk.slt | 3 +-
datafusion/sqllogictest/test_files/union.slt | 3 +-
datafusion/sqllogictest/test_files/unnest.slt | 15 +-
datafusion/sqllogictest/test_files/window.slt | 16 +-
datafusion/substrait/src/physical_plan/consumer.rs | 2 +-
datafusion/substrait/src/physical_plan/producer.rs | 2 +-
docs/source/library-user-guide/upgrading.md | 115 +++
60 files changed, 1781 insertions(+), 1104 deletions(-)
create mode 100644 datafusion/datasource/src/projection.rs
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
