This is an automated email from the ASF dual-hosted git repository.
alamb pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
from 733886320f Minor: Debug log when FairPool is created (#7431)
add 18a03bdb9b Support Configuring Arrow RecordBatch Writers via SQL
Statement Options (#7390)
No new revisions were added by this update.
Summary of changes:
datafusion/common/Cargo.toml | 2 +-
datafusion/common/src/error.rs | 7 +
.../src/file_options/arrow_writer.rs} | 27 +-
.../src/file_options/avro_writer.rs} | 27 +-
datafusion/common/src/file_options/csv_writer.rs | 107 ++++++
.../common/src/{ => file_options}/file_type.rs | 28 +-
datafusion/common/src/file_options/json_writer.rs | 53 +++
datafusion/common/src/file_options/mod.rs | 420 +++++++++++++++++++++
.../common/src/file_options/parquet_writer.rs | 169 +++++++++
datafusion/common/src/file_options/parse_utils.rs | 183 +++++++++
datafusion/common/src/lib.rs | 6 +-
datafusion/common/src/parsers.rs | 2 +-
datafusion/core/src/dataframe.rs | 13 +-
.../core/src/datasource/file_format/arrow.rs | 6 +-
datafusion/core/src/datasource/file_format/avro.rs | 5 +
datafusion/core/src/datasource/file_format/csv.rs | 84 ++---
datafusion/core/src/datasource/file_format/json.rs | 27 +-
datafusion/core/src/datasource/file_format/mod.rs | 5 +-
.../core/src/datasource/file_format/parquet.rs | 228 +----------
.../core/src/datasource/file_format/write.rs | 16 +-
datafusion/core/src/datasource/listing/table.rs | 42 ++-
.../core/src/datasource/listing_table_factory.rs | 85 +++--
.../core/src/datasource/physical_plan/mod.rs | 9 +-
datafusion/core/src/physical_planner.rs | 17 +-
datafusion/expr/src/logical_plan/builder.rs | 9 +-
datafusion/expr/src/logical_plan/dml.rs | 8 +-
datafusion/expr/src/logical_plan/plan.rs | 10 +-
datafusion/expr/src/utils.rs | 8 +-
datafusion/proto/src/physical_plan/mod.rs | 5 +-
datafusion/sql/src/statement.rs | 64 +---
datafusion/sql/tests/sql_integration.rs | 6 +-
datafusion/sqllogictest/test_files/copy.slt | 112 +++++-
32 files changed, 1340 insertions(+), 450 deletions(-)
copy datafusion/{proto/examples/expr_serde.rs =>
common/src/file_options/arrow_writer.rs} (63%)
copy datafusion/{proto/examples/expr_serde.rs =>
common/src/file_options/avro_writer.rs} (64%)
create mode 100644 datafusion/common/src/file_options/csv_writer.rs
copy datafusion/common/src/{ => file_options}/file_type.rs (94%)
create mode 100644 datafusion/common/src/file_options/json_writer.rs
create mode 100644 datafusion/common/src/file_options/mod.rs
create mode 100644 datafusion/common/src/file_options/parquet_writer.rs
create mode 100644 datafusion/common/src/file_options/parse_utils.rs
