This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion.git
from dff1cad385 chore(deps): bump async-compression from 0.4.37 to 0.4.39
(#20259)
add 69d0f44cc4 Support JSON arrays reader/parse for datafusion (#19924)
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 3 +
Cargo.toml | 2 +
.../examples/custom_data_source/csv_json_opener.rs | 1 +
datafusion/common/src/config.rs | 16 +
datafusion/core/src/dataframe/mod.rs | 2 +-
datafusion/core/src/datasource/file_format/json.rs | 259 ++++++-
.../core/src/datasource/file_format/options.rs | 61 +-
datafusion/core/src/datasource/listing/table.rs | 3 +-
.../core/src/datasource/physical_plan/json.rs | 12 +-
datafusion/core/src/execution/context/json.rs | 10 +-
datafusion/core/src/prelude.rs | 2 +-
datafusion/core/tests/data/json_array.json | 5 +
datafusion/core/tests/data/json_empty_array.json | 1 +
datafusion/core/tests/dataframe/mod.rs | 9 +-
datafusion/datasource-json/Cargo.toml | 2 +
datafusion/datasource-json/src/file_format.rs | 150 +++-
datafusion/datasource-json/src/mod.rs | 1 +
datafusion/datasource-json/src/source.rs | 554 ++++++++++++++-
datafusion/datasource-json/src/utils.rs | 778 +++++++++++++++++++++
.../proto-common/proto/datafusion_common.proto | 1 +
datafusion/proto-common/src/from_proto/mod.rs | 1 +
datafusion/proto-common/src/generated/pbjson.rs | 18 +
datafusion/proto-common/src/generated/prost.rs | 3 +
datafusion/proto-common/src/to_proto/mod.rs | 1 +
.../proto/src/generated/datafusion_proto_common.rs | 3 +
datafusion/proto/src/logical_plan/file_formats.rs | 2 +
.../proto/tests/cases/roundtrip_logical_plan.rs | 4 +-
datafusion/sqllogictest/test_files/json.slt | 28 +
28 files changed, 1847 insertions(+), 85 deletions(-)
create mode 100644 datafusion/core/tests/data/json_array.json
create mode 100644 datafusion/core/tests/data/json_empty_array.json
create mode 100644 datafusion/datasource-json/src/utils.rs
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
