This is an automated email from the ASF dual-hosted git repository.
etseidl pushed a change to branch gh5854_thrift_remodel
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
from f315dbe1e3 [thrift-remodel] Complete decoding of `FileMetaData` and
`RowGroupMetaData` (#8111)
add de7f8669af perf(arrow-ipc): avoid counting nulls in
`RecordBatchDecoder` (#8127)
add e410cd09af [Variant]: Implement DataType::Interval support for
cast_to_variant kernel (#8125)
add 6c65dd954c feat: arrow-ipc delta dictionary support (#8001)
add 0b845d8523 Add Initial `arrow-avro` writer implementation with basic
type support (#8123)
add 08c0984a8a Add schema resolution and type promotion support to
arrow-avro Decoder (#8124)
add 536ccf5bb7 [VARIANT] Add support for DataType::Utf8/LargeUtf8/Utf8View
for cast_to_variant (#8089)
add 4bb9127c8b [Variant] Add human-readable impl Debug for Variant (#8140)
add f248da3cc3 [VARIANT] Add support for DataType::Struct for
cast_to_variant (#8090)
add 48b723f118 [Variant] Add Variant::Time primitive and cast logic (#8114)
add e4f74d893e chore: Use tempfile to replace hand-written utils functions
(#8147)
add ace8dadb59 Implement `DataType::{Date32,Date64}` => `Variant::Date`
(#8081)
add f87f60e87e create PageIndexPolicy to allow optional indexes (#8071)
new 569411b6f1 Merge remote-tracking branch 'origin/main' into
gh5854_thrift_remodel
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/rust.yml | 5 +-
.../fixed_size_binary_dictionary_builder.rs | 93 +++
.../builder/generic_bytes_dictionary_builder.rs | 79 +++
.../src/builder/primitive_dictionary_builder.rs | 73 +++
arrow-avro/Cargo.toml | 2 +-
arrow-avro/src/compression.rs | 75 ++-
arrow-avro/src/lib.rs | 5 +
arrow-avro/src/reader/mod.rs | 405 ++++++++++++
arrow-avro/src/reader/record.rs | 305 ++++++++-
arrow-avro/src/writer/encoder.rs | 277 ++++++++
arrow-avro/src/writer/format.rs | 139 ++++
arrow-avro/src/writer/mod.rs | 341 ++++++++++
arrow-ipc/Cargo.toml | 1 +
arrow-ipc/src/lib.rs | 5 +-
arrow-ipc/src/reader.rs | 462 ++++++++++----
arrow-ipc/src/tests/delta_dictionary.rs | 479 ++++++++++++++
.../src/tests}/mod.rs | 11 +-
arrow-ipc/src/writer.rs | 256 +++++++-
arrow-ipc/tests/test_delta_dictionary.rs | 590 +++++++++++++++++
parquet-testing | 2 +-
parquet-variant-compute/Cargo.toml | 2 +-
parquet-variant-compute/src/cast_to_variant.rs | 710 ++++++++++++++++++++-
.../src/variant_array_builder.rs | 4 +-
.../src/variant_get/output/primitive.rs | 2 +-
.../src/variant_get/output/variant.rs | 2 +-
parquet-variant-json/src/to_json.rs | 33 +-
parquet-variant/src/builder.rs | 10 +
parquet-variant/src/decoder.rs | 42 +-
parquet-variant/src/variant.rs | 332 +++++++++-
parquet-variant/tests/variant_interop.rs | 7 +-
parquet/benches/arrow_reader_row_filter.rs | 5 +-
parquet/examples/external_metadata.rs | 8 +-
parquet/src/arrow/arrow_reader/mod.rs | 26 +-
parquet/src/arrow/async_reader/mod.rs | 16 +-
parquet/src/arrow/async_reader/store.rs | 6 +-
parquet/src/arrow/mod.rs | 2 +
parquet/src/file/metadata/mod.rs | 2 +-
parquet/src/file/metadata/reader.rs | 207 ++++--
parquet/src/file/serialized_reader.rs | 1 +
parquet/tests/arrow_reader/bad_data.rs | 1 +
parquet/tests/arrow_reader/predicate_cache.rs | 7 +-
41 files changed, 4758 insertions(+), 272 deletions(-)
create mode 100644 arrow-avro/src/writer/encoder.rs
create mode 100644 arrow-avro/src/writer/format.rs
create mode 100644 arrow-avro/src/writer/mod.rs
create mode 100644 arrow-ipc/src/tests/delta_dictionary.rs
copy {arrow-integration-testing/src/flight_client_scenarios =>
arrow-ipc/src/tests}/mod.rs (76%)
create mode 100644 arrow-ipc/tests/test_delta_dictionary.rs
