This is an automated email from the ASF dual-hosted git repository.
Jefffrey pushed a change to branch
dependabot/rust_toolchain/rust-toolchain-1.98.0
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
from 67e829ad35 Merge branch 'main' into
dependabot/rust_toolchain/rust-toolchain-1.98.0
add cb682a2f35 [Parquet] ALP encoder/decoder support (#9372)
add 2541f87dea fix(parquet): cut data page byte-budget mini-batches on
exact value counts (#10554)
add 7e3b403ac6 fix(parquet): reject Thrift list sizes larger than
remaining input (#10979)
add b372d1f14c fix(arrow-data): align struct null validation with parent
offset (#10970)
add f4877ff554 Merge branch 'main' into
dependabot/rust_toolchain/rust-toolchain-1.98.0
No new revisions were added by this update.
Summary of changes:
arrow-data/src/data.rs | 45 +-
parquet/src/arrow/arrow_writer/mod.rs | 2 +-
parquet/src/basic.rs | 10 +
parquet/src/bin/parquet-rewrite.rs | 4 +
parquet/src/column/writer/byte_budget_chunker.rs | 129 +-
parquet/src/column/writer/mod.rs | 259 +++-
parquet/src/data_type.rs | 1 +
parquet/src/encodings/alp.rs | 600 +++++++++
parquet/src/encodings/decoding.rs | 9 +-
parquet/src/encodings/decoding/alp_decoder.rs | 1549 ++++++++++++++++++++++
parquet/src/encodings/encoding/alp_encoder.rs | 1081 +++++++++++++++
parquet/src/encodings/encoding/mod.rs | 114 +-
parquet/src/encodings/mod.rs | 2 +
parquet/src/parquet_thrift.rs | 69 +-
parquet/tests/arrow_reader/parquet_testing.rs | 59 +-
15 files changed, 3797 insertions(+), 136 deletions(-)
create mode 100644 parquet/src/encodings/alp.rs
create mode 100644 parquet/src/encodings/decoding/alp_decoder.rs
create mode 100644 parquet/src/encodings/encoding/alp_encoder.rs