This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/pip/parquet/pytest/pyspark-3.4.4
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
discard c1384ece7b chore(deps): bump pyspark from 3.3.2 to 3.4.4 in
/parquet/pytest
add 6fae4eae85 refactor(parquet): bundle array reader recursion args into
`ReaderArgs` (#10089)
add 7aa97829e6 Run arrow tests for --lib and --tests on CI builds (#9814)
add 481223f875 feat(parquet-variant): add Dictionary and REE
variant_to_arrow support (#10014)
add d4c1b44e2b replace github .md templates with.yaml (#10096)
add c3e0684179 bench(parquet): add nested list writer benchmarks (#10084)
add dda2d2de83 perf(interleave): Optimize list interleave_list when child
is primitive (#10025)
add e106c15340 arrow-select: Optimize
`BatchCoalescer::push_batch_with_filter` for low selectivity filters and
inlined Utf8View/BinaryView (#9755)
add 301eb26bb9 Reduce copies in Arrow IPC writer (#10044)
add cecbc72edb removed clippy ignore statment (#10111)
add 826b808b27 Add `StructArray::field_` APIs symmetric to
`StructArray::column_` ones (#10110)
add 8d2333cd0a chore: update `Bytes` visibility to correctly reflect the
actual visibility (#10115)
add 549d77cb22 feat(arrow_array): add helper function to create MapArray
from `Vec<Option<Vec<(Key, Option<Value>)>>>` for tests (#10123)
add a6596e4097 feat: support `MapArray` in lengths kernel (#10121)
add 7567b7aacf optimize(concat): concat map implementation (#10048)
add 1ba5d486a4 [Variant] Preserve `UUID` extension type metadata for
Parquet writer (#10015)
add c4a831a1c8 ci: Split miri tests into 4 parallel shards (#10067)
add 11a58ac3ec chore: update pyo3 dependency to 0.29 (#10134)
add be664614ab Support writing REE arrays directly to Parquet (#10064)
add 78ca92d6ce [Variant] `VariantArray` field API naming (#10124)
add d4d79be389 Add tests and fix corner cases for Parquet/GeoArrow
extension type conversion (#10065)
add a212cf4170 perf(arrow-ipc): Add writer benchmarks for dictionaries
(#10122)
add 4a9061597a Add arrow-flight test coverage for IPC compression (#10097)
add e30bfe0cb2 Minor: Add interleave tests for List<Decimal128> and
List<Timestamp(tz)> (#10099)
add b9dd6f0031 [arrow-flight] Optimize flight, remove some allocations,
add dictionary focused benchmarks (#10126)
add b220251bdd fix(arrow-cast): check for overflow when converting Date32
-> Timestamp (#9825)
add 43d22d82c1 fix(parquet): return error instead of panicking in
pad_nulls on corrupt input (#10108)
add f36bfbbd3a fix(parquet_derive): support raw identifiers as column
names (#10113)
add d628e58b21 fix: handle Avro reader schema with no fields (#9611)
add 0eaa9d66be chore(deps): bump actions/checkout from 6 to 7 (#10159)
add c8eba1a0b9 chore: Fix clippy::useless_borrows_in_formatting (#10163)
add 7c6209f823 Fix Variant time microsecond JSON formatting (#10173)
add b79d20d639 fix(arrow-cast): respect cast safety for overflowing
temporal casts (#10162)
add 8afbea4b07 feat: Adds product aggregate compute kernel (#10151)
add 75538c8c5e doc: More comments to `concat_batches` (#10178)
add a1d8af82f5 arrow-buffer: implement Saturating, Checked num-traits for
i256 (#10088)
add 5be1b84e6a chore(deps): bump pyspark from 3.3.2 to 3.4.4 in
/parquet/pytest
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c1384ece7b)
\
N -- N -- N
refs/heads/dependabot/pip/parquet/pytest/pyspark-3.4.4 (5be1b84e6a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ISSUE_TEMPLATE/bug_report.md | 28 -
.github/ISSUE_TEMPLATE/bug_report.yml | 28 +
.github/ISSUE_TEMPLATE/config.yml | 5 +
.github/ISSUE_TEMPLATE/feature_request.md | 29 --
.github/ISSUE_TEMPLATE/feature_request.yml | 29 ++
.github/ISSUE_TEMPLATE/question.md | 23 -
.github/workflows/arrow.yml | 45 +-
.github/workflows/arrow_flight.yml | 6 +-
.github/workflows/audit.yml | 2 +-
.github/workflows/dev.yml | 4 +-
.github/workflows/dev_pr.yml | 2 +-
.github/workflows/docs.yml | 4 +-
.github/workflows/integration.yml | 16 +-
.github/workflows/miri.sh | 47 +-
.github/workflows/miri.yaml | 7 +-
.github/workflows/parquet-geospatial.yml | 6 +-
.github/workflows/parquet-variant.yml | 6 +-
.github/workflows/parquet.yml | 10 +-
.github/workflows/parquet_derive.yml | 4 +-
.github/workflows/release.yml | 2 +-
.github/workflows/rust.yml | 12 +-
Cargo.lock | 32 +-
arrow-arith/src/aggregate.rs | 145 ++++++
arrow-array/src/array/map_array.rs | 146 +++++-
arrow-array/src/array/struct_array.rs | 44 +-
arrow-avro/src/reader/async_reader/mod.rs | 57 ++
arrow-avro/src/reader/record.rs | 8 +-
arrow-buffer/src/bigint/mod.rs | 136 ++++-
arrow-buffer/src/bytes.rs | 17 +-
arrow-cast/src/cast/mod.rs | 150 +++++-
arrow-cast/src/parse.rs | 10 +-
arrow-flight/Cargo.toml | 2 +
arrow-flight/benches/common/mod.rs | 10 +-
arrow-flight/benches/flight.rs | 61 ++-
arrow-flight/src/encode.rs | 133 +++--
arrow-ipc/benches/ipc_writer.rs | 122 ++++-
arrow-ipc/src/writer.rs | 571 ++++++++++++++-------
arrow-ord/src/ord.rs | 151 ++----
arrow-pyarrow-integration-testing/Cargo.toml | 2 +-
arrow-pyarrow-testing/Cargo.toml | 2 +-
arrow-pyarrow/Cargo.toml | 2 +-
arrow-pyarrow/src/lib.rs | 4 +-
arrow-row/src/lib.rs | 2 +-
arrow-schema/src/error.rs | 4 +-
arrow-select/src/coalesce.rs | 363 ++++++++++++-
arrow-select/src/coalesce/byte_view.rs | 167 +++++-
arrow-select/src/coalesce/generic.rs | 11 +
arrow-select/src/coalesce/primitive.rs | 222 +++++++-
arrow-select/src/concat.rs | 193 ++++++-
arrow-select/src/filter.rs | 145 +++++-
arrow-select/src/interleave.rs | 235 ++++++++-
arrow-string/src/length.rs | 59 ++-
parquet-geospatial/src/types.rs | 74 +--
parquet-variant-compute/src/from_json.rs | 12 +-
parquet-variant-compute/src/shred_variant.rs | 202 ++++----
parquet-variant-compute/src/unshred_variant.rs | 4 +-
parquet-variant-compute/src/variant_array.rs | 124 ++++-
.../src/variant_array_builder.rs | 6 +-
parquet-variant-compute/src/variant_get.rs | 108 +++-
parquet-variant-compute/src/variant_to_arrow.rs | 63 ++-
parquet-variant-json/src/to_json.rs | 17 +-
parquet/benches/arrow_writer.rs | 81 ++-
parquet/src/arrow/array_reader/builder.rs | 88 ++--
parquet/src/arrow/array_reader/byte_array.rs | 8 +-
.../arrow/array_reader/byte_array_dictionary.rs | 12 +-
parquet/src/arrow/array_reader/byte_view_array.rs | 4 +-
.../src/arrow/array_reader/fixed_len_byte_array.rs | 11 +-
parquet/src/arrow/arrow_writer/levels.rs | 34 +-
parquet/src/arrow/arrow_writer/mod.rs | 237 +++++++++
parquet/src/arrow/buffer/dictionary_buffer.rs | 10 +-
parquet/src/arrow/buffer/offset_buffer.rs | 57 +-
parquet/src/arrow/buffer/view_buffer.rs | 9 +-
parquet/src/arrow/record_reader/buffer.rs | 8 +-
parquet/src/arrow/record_reader/mod.rs | 2 +-
parquet/src/arrow/schema/extension.rs | 55 +-
parquet/src/arrow/schema/mod.rs | 34 +-
parquet/src/schema/printer.rs | 4 +-
parquet/tests/geospatial.rs | 223 +++++++-
parquet_derive/src/lib.rs | 18 +-
parquet_derive/src/parquet_field.rs | 25 +-
parquet_derive_test/src/lib.rs | 49 ++
81 files changed, 4169 insertions(+), 931 deletions(-)
delete mode 100644 .github/ISSUE_TEMPLATE/bug_report.md
create mode 100644 .github/ISSUE_TEMPLATE/bug_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/config.yml
delete mode 100644 .github/ISSUE_TEMPLATE/feature_request.md
create mode 100644 .github/ISSUE_TEMPLATE/feature_request.yml
delete mode 100644 .github/ISSUE_TEMPLATE/question.md
