This is an automated email from the ASF dual-hosted git repository.
nevime pushed a change to branch rust-parquet-arrow-writer
in repository https://gitbox.apache.org/repos/asf/arrow.git.
discard 18ad03a ARROW-8426: [Rust] [Parquet] - Add more support for
converting Dicts
omit 9ba2179 ARROW-7842: [Rust] [Parquet] Arrow list reader
omit 0b5a846 ARROW-10334: [Rust] [Parquet] NullArray roundtrip
omit 25d96c5 ARROW-10225: [Rust] [Parquet] Fix null comparison in roundtrip
omit 96798dc ARROW-10168: [Rust] [Parquet] Schema roundtrip - use Arrow
schema from Parquet metadata when available
omit 6677a41 ARROW-10191: [Rust] [Parquet] Add roundtrip Arrow -> Parquet
tests for all supported Arrow DataTypes
omit 5063854 ARROW-8426: [Rust] [Parquet] Add support for writing
dictionary types
omit 98d4ffc ARROW-10095: [Rust] Update rust-parquet-arrow-writer branch's
encode_arrow_schema with ipc changes
omit dcec335 ARROW-8423: [Rust] [Parquet] Serialize Arrow schema metadata
omit 6dc26ed ARROW-8289: [Rust] Parquet Arrow writer with nested support
add a764d3b ARROW-10332: [Rust] Allow CSV reader to iterate from start up
to end
add 7155cd5 ARROW-10135: [Rust] [Parquet] Refactor file module to help
adding sources
add f6501a5 ARROW-10319: [Go][Flight] Add context to flight client auth
handler
add 06d4f17 ARROW-10390: [Rust][Parquet] Ensure it is possible to create
custom parquet writers
new a3cd160 ARROW-8289: [Rust] Parquet Arrow writer with nested support
new b11c9a5 ARROW-8423: [Rust] [Parquet] Serialize Arrow schema metadata
new fc35a22 ARROW-10095: [Rust] Update rust-parquet-arrow-writer branch's
encode_arrow_schema with ipc changes
new 02db44e ARROW-8426: [Rust] [Parquet] Add support for writing
dictionary types
new 2c7fa07 ARROW-10191: [Rust] [Parquet] Add roundtrip Arrow -> Parquet
tests for all supported Arrow DataTypes
new a305933 ARROW-10168: [Rust] [Parquet] Schema roundtrip - use Arrow
schema from Parquet metadata when available
new 230c97c ARROW-10225: [Rust] [Parquet] Fix null comparison in roundtrip
new 13e15fe ARROW-10334: [Rust] [Parquet] NullArray roundtrip
new 2b04fbd ARROW-7842: [Rust] [Parquet] Arrow list reader
new ce06e17 ARROW-8426: [Rust] [Parquet] - Add more support for
converting Dicts
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (18ad03a)
\
N -- N -- N refs/heads/rust-parquet-arrow-writer (ce06e17)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 10 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
go/arrow/flight/client.go | 2 +-
go/arrow/flight/client_auth.go | 8 +-
go/arrow/flight/flight_test.go | 24 +-
rust/arrow/examples/read_csv.rs | 2 +-
rust/arrow/src/array/builder.rs | 159 ++--
rust/arrow/src/csv/reader.rs | 395 ++++----
rust/arrow/src/util/buffered_iterator.rs | 138 +++
rust/arrow/src/util/mod.rs | 1 +
rust/datafusion/src/physical_plan/csv.rs | 1 +
rust/parquet/src/arrow/array_reader.rs | 16 +-
rust/parquet/src/file/footer.rs | 263 ++++++
rust/parquet/src/file/mod.rs | 5 +
rust/parquet/src/file/reader.rs | 992 +--------------------
.../src/file/{reader.rs => serialized_reader.rs} | 569 ++----------
rust/parquet/src/file/writer.rs | 5 +-
rust/parquet/src/util/cursor.rs | 113 +++
rust/parquet/src/util/io.rs | 22 +-
rust/parquet/src/util/mod.rs | 1 +
rust/parquet/tests/custom_writer.rs | 100 +++
19 files changed, 1125 insertions(+), 1691 deletions(-)
create mode 100644 rust/arrow/src/util/buffered_iterator.rs
create mode 100644 rust/parquet/src/file/footer.rs
copy rust/parquet/src/file/{reader.rs => serialized_reader.rs} (59%)
create mode 100644 rust/parquet/src/util/cursor.rs
create mode 100644 rust/parquet/tests/custom_writer.rs
