This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/apache-avro-approx-0.20.0
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
discard 989e8a5 build(deps): update apache-avro requirement from ~0.17.0 to
~0.20.0
add a8419ab feat: support picking up storage options from `HOODIE_ENV_`
env vars (#410)
add 8b8451a refactor: replace custom `.to::()` with `into()` for
`HudiConfig` conversions (#432)
add 57f17e0 refactor: move .crc filtering logic from table to storage
layer (#458)
add f6e450a build(deps): bump actions/setup-python from 5 to 6 (#444)
add ae11ac0 build(deps): bump actions/setup-node from 4 to 5 (#442)
add 543240a build(deps): bump pytest from 8.4.1 to 8.4.2 in /python (#441)
add b65312d build(deps): fix integration test setup issue with pyarrow
and rust versions (#467)
add 329d993 build(deps): bump astral-sh/setup-uv from 6 to 7 (#465)
add 1ae9108 build(deps): bump coverage from 7.8 to 7.10.7 in /python
(#456)
add 038eca8 build(deps): bump mypy from 1.17.1 to 1.18.2 in /python (#454)
add 6ca1520 build(deps): bump actions/setup-node from 5 to 6 (#469)
add 4bfdee8 build(deps): bump ruff from 0.12 to 0.14.1 in /python (#472)
add f27feb8 refactor: define avro model for parsing commit metadata (#477)
add 99d5dbb ci: reduce CI run time (#478)
add 1f6b54e build: use build wrapper to handle macos 26 SDK loading (#479)
add aaade0f feat: add table v8+ timeline support for loading old and new
table versions (#395)
add 5cb55e3 build(deps): bump apache/skywalking-eyes from 0.7.0 to 0.8.0
(#468)
add 76e2877 build(deps): bump actions/checkout from 5 to 6 (#485)
add c648a34 feat: add hfile reader (#490)
add 2c865a4 feat: support reading log files from `files` partition in
metadata table (#492)
add 8c7ef67 feat: add API to read file slice from base file and list of
log files (#446)
add a62d9ef build(deps): bump actions/download-artifact from 5 to 7 (#496)
add 2f15ef0 build(deps): bump actions/upload-artifact from 4 to 6 (#495)
add 23a3b4a feat: support reading metadata table (files) (#499)
add 8f41bf0 chore: support generating local coverage report (#491)
add 24dc861 feat: implement table v8 file slicing for read path (#501)
add 3e3a2cf refactor: add targeted MDT lookup APIs for partition pruning
(#502)
add c250a00 build(deps): bump actions/cache from 4 to 5 (#494)
add cafc039 build(deps): update apache-avro requirement from ~0.17.0 to
~0.20.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (989e8a5)
\
N -- N -- N
refs/heads/dependabot/cargo/apache-avro-approx-0.20.0 (cafc039)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.cargo/config.toml | 6 +
.github/workflows/ci.yml | 82 +-
.github/workflows/code.yml | 8 +-
.github/workflows/pr.yml | 4 +-
.github/workflows/release.yml | 16 +-
.gitignore | 1 +
Cargo.toml | 12 +-
Makefile | 88 +-
build-wrapper.sh | 45 +
crates/core/Cargo.toml | 14 +
crates/core/src/config/internal.rs | 21 +-
crates/core/src/config/mod.rs | 11 -
crates/core/src/config/read.rs | 44 +-
crates/core/src/config/table.rs | 86 +-
crates/core/src/error.rs | 6 +
crates/core/src/file_group/base_file.rs | 26 +
crates/core/src/file_group/builder.rs | 1053 +++++++-
crates/core/src/file_group/file_slice.rs | 11 +
crates/core/src/file_group/log_file/content.rs | 86 +-
crates/core/src/file_group/log_file/log_block.rs | 581 ++++-
crates/core/src/file_group/log_file/log_format.rs | 68 +-
crates/core/src/file_group/log_file/mod.rs | 242 +-
crates/core/src/file_group/log_file/reader.rs | 68 +-
crates/core/src/file_group/log_file/scanner.rs | 549 ++++-
crates/core/src/file_group/mod.rs | 479 +++-
crates/core/src/file_group/reader.rs | 490 +++-
crates/core/src/file_group/record_batches.rs | 4 +-
crates/core/src/hfile/block.rs | 432 ++++
crates/core/src/hfile/block_type.rs | 227 ++
crates/core/src/hfile/compression.rs | 97 +
crates/core/src/hfile/error.rs | 63 +
crates/core/src/hfile/key.rs | 468 ++++
crates/core/src/hfile/mod.rs | 56 +
crates/core/src/hfile/proto.rs | 89 +
crates/core/src/hfile/reader.rs | 2537 ++++++++++++++++++++
crates/core/src/hfile/record.rs | 165 ++
crates/core/src/hfile/trailer.rs | 156 ++
crates/core/src/lib.rs | 7 +-
crates/core/src/merge/ordering.rs | 4 +-
crates/core/src/merge/record_merger.rs | 17 +-
crates/core/src/metadata/commit.rs | 657 +++++
crates/core/src/metadata/merger.rs | 634 +++++
crates/core/src/metadata/mod.rs | 8 +
crates/core/src/metadata/replace_commit.rs | 130 +
crates/core/src/metadata/table/mod.rs | 441 ++++
crates/core/src/metadata/table/records.rs | 964 ++++++++
crates/core/src/schema/resolver.rs | 164 +-
crates/core/src/storage/mod.rs | 21 +
crates/core/src/table/builder.rs | 96 +-
crates/core/src/table/fs_view.rs | 179 +-
crates/core/src/table/listing.rs | 64 +-
crates/core/src/table/mod.rs | 546 +----
crates/core/src/table/partition.rs | 15 +-
crates/core/src/table/validation.rs | 194 +-
crates/core/src/timeline/builder.rs | 344 +++
crates/core/src/timeline/completion_time.rs | 57 +
crates/core/src/timeline/instant.rs | 260 +-
crates/core/src/timeline/loader.rs | 466 ++++
crates/core/src/timeline/lsm_tree.rs | 109 +
crates/core/src/timeline/mod.rs | 397 ++-
crates/core/src/timeline/selector.rs | 174 +-
crates/core/src/timeline/util.rs | 8 +
crates/core/src/timeline/view.rs | 312 +++
crates/core/src/util/mod.rs | 1 +
.../src/{storage/file_metadata.rs => util/path.rs} | 42 +-
.../core/tests/data/commit_metadata/v6_commit.json | 38 +
.../tests/data/commit_metadata/v8_deltacommit.avro | Bin 0 -> 4483 bytes
...hbase_2_4_13_16KB_GZ_20000_fake_first_key.hfile | Bin 0 -> 115796 bytes
...2_4_13_1KB_GZ_10000_large_keys_deep_index.hfile | Bin 0 -> 246061 bytes
..._1_0_hbase_2_4_13_1KB_GZ_20000_large_keys.hfile | Bin 0 -> 458683 bytes
.../hfile/hudi_1_0_hbase_2_4_9_16KB_GZ_20000.hfile | Bin 0 -> 105235 bytes
...1_0_hbase_2_4_9_16KB_GZ_200_20_non_unique.hfile | Bin 0 -> 19476 bytes
.../hudi_1_0_hbase_2_4_9_16KB_NONE_5000.hfile | Bin 0 -> 301098 bytes
.../hudi_1_0_hbase_2_4_9_512KB_GZ_20000.hfile | Bin 0 -> 101870 bytes
.../hudi_1_0_hbase_2_4_9_64KB_NONE_5000.hfile | Bin 0 -> 300065 bytes
.../data/hfile/hudi_1_0_hbase_2_4_9_no_entry.hfile | Bin 0 -> 5087 bytes
.../.hoodie/hoodie.properties | 10 +-
.../.hoodie/hoodie.properties | 10 +-
.../.gitkeep => timeline/commits_stub/test.crc} | 0
crates/core/tests/table_read_tests.rs | 552 +++++
crates/datafusion/src/lib.rs | 66 +-
.../mor/avro/v8_trips_8i1u.sql | 50 -
.../mor/avro/v8_trips_8i1u.zip | Bin 29954 -> 0 bytes
.../mor/avro/v8_trips_8i3d.zip | Bin 29933 -> 0 bytes
.../{v8_trips_8i3d.sql => v8_trips_8i3u1d.sql} | 19 +-
.../mor/avro/v8_trips_8i3u1d.zip | Bin 0 -> 468520 bytes
crates/test/src/lib.rs | 12 +-
demo/ci_run.sh | 12 +-
demo/compose.yaml | 4 +
demo/infra/runner/Dockerfile | 9 +-
python/hudi/_internal.pyi | 15 +
python/pyproject.toml | 16 +-
python/src/internal.rs | 14 +
python/tests/test_file_group_read.py | 37 +-
rust-toolchain.toml | 2 +-
95 files changed, 14287 insertions(+), 1281 deletions(-)
create mode 100755 build-wrapper.sh
create mode 100644 crates/core/src/hfile/block.rs
create mode 100644 crates/core/src/hfile/block_type.rs
create mode 100644 crates/core/src/hfile/compression.rs
create mode 100644 crates/core/src/hfile/error.rs
create mode 100644 crates/core/src/hfile/key.rs
create mode 100644 crates/core/src/hfile/mod.rs
create mode 100644 crates/core/src/hfile/proto.rs
create mode 100644 crates/core/src/hfile/reader.rs
create mode 100644 crates/core/src/hfile/record.rs
create mode 100644 crates/core/src/hfile/trailer.rs
create mode 100644 crates/core/src/metadata/commit.rs
create mode 100644 crates/core/src/metadata/merger.rs
create mode 100644 crates/core/src/metadata/replace_commit.rs
create mode 100644 crates/core/src/metadata/table/mod.rs
create mode 100644 crates/core/src/metadata/table/records.rs
create mode 100644 crates/core/src/timeline/builder.rs
create mode 100644 crates/core/src/timeline/completion_time.rs
create mode 100644 crates/core/src/timeline/loader.rs
create mode 100644 crates/core/src/timeline/lsm_tree.rs
create mode 100644 crates/core/src/timeline/view.rs
copy crates/core/src/{storage/file_metadata.rs => util/path.rs} (51%)
create mode 100644 crates/core/tests/data/commit_metadata/v6_commit.json
create mode 100644 crates/core/tests/data/commit_metadata/v8_deltacommit.avro
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_13_16KB_GZ_20000_fake_first_key.hfile
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_13_1KB_GZ_10000_large_keys_deep_index.hfile
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_13_1KB_GZ_20000_large_keys.hfile
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_9_16KB_GZ_20000.hfile
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_9_16KB_GZ_200_20_non_unique.hfile
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_9_16KB_NONE_5000.hfile
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_9_512KB_GZ_20000.hfile
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_9_64KB_NONE_5000.hfile
create mode 100644
crates/core/tests/data/hfile/hudi_1_0_hbase_2_4_9_no_entry.hfile
copy demo/.gitignore =>
crates/core/tests/data/timeline/commits_load_schema_from_base_file_cow/.hoodie/hoodie.properties
(83%)
copy demo/.gitignore =>
crates/core/tests/data/timeline/commits_load_schema_from_base_file_mor/.hoodie/hoodie.properties
(83%)
copy crates/core/tests/data/{leaf_dir/.gitkeep =>
timeline/commits_stub/test.crc} (100%)
create mode 100644 crates/core/tests/table_read_tests.rs
delete mode 100644
crates/test/data/quickstart_trips_table/mor/avro/v8_trips_8i1u.sql
delete mode 100644
crates/test/data/quickstart_trips_table/mor/avro/v8_trips_8i1u.zip
delete mode 100644
crates/test/data/quickstart_trips_table/mor/avro/v8_trips_8i3d.zip
rename crates/test/data/quickstart_trips_table/mor/avro/{v8_trips_8i3d.sql =>
v8_trips_8i3u1d.sql} (79%)
create mode 100644
crates/test/data/quickstart_trips_table/mor/avro/v8_trips_8i3u1d.zip
