This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/github_actions/astral-sh/setup-uv-8.1.0
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
discard 9052465d build(deps): bump astral-sh/setup-uv from 7.3.1 to 8.1.0
add 57ef2e95 fix: order partition schema by config and error on missing
fields (#581)
add fdfc7789 perf: improve datafusion integration (#548)
add 2a64624a refactor: consolidate file metadata population for snapshot
and incremental queries (#586)
add b735bf9d docs: update release guide (#287)
add 41f313c8 build(deps-dev): bump pytest from 8.4.2 to 9.0.3 in /python
(#577)
add 29d850f5 build(deps-dev): bump mypy from 1.19.1 to 1.20.2 in /python
(#584)
add d80ee0b7 build(deps-dev): bump ruff from 0.14.13 to 0.15.12 in /python
(#585)
add cf81439e feat: export `HudiTableConfig` and `HudiReadConfig` as python
enums (#433)
add 40f4cd62 docs: add AGENTS.md as canonical AI coding agent guide (#591)
add de2982ae feat: unify Hudi read APIs around ReadOptions and add Python
bindings (#587)
add dcef1484 docs: deduplicate AI agent guidance with sub-directory
AGENTS.md (#594)
add d5925e4b feat(core): enrich FileSlice with stats and streamline config
flow (#592)
add 05a2ae6e build: upgrade rust dev toolchain to 1.94 (#595)
add f62c998a feat(core): add general config alias support with ordering
fields as primary config (#598)
add a5c918d7 refactor(core): move parquet io into base file reader (#599)
add 150570a2 feat(core): add lance base file format support (#596)
add a7f47f49 build(deps): bump astral-sh/setup-uv from 7.3.1 to 8.1.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9052465d)
\
N -- N -- N
refs/heads/dependabot/github_actions/astral-sh/setup-uv-8.1.0 (a7f47f49)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/copilot-instructions.md | 70 +-
.github/instructions/python.instructions.md | 95 +-
.github/instructions/rust.instructions.md | 59 +-
.github/workflows/ci.yml | 18 +-
.github/workflows/code.yml | 7 +-
.github/workflows/release.yml | 19 +-
.gitignore | 1 +
.licenserc.yaml | 2 +
AGENTS.md | 90 ++
CLAUDE.md | 1 +
Cargo.toml | 5 +-
Makefile | 13 +-
README.md | 219 ++-
benchmark/tpch/README.md | 92 +-
benchmark/tpch/config/sf1.yaml | 15 +-
benchmark/tpch/config/sf10.yaml | 15 +-
benchmark/tpch/config/sf100.yaml | 17 +-
benchmark/tpch/config/sf1000.yaml | 44 -
benchmark/tpch/infra/Dockerfile | 56 -
benchmark/tpch/infra/gcp/bootstrap.sh | 64 +
benchmark/tpch/infra/gcp/sync.sh | 49 +
benchmark/tpch/infra/spark/bench.py | 40 +-
benchmark/tpch/infra/spark/spark-defaults.conf | 6 +
benchmark/tpch/run.sh | 252 ++--
benchmark/tpch/src/config.rs | 18 +-
benchmark/tpch/src/main.rs | 70 +-
cpp/AGENTS.md | 5 +
cpp/CLAUDE.md | 1 +
cpp/src/lib.rs | 33 +-
crates/AGENTS.md | 65 +
crates/CLAUDE.md | 1 +
crates/core/Cargo.toml | 11 +
crates/core/src/config/mod.rs | 115 +-
crates/core/src/config/plan.rs | 139 ++
crates/core/src/config/read.rs | 250 +++-
crates/core/src/config/read_options.rs | 466 ++++++
crates/core/src/config/table.rs | 269 +++-
crates/core/src/expr/filter.rs | 601 +++++---
crates/core/src/file_group/base_file/lance.rs | 756 ++++++++++
.../file_group/{base_file.rs => base_file/mod.rs} | 7 +-
crates/core/src/file_group/base_file/parquet.rs | 283 ++++
crates/core/src/file_group/base_file/reader.rs | 206 +++
crates/core/src/file_group/builder.rs | 556 +++++--
crates/core/src/file_group/file_slice.rs | 133 +-
crates/core/src/file_group/log_file/reader.rs | 2 +-
crates/core/src/file_group/log_file/scanner.rs | 8 +-
crates/core/src/file_group/reader.rs | 1244 +++++++++-------
crates/core/src/file_group/record_batches.rs | 18 +-
crates/core/src/hfile/reader.rs | 74 +-
crates/core/src/keygen/mod.rs | 14 +-
crates/core/src/keygen/timestamp_based.rs | 32 +-
crates/core/src/merge/ordering.rs | 8 +-
crates/core/src/merge/record_merger.rs | 18 +-
crates/core/src/metadata/commit.rs | 137 ++
crates/core/src/metadata/merger.rs | 30 +-
crates/core/src/metadata/table/mod.rs | 19 +-
crates/core/src/metadata/table/records.rs | 18 +-
crates/core/src/schema/resolver.rs | 83 +-
crates/core/src/statistics/estimator.rs | 194 +++
crates/core/src/statistics/mod.rs | 2 +
crates/core/src/storage/error.rs | 6 +
crates/core/src/storage/file_metadata.rs | 14 +-
crates/core/src/storage/mod.rs | 249 +---
crates/core/src/table/builder.rs | 18 +-
crates/core/src/table/file_pruner.rs | 2 +-
crates/core/src/table/fs_view.rs | 635 +++++++-
crates/core/src/table/listing.rs | 94 +-
crates/core/src/table/mod.rs | 1543 +++++++++++++-------
crates/core/src/table/partition.rs | 116 +-
crates/core/src/table/read_options.rs | 215 ---
crates/core/src/table/validation.rs | 4 +-
crates/core/src/timeline/builder.rs | 2 +-
crates/core/src/timeline/mod.rs | 37 +-
crates/core/src/timeline/selector.rs | 44 +-
crates/core/src/timeline/util.rs | 6 +-
crates/core/src/util/arrow.rs | 60 +
crates/core/tests/table_read_tests.rs | 1185 +++++++++++++--
crates/datafusion/src/lib.rs | 158 +-
crates/datafusion/src/util/expr.rs | 28 +-
crates/datafusion/tests/plan_tests.rs | 18 +
.../quickstart_trips_table/cow/v9_trips_lance.sql | 79 +
.../quickstart_trips_table/cow/v9_trips_lance.zip | Bin 0 -> 162006 bytes
.../mor/avro/v9_trips_lance.sql | 95 ++
.../mor/avro/v9_trips_lance.zip | Bin 0 -> 241819 bytes
.../sample_table/cow/v9_lance_nonpartitioned.sql | 72 +
.../sample_table/cow/v9_lance_nonpartitioned.zip | Bin 0 -> 142525 bytes
...onpart_nometa.sql => v9_lance_txns_nonpart.sql} | 59 +-
.../sample_table/cow/v9_lance_txns_nonpart.zip | Bin 0 -> 289546 bytes
...nonpart_nometa.sql => v9_lance_txns_simple.sql} | 106 +-
.../data/sample_table/cow/v9_lance_txns_simple.zip | Bin 0 -> 295789 bytes
.../mor/avro/v9_lance_nonhivestyle.sql | 85 ++
.../mor/avro/v9_lance_nonhivestyle.zip | Bin 0 -> 193254 bytes
crates/test/src/lib.rs | 138 +-
demo/apps/hudi-file-group-api/cpp/main.cpp | 3 +-
demo/apps/hudi-table-api/python/src/main.py | 2 +-
demo/apps/hudi-table-api/rust/src/main.rs | 4 +-
demo/infra/runner/Dockerfile | 4 +-
docs/reader-spec.md | 345 +++++
python/AGENTS.md | 66 +
python/CLAUDE.md | 1 +
python/Cargo.toml | 1 +
python/hudi/__init__.py | 10 +
python/hudi/_config.py | 61 +
python/hudi/_internal.pyi | 290 ++--
python/hudi/table/builder.py | 22 +-
python/pyproject.toml | 10 +-
python/src/internal.rs | 631 ++++++--
python/src/lib.rs | 10 +-
python/tests/test_config_enums.py | 75 +
python/tests/test_file_group_read.py | 8 +-
python/tests/test_streaming_read.py | 167 +++
python/tests/test_table_builder.py | 67 +-
python/tests/test_table_incremental_read.py | 94 +-
python/tests/test_table_misc.py | 162 ++
python/tests/test_table_read.py | 50 +-
release/README.md | 232 +--
rust-toolchain.toml | 2 +-
117 files changed, 11071 insertions(+), 3449 deletions(-)
create mode 100644 AGENTS.md
create mode 120000 CLAUDE.md
delete mode 100644 benchmark/tpch/config/sf1000.yaml
delete mode 100644 benchmark/tpch/infra/Dockerfile
create mode 100755 benchmark/tpch/infra/gcp/bootstrap.sh
create mode 100755 benchmark/tpch/infra/gcp/sync.sh
create mode 100644 cpp/AGENTS.md
create mode 120000 cpp/CLAUDE.md
create mode 100644 crates/AGENTS.md
create mode 120000 crates/CLAUDE.md
create mode 100644 crates/core/src/config/plan.rs
create mode 100644 crates/core/src/config/read_options.rs
create mode 100644 crates/core/src/file_group/base_file/lance.rs
rename crates/core/src/file_group/{base_file.rs => base_file/mod.rs} (97%)
create mode 100644 crates/core/src/file_group/base_file/parquet.rs
create mode 100644 crates/core/src/file_group/base_file/reader.rs
create mode 100644 crates/core/src/statistics/estimator.rs
delete mode 100644 crates/core/src/table/read_options.rs
create mode 100644
crates/test/data/quickstart_trips_table/cow/v9_trips_lance.sql
create mode 100644
crates/test/data/quickstart_trips_table/cow/v9_trips_lance.zip
create mode 100644
crates/test/data/quickstart_trips_table/mor/avro/v9_trips_lance.sql
create mode 100644
crates/test/data/quickstart_trips_table/mor/avro/v9_trips_lance.zip
create mode 100644
crates/test/data/sample_table/cow/v9_lance_nonpartitioned.sql
create mode 100644
crates/test/data/sample_table/cow/v9_lance_nonpartitioned.zip
copy crates/test/data/sample_table/cow/{v9_txns_nonpart_nometa.sql =>
v9_lance_txns_nonpart.sql} (80%)
create mode 100644 crates/test/data/sample_table/cow/v9_lance_txns_nonpart.zip
copy crates/test/data/sample_table/cow/{v9_txns_nonpart_nometa.sql =>
v9_lance_txns_simple.sql} (66%)
create mode 100644 crates/test/data/sample_table/cow/v9_lance_txns_simple.zip
create mode 100644
crates/test/data/sample_table/mor/avro/v9_lance_nonhivestyle.sql
create mode 100644
crates/test/data/sample_table/mor/avro/v9_lance_nonhivestyle.zip
create mode 100644 docs/reader-spec.md
create mode 100644 python/AGENTS.md
create mode 120000 python/CLAUDE.md
create mode 100644 python/hudi/_config.py
create mode 100644 python/tests/test_config_enums.py
create mode 100644 python/tests/test_streaming_read.py
create mode 100644 python/tests/test_table_misc.py
