XiaoHongbo-Hope opened a new pull request, #11218: URL: https://github.com/apache/paimon/pull/11218
### Purpose Align release-2.1's native write APIs and Native CI with the published `pypaimon-rust==0.5.0` wheel. The VARIANT regression test currently falls back to the Python writer because release-2.1 calls `_with_commit_user`, while the wheel exposes `with_commit_user`. Native MERGE also passes dictionary clauses, whereas 0.5.0 requires typed clauses. - Use the public commit-user setter for batch writes, postpone fixed-bucket writes, overwrite commits, updates and merges. - Encode MERGE assignments and branches with `MergeAssignment`, `WhenMatched` and `WhenNotMatched`. - Raise the SQL extra's Rust minimum to 0.5.0 and install/assert exactly 0.5.0 in Native CI instead of building the old pinned revision. This targets the published API directly, without a legacy setter adapter or the broader Python executor refactoring from master. Existing regression tests and strict read-schema validation remain enabled. ### Known blocker — draft, not ready to merge An exploratory native test run with the 0.5.0 wheel found eight failures in `test_not_null_collection_children_ignore_masked_and_unreferenced_values`. Native reading returns `list<element: large_binary>`, but the declared schema requires `list<item: large_binary not null>`. The strict read-schema check rejects this difference. This must be investigated before switching release-2.1's Native CI dependency. The broad run was intentionally interrupted after 354 passes and these eight failures; the rest of the native suite is not yet verified. No failing tests were removed or skipped. ### Tests Local Python 3.11 with the published `pypaimon-rust==0.5.0` wheel: - Reproduced the original VARIANT failure before changing the setter. - VARIANT, native write, postpone write, update, commit and MERGE regression suites are being checked together with the final changes. - Flake8 on changed Python files and `git diff --check` passed. Hosted CI remains pending. This PR is a draft to make the 0.5.0 alignment and remaining incompatibility reviewable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
