XiaoHongbo-Hope opened a new pull request, #11218:
URL: https://github.com/apache/paimon/pull/11218

   ### Purpose
   
   Align release-2.1's native write APIs and Native CI with the published 
`pypaimon-rust==0.5.0` wheel.
   
   The VARIANT regression test currently falls back to the Python writer 
because release-2.1 calls `_with_commit_user`, while the wheel exposes 
`with_commit_user`. Native MERGE also passes dictionary clauses, whereas 0.5.0 
requires typed clauses.
   
   - Use the public commit-user setter for batch writes, postpone fixed-bucket 
writes, overwrite commits, updates and merges.
   - Encode MERGE assignments and branches with `MergeAssignment`, 
`WhenMatched` and `WhenNotMatched`.
   - Raise the SQL extra's Rust minimum to 0.5.0 and install/assert exactly 
0.5.0 in Native CI instead of building the old pinned revision.
   
   This targets the published API directly, without a legacy setter adapter or 
the broader Python executor refactoring from master. Existing regression tests 
and strict read-schema validation remain enabled.
   
   ### Known blocker — draft, not ready to merge
   
   An exploratory native test run with the 0.5.0 wheel found eight failures in 
`test_not_null_collection_children_ignore_masked_and_unreferenced_values`. 
Native reading returns `list<element: large_binary>`, but the declared schema 
requires `list<item: large_binary not null>`. The strict read-schema check 
rejects this difference. This must be investigated before switching 
release-2.1's Native CI dependency.
   
   The broad run was intentionally interrupted after 354 passes and these eight 
failures; the rest of the native suite is not yet verified. No failing tests 
were removed or skipped.
   
   ### Tests
   
   Local Python 3.11 with the published `pypaimon-rust==0.5.0` wheel:
   - Reproduced the original VARIANT failure before changing the setter.
   - VARIANT, native write, postpone write, update, commit and MERGE regression 
suites are being checked together with the final changes.
   - Flake8 on changed Python files and `git diff --check` passed.
   
   Hosted CI remains pending. This PR is a draft to make the 0.5.0 alignment 
and remaining incompatibility reviewable.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to