JingsongLi opened a new pull request, #1495:
URL: https://github.com/apache/paimon-rust/pull/1495

   ### Purpose
   
   A schema-only change can leave the latest data snapshot on the previous 
schema. Scalar index keys use the schema of the build, which can differ from 
that snapshot. This aligns Rust with [the Java 
change](https://github.com/apache/paimon/pull/11348).
   
   ### Changes
   
   - Write the source snapshot and actual build schema ID in `_SOURCE_META` v2. 
Decode v1 with an unknown schema ID. Scalar files without a recorded build 
schema use field presence checks.
   - Compare all fields of each scalar index, including composite keys, with 
the read schema. Cache the result by source schema ID and field ID. Scalar 
predicates and search prefilters skip incompatible files.
   - Rebuild incompatible scalar coverage through manual builds and automatic 
maintenance. Publish replacement files and remove old coverage in the same 
index commit.
   - Align schema-triggered rebuilding with Java's scalar scope. Remove the 
Rust-specific full-text rebuild and test for VARCHAR narrowing.
   
   ### Verification
   
   - `cargo test --locked --offline -p paimon --lib --features vortex` (5,061 
passed, 7 ignored)
   - `cargo fmt --all -- --check`
   - Checked the Java wire format, legacy source metadata, scalar query 
fallback, and rebuild after a schema-only change.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to