JingsongLi opened a new pull request, #1495: URL: https://github.com/apache/paimon-rust/pull/1495
### Purpose A schema-only change can leave the latest data snapshot on the previous schema. Scalar index keys use the schema of the build, which can differ from that snapshot. This aligns Rust with [the Java change](https://github.com/apache/paimon/pull/11348). ### Changes - Write the source snapshot and actual build schema ID in `_SOURCE_META` v2. Decode v1 with an unknown schema ID. Scalar files without a recorded build schema use field presence checks. - Compare all fields of each scalar index, including composite keys, with the read schema. Cache the result by source schema ID and field ID. Scalar predicates and search prefilters skip incompatible files. - Rebuild incompatible scalar coverage through manual builds and automatic maintenance. Publish replacement files and remove old coverage in the same index commit. - Align schema-triggered rebuilding with Java's scalar scope. Remove the Rust-specific full-text rebuild and test for VARCHAR narrowing. ### Verification - `cargo test --locked --offline -p paimon --lib --features vortex` (5,061 passed, 7 ignored) - `cargo fmt --all -- --check` - Checked the Java wire format, legacy source metadata, scalar query fallback, and rebuild after a schema-only change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
