JingsongLi opened a new pull request, #1491: URL: https://github.com/apache/paimon-rust/pull/1491
### Purpose Part of #1490. Align Rust Data Evolution vector indexes with the centroid layout introduced by apache/paimon#11249. ### Brief change log - Read and write Java-compatible `PAIMCENT` descriptors and `PVROUT01` routing models. Build local indexes over sparse row labels relative to their source range and atomically replace the selected partitions' index files. - Route single and batch queries with `centroid.nprobe`, automatic widening, and shard-local IVF or DiskANN options. Check manifest generation completeness at commit and query time. - Keep centroid refresh explicit. The Rust builder spills batches to local scratch files and trains each local index independently. Outer and inner probe widths use independent policies. ### Tests - A Java JNI fixture verifies model and native shard reads with rebased labels. - A Rust end-to-end test covers range-to-centroid replacement, serialized build plans, routed batch queries, and rebuilding the same partitions. ### API and Format Adds centroid build and search options and a build-plan accessor for the index removals that accompany a replacement. Existing range indexes retain their format. ### Documentation Documents explicit centroid builds, replacement, and probe options. Draft for review of the routing and manifest assumptions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
