JingsongLi opened a new pull request, #1491:
URL: https://github.com/apache/paimon-rust/pull/1491

   ### Purpose
   
   Part of #1490. Align Rust Data Evolution vector indexes with the centroid 
layout introduced by apache/paimon#11249.
   
   ### Brief change log
   
   - Read and write Java-compatible `PAIMCENT` descriptors and `PVROUT01` 
routing models. Build local indexes over sparse row labels relative to their 
source range and atomically replace the selected partitions' index files.
   - Route single and batch queries with `centroid.nprobe`, automatic widening, 
and shard-local IVF or DiskANN options. Check manifest generation completeness 
at commit and query time.
   - Keep centroid refresh explicit. The Rust builder spills batches to local 
scratch files and trains each local index independently. Outer and inner probe 
widths use independent policies.
   
   ### Tests
   
   - A Java JNI fixture verifies model and native shard reads with rebased 
labels.
   - A Rust end-to-end test covers range-to-centroid replacement, serialized 
build plans, routed batch queries, and rebuilding the same partitions.
   
   ### API and Format
   
   Adds centroid build and search options and a build-plan accessor for the 
index removals that accompany a replacement. Existing range indexes retain 
their format.
   
   ### Documentation
   
   Documents explicit centroid builds, replacement, and probe options. Draft 
for review of the routing and manifest assumptions.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to