JingsongLi opened a new pull request, #56: URL: https://github.com/apache/paimon-vector-index/pull/56
## Summary Adds IVF_RQ/RaBitQ support with a search-time query_bits tuning knob and reserves IVF_RQ v1 format fields for future multi-bit codes. Defaults remain conservative: query_bits=0 keeps the existing float-query path, and writers still emit 1-bit stored codes. ## Changes - Implement IVF_RQ/RaBitQ core indexing, serialization, and reader search paths. - Add query_bits=0|4|8 APIs across Rust, C ABI, C++ wrapper, Java/JNI, and Python. - Reserve IVF_RQ v1 header fields for num_bits, rotation_type, factor_layout, optional ex_codes, and optional error_factor. - Keep current readers strict: future multi-bit or optional-section payloads are rejected until the scanner is implemented. - Extend ANN benchmark knobs, storage golden fixtures, validation tests, and docs. ## Testing - [x] cargo fmt --all - [x] cargo test --workspace -- --nocapture - [x] git diff --check ## Notes Current multi-bit storage is intentionally format-reserved only. Writers still produce num_bits=1 with no optional sections, so this PR does not enable multi-bit RQ by default. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
