JingsongLi opened a new pull request, #3: URL: https://github.com/apache/paimon-vector-index/pull/3
## Summary - **opq**: Optimized Product Quantization — learns a rotation matrix (SVD) to minimize quantization error before PQ encoding - **shuffler**: Disk-based partition shuffler for large-scale IVF index building — write vectors with partition IDs, read back grouped by partition - **fastscan**: Block-layout 4-bit PQ fast scan with SIMD (AVX2/NEON) — quantizes distance tables to u8 and accumulates via shuffle instructions ~975 lines of new code, all clippy-clean and tested (21 tests pass). ## Test plan - [x] `cargo fmt --all -- --check` passes - [x] `cargo clippy --all-targets --workspace -- -D warnings` passes - [x] `cargo test --all` passes (21 tests) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
