github-actions[bot] commented on PR #127:
URL: 
https://github.com/apache/paimon-vector-index/pull/127#issuecomment-6908332261

   <!-- paimon-pr-benchmark -->
   [Benchmark 
run](https://github.com/apache/paimon-vector-index/actions/runs/43810767330) ยท 
success ยท attempt 1
   
   ## Vector index benchmark
   
   **๐ŸŸข No alerts (5/5 indexes)**
   
   | Index | Recall@10 (ฮ”) | Single QPS ฮ” | Batch QPS ฮ” | Status |
   |---|---:|---:|---:|---|
   | IVF_FLAT | 100.00% (+0.00 pp) | -0.4% | -0.4% | ๐ŸŸข OK |
   | IVF_SQ | 99.26% (+0.00 pp) | -0.8% | -1.2% | ๐ŸŸข OK |
   | IVF_PQ | 46.60% (+0.00 pp) | +0.6% | -2.0% | ๐ŸŸข OK |
   | IVF_RQ | 90.91% (+0.00 pp) | -3.7% | +0.1% | ๐ŸŸข OK |
   | DISKANN | 77.18% (+0.00 pp) | -0.4% | -0.7% | ๐ŸŸข OK |
   
   ๐ŸŸก QPS โ†“ >10% or Recall โ†“ >1pp ยท ๐Ÿ”ด QPS โ†“ >20% or Recall โ†“ >3pp. Advisory 
only; QPS is measured after warmup.
   
   <details><summary>Absolute metrics & environment</summary>
   
   Medians, base โ†’ PR. QPS is timed after warmup; P95 uses the first warm sweep.
   
   | Index | Single QPS | Batch QPS | P95 (ยตs) | Build (ms) | Process RSS (MiB) 
| Size (MiB) |
   |---|---:|---:|---:|---:|---:|---:|
   | IVF_FLAT | 72,746.04 โ†’ 72,487.46 | 85,437.15 โ†’ 85,108.64 | 17.91 โ†’ 17.75 | 
27.50 โ†’ 31.00 | 19.85 โ†’ 19.85 | 2.47 โ†’ 2.47 |
   | IVF_SQ | 61,490.78 โ†’ 61,008.65 | 116,987.16 โ†’ 115,597.27 | 18.68 โ†’ 19.67 | 
18.50 โ†’ 18.00 | 19.85 โ†’ 19.85 | 0.67 โ†’ 0.67 |
   | IVF_PQ | 12,649.37 โ†’ 12,726.80 | 141,987.93 โ†’ 139,089.79 | 95.63 โ†’ 93.43 | 
258.00 โ†’ 261.00 | 19.85 โ†’ 19.85 | 0.17 โ†’ 0.17 |
   | IVF_RQ | 12,041.06 โ†’ 11,593.75 | 52,125.99 โ†’ 52,159.50 | 98.37 โ†’ 103.59 | 
33.00 โ†’ 33.00 | 19.85 โ†’ 19.85 | 0.52 โ†’ 0.52 |
   | DISKANN | 10,130.53 โ†’ 10,087.44 | 19,798.53 โ†’ 19,662.19 | 119.05 โ†’ 120.36 
| 1,295.00 โ†’ 1,295.00 | 19.93 โ†’ 19.93 | 3.22 โ†’ 3.22 |
   
   Base `b8736bbb95b315a3fca2cdbaf8cb59584bfc342b` ยท PR merge 
`9c2d6dcf9789ac2f56c57a7dd3366e6008186dcc`
   rustc 1.100.0 (0ef1bc386 2026-11-09) ยท 
Linux-7.0.0-1017-azure-x86_64-with-glibc2.39 ยท INTEL(R) XEON(R) PLATINUM 8573C
   6 samples/version/index, alternating execution order; 2 threads; 10k ร— 64D 
vectors; 2,048 queries; โ‰ฅ1s per timed mode.
   RSS is the process lifetime peak up to build completion, including 
dataset/ground truth.
   Raw CSVs, sample ranges, workload settings and logs are in the workflow 
artifact.
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to