github-actions[bot] commented on PR #123: URL: https://github.com/apache/paimon-vector-index/pull/123#issuecomment-6906385322
<!-- paimon-pr-benchmark --> [Benchmark run](https://github.com/apache/paimon-vector-index/actions/runs/43797291119) ยท success ยท attempt 1 ## Vector index benchmark **๐ข No alerts (5/5 indexes)** | Index | Recall@10 (ฮ) | Single QPS ฮ | Batch QPS ฮ | Status | |---|---:|---:|---:|---| | IVF_FLAT | 100.00% (+0.00 pp) | +1.0% | +1.0% | ๐ข OK | | IVF_SQ | 99.26% (+0.00 pp) | +1.0% | +1.0% | ๐ข OK | | IVF_PQ | 46.60% (+0.00 pp) | -0.5% | +0.8% | ๐ข OK | | IVF_RQ | 90.91% (+0.00 pp) | +1.7% | +6.3% | ๐ข OK | | DISKANN | 77.18% (+0.00 pp) | -1.1% | -1.7% | ๐ข OK | ๐ก QPS โ >10% or Recall โ >1pp ยท ๐ด QPS โ >20% or Recall โ >3pp. Advisory only; QPS is measured after warmup. <details><summary>Absolute metrics & environment</summary> Medians, base โ PR. QPS is timed after warmup; P95 uses the first warm sweep. | Index | Single QPS | Batch QPS | P95 (ยตs) | Build (ms) | Process RSS (MiB) | Size (MiB) | |---|---:|---:|---:|---:|---:|---:| | IVF_FLAT | 77,941.50 โ 78,689.80 | 89,287.92 โ 90,190.18 | 15.84 โ 16.05 | 25.00 โ 25.00 | 19.83 โ 19.83 | 2.47 โ 2.47 | | IVF_SQ | 62,291.24 โ 62,891.55 | 116,480.91 โ 117,594.61 | 18.10 โ 17.96 | 18.00 โ 18.00 | 19.83 โ 19.83 | 0.67 โ 0.67 | | IVF_PQ | 16,301.41 โ 16,227.28 | 133,571.29 โ 134,632.05 | 75.99 โ 76.23 | 190.00 โ 191.00 | 19.83 โ 19.83 | 0.17 โ 0.17 | | IVF_RQ | 11,110.03 โ 11,294.31 | 45,654.93 โ 48,548.95 | 112.30 โ 108.39 | 33.00 โ 33.00 | 19.83 โ 19.83 | 0.52 โ 0.52 | | DISKANN | 10,147.59 โ 10,039.75 | 19,991.65 โ 19,653.76 | 120.59 โ 120.01 | 1,110.00 โ 1,102.00 | 19.87 โ 19.92 | 3.22 โ 3.22 | Base `f6a5558c495fb797aaece78eb177019fd46e215c` ยท PR merge `410252eb5fdbc479c067836526133ff70f3098c0` rustc 1.100.0 (0ef1bc386 2026-11-09) ยท Linux-7.0.0-1017-azure-x86_64-with-glibc2.39 ยท AMD EPYC 7763 64-Core Processor 6 samples/version/index, alternating execution order; 2 threads; 10k ร 64D vectors; 2,048 queries; โฅ1s per timed mode. RSS is the process lifetime peak up to build completion, including dataset/ground truth. Raw CSVs, sample ranges, workload settings and logs are in the workflow artifact. </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
