shubhamvishu commented on PR #12868:
URL: https://github.com/apache/lucene/pull/12868#issuecomment-1838079506
I also ran the benchmarks for **`wikibigall`**. Here also we see similarly
consistent **7%** improvement for `PKLookup` with `0.000` p-value. Below are
the benchmark results :
```
TaskQPS baseline StdDevQPS my_modified_version
StdDev Pct diff p-value
BrowseMonthSSDVFacets 23.50 (9.9%) 22.82 (10.6%)
-2.9% ( -21% - 19%) 0.374
LowSloppyPhrase 7.89 (6.1%) 7.84 (7.2%)
-0.7% ( -13% - 13%) 0.737
TermDTSort 169.47 (5.8%) 168.46 (5.6%)
-0.6% ( -11% - 11%) 0.740
HighTermTitleBDVSort 10.66 (6.2%) 10.60 (6.2%)
-0.6% ( -12% - 12%) 0.770
BrowseDayOfYearSSDVFacets 20.09 (14.5%) 19.98 (17.1%)
-0.6% ( -28% - 36%) 0.910
OrHighMed 184.16 (3.2%) 183.28 (3.7%)
-0.5% ( -7% - 6%) 0.660
OrHighHigh 51.72 (5.6%) 51.48 (5.8%)
-0.5% ( -11% - 11%) 0.796
BrowseRandomLabelTaxoFacets 11.19 (5.1%) 11.14 (4.5%)
-0.4% ( -9% - 9%) 0.772
MedSloppyPhrase 17.91 (3.5%) 17.84 (4.2%)
-0.4% ( -7% - 7%) 0.752
LowPhrase 13.42 (5.3%) 13.37 (6.3%)
-0.4% ( -11% - 11%) 0.848
AndHighLow 529.38 (2.2%) 527.55 (2.9%)
-0.3% ( -5% - 4%) 0.674
BrowseDateSSDVFacets 4.47 (11.1%) 4.46 (10.4%)
-0.3% ( -19% - 23%) 0.924
BrowseDateTaxoFacets 12.59 (4.0%) 12.55 (3.5%)
-0.3% ( -7% - 7%) 0.810
OrHighMedDayTaxoFacets 10.06 (4.9%) 10.04 (4.7%)
-0.2% ( -9% - 9%) 0.914
HighTermDayOfYearSort 314.20 (1.9%) 313.90 (1.7%)
-0.1% ( -3% - 3%) 0.867
BrowseMonthTaxoFacets 12.34 (3.4%) 12.35 (2.8%)
0.1% ( -5% - 6%) 0.903
AndHighMed 164.82 (4.1%) 165.05 (4.3%)
0.1% ( -7% - 8%) 0.916
HighPhrase 40.51 (4.2%) 40.57 (5.6%)
0.1% ( -9% - 10%) 0.926
Prefix3 793.33 (2.5%) 794.74 (2.8%)
0.2% ( -5% - 5%) 0.833
OrNotHighLow 731.50 (2.6%) 733.25 (2.4%)
0.2% ( -4% - 5%) 0.760
OrHighLow 394.15 (4.5%) 395.24 (4.5%)
0.3% ( -8% - 9%) 0.845
MedTermDayTaxoFacets 27.09 (5.4%) 27.17 (4.6%)
0.3% ( -9% - 10%) 0.857
Respell 37.26 (1.9%) 37.40 (1.9%)
0.4% ( -3% - 4%) 0.540
MedPhrase 68.95 (3.2%) 69.21 (4.5%)
0.4% ( -7% - 8%) 0.764
HighTermTitleSort 103.69 (2.8%) 104.13 (3.2%)
0.4% ( -5% - 6%) 0.659
HighSpanNear 2.72 (5.7%) 2.74 (3.9%)
0.5% ( -8% - 10%) 0.755
HighSloppyPhrase 7.67 (5.8%) 7.71 (6.5%)
0.5% ( -11% - 13%) 0.801
Wildcard 18.57 (2.9%) 18.66 (2.8%)
0.5% ( -5% - 6%) 0.581
Fuzzy1 73.74 (1.2%) 74.11 (1.4%)
0.5% ( -2% - 3%) 0.231
AndHighHighDayTaxoFacets 15.25 (2.1%) 15.32 (2.8%)
0.5% ( -4% - 5%) 0.522
AndHighMedDayTaxoFacets 20.82 (2.1%) 20.93 (2.8%)
0.5% ( -4% - 5%) 0.524
AndHighHigh 22.11 (5.7%) 22.23 (5.4%)
0.5% ( -10% - 12%) 0.759
HighTerm 255.66 (5.9%) 257.09 (4.9%)
0.6% ( -9% - 12%) 0.744
Fuzzy2 62.45 (1.1%) 62.81 (1.4%)
0.6% ( -1% - 3%) 0.149
BrowseRandomLabelSSDVFacets 15.32 (6.9%) 15.42 (10.6%)
0.7% ( -15% - 19%) 0.816
MedTerm 286.47 (6.0%) 288.39 (4.6%)
0.7% ( -9% - 11%) 0.689
IntNRQ 119.53 (3.3%) 120.36 (5.0%)
0.7% ( -7% - 9%) 0.600
LowTerm 461.65 (5.4%) 464.97 (3.9%)
0.7% ( -8% - 10%) 0.631
HighTermMonthSort 2546.87 (3.3%) 2566.25 (2.4%)
0.8% ( -4% - 6%) 0.403
LowIntervalsOrdered 18.69 (3.6%) 18.84 (3.4%)
0.8% ( -5% - 8%) 0.468
BrowseDayOfYearTaxoFacets 13.53 (6.0%) 13.64 (6.3%)
0.8% ( -10% - 13%) 0.669
OrNotHighMed 114.22 (3.0%) 115.51 (2.5%)
1.1% ( -4% - 6%) 0.195
OrHighNotMed 278.93 (4.7%) 282.15 (4.8%)
1.2% ( -7% - 11%) 0.443
OrNotHighHigh 81.05 (5.1%) 82.09 (4.5%)
1.3% ( -7% - 11%) 0.402
OrHighNotHigh 151.36 (5.3%) 153.39 (4.7%)
1.3% ( -8% - 12%) 0.398
MedIntervalsOrdered 17.52 (5.0%) 17.78 (4.4%)
1.4% ( -7% - 11%) 0.333
HighIntervalsOrdered 3.42 (4.7%) 3.48 (4.4%)
1.8% ( -7% - 11%) 0.223
OrHighNotLow 231.81 (5.6%) 236.03 (5.4%)
1.8% ( -8% - 13%) 0.297
MedSpanNear 11.01 (8.1%) 11.23 (5.5%)
2.0% ( -10% - 16%) 0.367
LowSpanNear 4.54 (11.5%) 4.67 (7.3%)
3.0% ( -14% - 24%) 0.326
PKLookup 122.20 (1.3%) 130.59 (2.0%)
6.9% ( 3% - 10%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
