zacharymorn commented on PR #1018:
URL: https://github.com/apache/lucene/pull/1018#issuecomment-1182774748
Benchmark results with `wikinightly.tasks` boolean queries below:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseMonthTaxoFacets 28.81 (37.2%) 26.45
(32.0%) -8.2% ( -56% - 97%) 0.454
OrHighMedDayTaxoFacets 17.65 (4.5%) 16.78
(5.3%) -5.0% ( -14% - 5%) 0.001
BrowseRandomLabelTaxoFacets 27.58 (50.2%) 26.72
(45.1%) -3.1% ( -65% - 185%) 0.836
TermBGroup1M1P 37.75 (7.6%) 36.62
(6.5%) -3.0% ( -15% - 11%) 0.179
TermGroup100 36.05 (5.4%) 35.18
(4.5%) -2.4% ( -11% - 8%) 0.130
IntNRQ 90.71 (4.7%) 88.69
(7.2%) -2.2% ( -13% - 10%) 0.248
TermBGroup1M 30.11 (5.3%) 29.64
(5.1%) -1.6% ( -11% - 9%) 0.343
TermDateFacets 48.93 (4.5%) 48.28
(5.0%) -1.3% ( -10% - 8%) 0.377
SloppyPhrase 13.21 (3.3%) 13.05
(3.5%) -1.2% ( -7% - 5%) 0.256
IntervalsOrdered 125.27 (7.0%) 123.79
(7.9%) -1.2% ( -14% - 14%) 0.615
MedTermDayTaxoFacets 78.33 (4.2%) 77.48
(4.5%) -1.1% ( -9% - 8%) 0.429
TermDayOfYearSort 254.99 (3.5%) 252.39
(2.9%) -1.0% ( -7% - 5%) 0.312
AndHighMedDayTaxoFacets 122.91 (2.6%) 121.74
(2.8%) -1.0% ( -6% - 4%) 0.265
SpanNear 6.11 (5.6%) 6.05
(4.4%) -0.9% ( -10% - 9%) 0.583
AndHighMed 144.28 (4.2%) 143.04
(4.9%) -0.9% ( -9% - 8%) 0.556
AndHighHigh 43.39 (2.6%) 43.04
(4.0%) -0.8% ( -7% - 5%) 0.449
Phrase 52.64 (4.4%) 52.26
(4.6%) -0.7% ( -9% - 8%) 0.615
AndHighHighDayTaxoFacets 11.91 (2.9%) 11.83
(3.6%) -0.7% ( -6% - 6%) 0.527
TermDTSort 331.47 (3.4%) 329.38
(3.3%) -0.6% ( -7% - 6%) 0.552
AndHighOrMedMed 90.33 (4.4%) 90.06
(4.8%) -0.3% ( -9% - 9%) 0.841
TermGroup10K 42.46 (4.3%) 42.38
(4.3%) -0.2% ( -8% - 8%) 0.886
BrowseMonthSSDVFacets 29.10 (14.2%) 29.05
(9.5%) -0.2% ( -20% - 27%) 0.965
TermGroup1M 40.35 (4.0%) 40.30
(4.3%) -0.1% ( -8% - 8%) 0.932
AndMedOrHighHigh 86.73 (3.5%) 86.76
(3.9%) 0.0% ( -7% - 7%) 0.978
TermMonthSort 273.18 (7.7%) 273.28
(8.4%) 0.0% ( -14% - 17%) 0.989
Fuzzy2 81.84 (2.8%) 81.91
(2.9%) 0.1% ( -5% - 5%) 0.918
PKLookup 321.81 (5.4%) 322.43
(5.8%) 0.2% ( -10% - 12%) 0.914
TermTitleSort 188.55 (8.0%) 188.92
(8.3%) 0.2% ( -14% - 17%) 0.939
Respell 111.20 (2.5%) 111.46
(3.7%) 0.2% ( -5% - 6%) 0.815
Fuzzy1 78.31 (2.9%) 78.64
(2.9%) 0.4% ( -5% - 6%) 0.648
BrowseRandomLabelSSDVFacets 19.92 (8.2%) 20.03
(6.4%) 0.5% ( -13% - 16%) 0.821
Term 3440.49 (3.9%) 3461.12
(4.8%) 0.6% ( -7% - 9%) 0.664
BrowseDayOfYearSSDVFacets 26.22 (12.5%) 26.47
(4.8%) 0.9% ( -14% - 20%) 0.751
BrowseDateTaxoFacets 27.49 (32.2%) 27.82
(32.6%) 1.2% ( -48% - 97%) 0.905
BrowseDayOfYearTaxoFacets 27.84 (31.8%) 28.20
(32.4%) 1.3% ( -47% - 96%) 0.900
BrowseDateSSDVFacets 3.75 (27.0%) 3.80
(28.3%) 1.3% ( -42% - 77%) 0.879
Wildcard 113.02 (4.3%) 114.66
(5.3%) 1.5% ( -7% - 11%) 0.342
Prefix3 83.80 (7.4%) 85.97
(7.3%) 2.6% ( -11% - 18%) 0.266
OrHighHigh 113.87 (3.9%) 156.08
(8.9%) 37.1% ( 23% - 51%) 0.000
OrHighMed 92.87 (5.1%) 210.48
(13.0%) 126.6% ( 103% - 152%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
TermTitleSort 188.71 (5.6%) 183.28
(3.5%) -2.9% ( -11% - 6%) 0.050
TermMonthSort 149.91 (5.6%) 145.60
(3.3%) -2.9% ( -11% - 6%) 0.046
BrowseRandomLabelTaxoFacets 32.23 (53.0%) 31.53
(44.8%) -2.2% ( -65% - 203%) 0.889
AndMedOrHighHigh 91.67 (4.8%) 89.95
(5.0%) -1.9% ( -11% - 8%) 0.227
BrowseDayOfYearSSDVFacets 26.61 (7.5%) 26.14
(6.2%) -1.8% ( -14% - 12%) 0.407
Prefix3 401.75 (8.2%) 396.17
(9.1%) -1.4% ( -17% - 17%) 0.612
Term 2461.88 (4.3%) 2428.89
(5.9%) -1.3% ( -11% - 9%) 0.411
TermDTSort 336.78 (2.4%) 333.41
(6.1%) -1.0% ( -9% - 7%) 0.495
Wildcard 226.55 (5.0%) 224.30
(5.9%) -1.0% ( -11% - 10%) 0.568
TermDateFacets 40.50 (4.4%) 40.11
(5.5%) -1.0% ( -10% - 9%) 0.544
MedTermDayTaxoFacets 75.15 (4.0%) 74.47
(4.7%) -0.9% ( -9% - 8%) 0.513
AndHighHighDayTaxoFacets 53.04 (1.7%) 52.64
(2.8%) -0.8% ( -5% - 3%) 0.297
Fuzzy1 129.74 (3.1%) 128.76
(3.0%) -0.8% ( -6% - 5%) 0.431
TermBGroup1M 30.05 (3.5%) 29.84
(3.8%) -0.7% ( -7% - 6%) 0.539
Respell 109.95 (3.5%) 109.19
(2.5%) -0.7% ( -6% - 5%) 0.474
TermGroup100 51.02 (4.2%) 50.67
(4.8%) -0.7% ( -9% - 8%) 0.636
AndHighOrMedMed 114.19 (5.7%) 113.43
(5.8%) -0.7% ( -11% - 11%) 0.712
TermGroup1M 40.46 (2.1%) 40.22
(2.6%) -0.6% ( -5% - 4%) 0.431
Fuzzy2 139.53 (2.7%) 138.72
(2.9%) -0.6% ( -6% - 5%) 0.507
AndHighMedDayTaxoFacets 195.10 (3.7%) 194.06
(4.2%) -0.5% ( -8% - 7%) 0.668
Phrase 51.67 (5.2%) 51.42
(6.6%) -0.5% ( -11% - 11%) 0.796
AndHighMed 118.69 (4.6%) 118.24
(4.5%) -0.4% ( -9% - 9%) 0.794
TermDayOfYearSort 178.99 (2.3%) 178.42
(5.4%) -0.3% ( -7% - 7%) 0.808
TermGroup10K 31.90 (2.7%) 31.80
(3.4%) -0.3% ( -6% - 5%) 0.747
BrowseMonthSSDVFacets 29.03 (9.8%) 28.97
(9.3%) -0.2% ( -17% - 20%) 0.947
IntNRQ 106.66 (1.6%) 106.57
(2.0%) -0.1% ( -3% - 3%) 0.883
AndHighHigh 99.10 (3.8%) 99.03
(3.6%) -0.1% ( -7% - 7%) 0.946
OrHighMedDayTaxoFacets 25.38 (5.6%) 25.37
(5.6%) -0.0% ( -10% - 11%) 1.000
TermBGroup1M1P 43.68 (4.7%) 43.68
(5.6%) 0.0% ( -9% - 10%) 0.995
SpanNear 6.04 (4.7%) 6.09
(5.3%) 0.8% ( -8% - 11%) 0.632
SloppyPhrase 13.22 (5.0%) 13.34
(4.4%) 0.9% ( -8% - 10%) 0.549
BrowseRandomLabelSSDVFacets 19.85 (6.9%) 20.05
(7.3%) 1.0% ( -12% - 16%) 0.651
PKLookup 311.58 (6.5%) 315.09
(4.1%) 1.1% ( -8% - 12%) 0.511
IntervalsOrdered 12.87 (3.5%) 13.05
(3.0%) 1.4% ( -4% - 8%) 0.169
BrowseDayOfYearTaxoFacets 30.81 (33.5%) 31.50
(31.9%) 2.2% ( -47% - 101%) 0.828
BrowseMonthTaxoFacets 31.11 (34.6%) 31.83
(34.7%) 2.3% ( -49% - 109%) 0.834
BrowseDateTaxoFacets 30.37 (34.0%) 31.08
(32.2%) 2.3% ( -47% - 103%) 0.823
BrowseDateSSDVFacets 3.59 (26.2%) 3.74
(32.9%) 4.2% ( -43% - 85%) 0.654
OrHighHigh 22.23 (5.0%) 28.36
(5.9%) 27.6% ( 15% - 40%) 0.000
OrHighMed 90.16 (5.0%) 206.19
(10.2%) 128.7% ( 108% - 151%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
Term 3286.93 (4.1%) 3169.95
(4.3%) -3.6% ( -11% - 5%) 0.007
OrHighMedDayTaxoFacets 25.73 (5.6%) 25.06
(5.3%) -2.6% ( -12% - 8%) 0.135
TermDayOfYearSort 207.37 (9.4%) 202.08
(3.9%) -2.6% ( -14% - 11%) 0.264
Wildcard 162.54 (5.7%) 158.47
(7.6%) -2.5% ( -14% - 11%) 0.241
TermTitleSort 151.92 (9.3%) 148.49
(8.6%) -2.3% ( -18% - 17%) 0.427
BrowseRandomLabelSSDVFacets 19.14 (8.3%) 18.73
(8.8%) -2.1% ( -17% - 16%) 0.429
TermMonthSort 222.69 (8.9%) 218.26
(8.6%) -2.0% ( -17% - 16%) 0.471
AndMedOrHighHigh 88.57 (4.1%) 86.92
(3.3%) -1.9% ( -8% - 5%) 0.114
TermDateFacets 48.42 (4.3%) 47.70
(5.2%) -1.5% ( -10% - 8%) 0.317
AndHighMed 153.98 (4.4%) 151.71
(4.7%) -1.5% ( -10% - 7%) 0.304
Prefix3 451.17 (5.0%) 444.73
(8.8%) -1.4% ( -14% - 13%) 0.530
MedTermDayTaxoFacets 75.95 (3.7%) 75.00
(4.6%) -1.2% ( -9% - 7%) 0.344
AndHighOrMedMed 118.33 (4.0%) 116.89
(4.2%) -1.2% ( -9% - 7%) 0.351
AndHighHighDayTaxoFacets 17.00 (3.7%) 16.82
(3.8%) -1.1% ( -8% - 6%) 0.372
TermBGroup1M1P 44.63 (7.0%) 44.21
(7.2%) -0.9% ( -14% - 14%) 0.675
TermGroup100 28.21 (3.7%) 27.95
(3.5%) -0.9% ( -7% - 6%) 0.422
IntervalsOrdered 22.52 (4.3%) 22.32
(3.5%) -0.9% ( -8% - 7%) 0.468
Phrase 37.73 (2.3%) 37.39
(2.6%) -0.9% ( -5% - 4%) 0.252
Respell 113.41 (3.3%) 112.53
(3.7%) -0.8% ( -7% - 6%) 0.486
PKLookup 306.72 (5.0%) 304.50
(4.5%) -0.7% ( -9% - 9%) 0.629
TermBGroup1M 46.71 (4.5%) 46.40
(4.0%) -0.7% ( -8% - 8%) 0.617
AndHighHigh 96.96 (3.0%) 96.41
(2.8%) -0.6% ( -6% - 5%) 0.538
Fuzzy1 129.09 (3.4%) 128.39
(3.4%) -0.5% ( -7% - 6%) 0.620
BrowseMonthTaxoFacets 26.85 (35.1%) 26.73
(34.7%) -0.5% ( -51% - 106%) 0.965
BrowseMonthSSDVFacets 29.39 (15.2%) 29.27
(14.9%) -0.4% ( -26% - 34%) 0.930
TermGroup1M 38.86 (3.8%) 38.74
(3.6%) -0.3% ( -7% - 7%) 0.783
TermGroup10K 23.10 (3.5%) 23.09
(3.7%) -0.0% ( -6% - 7%) 0.987
Fuzzy2 117.98 (3.7%) 117.96
(4.1%) -0.0% ( -7% - 8%) 0.992
AndHighMedDayTaxoFacets 38.61 (3.1%) 38.63
(2.8%) 0.1% ( -5% - 6%) 0.943
BrowseDayOfYearSSDVFacets 26.80 (11.7%) 26.82
(12.1%) 0.1% ( -21% - 27%) 0.985
SloppyPhrase 3.06 (4.8%) 3.06
(4.8%) 0.2% ( -8% - 10%) 0.886
SpanNear 15.79 (4.1%) 15.93
(3.8%) 0.9% ( -6% - 9%) 0.476
IntNRQ 117.55 (9.6%) 119.71
(7.2%) 1.8% ( -13% - 20%) 0.492
TermDTSort 251.34 (8.0%) 258.83
(9.4%) 3.0% ( -13% - 22%) 0.281
BrowseDateSSDVFacets 4.15 (26.0%) 4.34
(25.9%) 4.6% ( -37% - 76%) 0.575
BrowseDayOfYearTaxoFacets 26.03 (25.6%) 27.32
(32.1%) 5.0% ( -41% - 84%) 0.589
BrowseDateTaxoFacets 25.45 (25.8%) 26.82
(32.8%) 5.4% ( -42% - 86%) 0.563
BrowseRandomLabelTaxoFacets 23.16 (39.1%) 24.71
(47.4%) 6.7% ( -57% - 152%) 0.624
OrHighHigh 110.60 (3.9%) 147.71
(8.9%) 33.6% ( 20% - 48%) 0.000
OrHighMed 87.22 (4.2%) 190.07
(8.4%) 117.9% ( 101% - 136%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
