RamakrishnaChilaka commented on PR #15122:
URL: https://github.com/apache/lucene/pull/15122#issuecomment-3220604700
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseMonthSSDVFacets 3.60 (20.3%) 3.37
(11.4%) -6.3% ( -31% - 31%) 0.223
Fuzzy1 67.16 (6.1%) 63.18
(8.0%) -5.9% ( -18% - 8%) 0.008
BrowseDateTaxoFacets 2.49 (24.3%) 2.39
(6.8%) -3.7% ( -27% - 36%) 0.512
range 2023.15 (7.4%) 1950.18
(8.8%) -3.6% ( -18% - 13%) 0.161
BrowseDayOfYearTaxoFacets 2.49 (20.2%) 2.40
(6.7%) -3.6% ( -25% - 29%) 0.450
Respell 28.12 (8.3%) 27.18
(6.1%) -3.3% ( -16% - 12%) 0.147
MedPhrase 66.70 (3.6%) 64.81
(4.3%) -2.8% ( -10% - 5%) 0.025
Fuzzy2 36.78 (10.6%) 35.77
(8.4%) -2.8% ( -19% - 18%) 0.362
BrowseRandomLabelTaxoFacets 1.94 (9.9%) 1.89
(2.7%) -2.7% ( -13% - 11%) 0.241
BrowseDayOfYearSSDVFacets 3.23 (9.1%) 3.15
(9.9%) -2.6% ( -19% - 18%) 0.392
PKLookup 154.56 (9.8%) 151.27
(10.1%) -2.1% ( -20% - 19%) 0.500
AndHighHighDayTaxoFacets 26.67 (3.5%) 26.20
(4.0%) -1.8% ( -8% - 5%) 0.137
LowTerm 1072.87 (19.7%) 1056.23
(18.1%) -1.6% ( -32% - 45%) 0.796
MedTerm 630.89 (10.8%) 622.16
(10.9%) -1.4% ( -20% - 22%) 0.686
IntNRQ 166.07 (2.4%) 163.85
(1.8%) -1.3% ( -5% - 3%) 0.050
LowPhrase 436.94 (5.1%) 431.39
(4.1%) -1.3% ( -10% - 8%) 0.389
HighSpanNear 27.61 (3.9%) 27.32
(4.3%) -1.1% ( -8% - 7%) 0.421
HighPhrase 61.94 (2.9%) 61.33
(3.0%) -1.0% ( -6% - 5%) 0.289
BrowseMonthTaxoFacets 2.71 (7.0%) 2.69
(7.2%) -0.7% ( -13% - 14%) 0.751
TermDTSort 195.80 (2.5%) 194.74
(3.9%) -0.5% ( -6% - 5%) 0.600
MedSpanNear 14.86 (4.8%) 14.79
(6.3%) -0.5% ( -11% - 11%) 0.780
LowSpanNear 20.27 (3.1%) 20.18
(3.7%) -0.5% ( -6% - 6%) 0.674
LowSloppyPhrase 141.19 (4.1%) 140.97
(4.1%) -0.2% ( -8% - 8%) 0.907
HighTermTitleBDVSort 26.33 (4.7%) 26.37
(4.9%) 0.2% ( -9% - 10%) 0.918
AndHighLow 1152.91 (6.1%) 1155.86
(5.5%) 0.3% ( -10% - 12%) 0.889
HighTerm 680.10 (10.1%) 682.47
(10.0%) 0.3% ( -17% - 22%) 0.913
AndHighMedDayTaxoFacets 88.21 (7.5%) 88.82
(5.3%) 0.7% ( -11% - 14%) 0.735
HighIntervalsOrdered 24.29 (8.3%) 24.47
(10.9%) 0.7% ( -17% - 21%) 0.814
HighTermDayOfYearSort 181.58 (4.4%) 182.93
(2.4%) 0.7% ( -5% - 7%) 0.510
IntSet 442.06 (9.7%) 445.64
(9.7%) 0.8% ( -16% - 22%) 0.792
HighSloppyPhrase 28.85 (5.0%) 29.09
(5.6%) 0.8% ( -9% - 12%) 0.615
OrHighNotHigh 277.02 (10.7%) 279.55
(10.2%) 0.9% ( -18% - 24%) 0.782
AndHighHigh 109.63 (15.7%) 110.68
(14.4%) 1.0% ( -25% - 36%) 0.841
Wildcard 437.67 (5.9%) 442.00
(9.6%) 1.0% ( -13% - 17%) 0.695
OrNotHighMed 307.72 (9.9%) 310.98
(9.3%) 1.1% ( -16% - 22%) 0.728
OrHighMed 424.58 (11.6%) 429.21
(9.7%) 1.1% ( -18% - 25%) 0.747
OrNotHighHigh 197.44 (10.1%) 199.68
(9.9%) 1.1% ( -17% - 23%) 0.721
HighTermTitleSort 79.41 (5.0%) 80.32
(5.2%) 1.1% ( -8% - 11%) 0.478
OrHighNotMed 377.33 (10.2%) 382.16
(8.7%) 1.3% ( -15% - 22%) 0.669
MedSloppyPhrase 45.13 (4.3%) 45.71
(6.2%) 1.3% ( -8% - 12%) 0.450
MedTermDayTaxoFacets 16.84 (6.9%) 17.06
(5.6%) 1.3% ( -10% - 14%) 0.504
OrHighMedDayTaxoFacets 8.75 (6.2%) 8.88
(8.5%) 1.4% ( -12% - 17%) 0.548
AndHighMed 363.26 (8.2%) 368.73
(8.9%) 1.5% ( -14% - 20%) 0.580
HighTermMonthSort 894.70 (7.6%) 908.53
(5.8%) 1.5% ( -10% - 16%) 0.468
BrowseRandomLabelSSDVFacets 2.22 (7.0%) 2.26
(10.5%) 1.7% ( -14% - 20%) 0.557
LowIntervalsOrdered 62.92 (5.8%) 64.24
(4.8%) 2.1% ( -7% - 13%) 0.212
OrHighNotLow 747.30 (9.2%) 765.58
(8.1%) 2.4% ( -13% - 21%) 0.373
OrHighLow 553.62 (5.6%) 567.71
(4.9%) 2.5% ( -7% - 13%) 0.124
MedIntervalsOrdered 58.19 (10.0%) 59.69
(9.1%) 2.6% ( -15% - 24%) 0.394
OrHighHigh 85.46 (15.5%) 87.99
(13.0%) 3.0% ( -22% - 37%) 0.513
OrNotHighLow 1156.15 (5.1%) 1194.57
(6.1%) 3.3% ( -7% - 15%) 0.061
BrowseDateSSDVFacets 0.71 (10.6%) 0.73
(8.8%) 4.1% ( -13% - 26%) 0.181
Prefix3 272.91 (17.8%) 309.73
(5.5%) 13.5% ( -8% - 44%) 0.001
```
TL;DR: the change does not help (and slightly hurts) the macro-benchmarks.
Hence closing the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
