mikemccand commented on pull request #518:
URL: https://github.com/apache/lucene/pull/518#issuecomment-999918920
I re-ran benchmarks with more iterations per task (200 vs 20 before) to let
hotspot have more time to optimize in each of the 20 JVMs:
```
Task QPS base StdDevQPS new-mmap
StdDev Pct diff p-value
BrowseMonthTaxoFacets 4.71 (6.2%) 4.39
(3.3%) -6.8% ( -15% - 2%) 0.000
BrowseMonthSSDVFacets 7.86 (14.8%) 7.34
(10.9%) -6.7% ( -28% - 22%) 0.104
HighTermMonthSort 59.25 (12.5%) 57.42
(11.8%) -3.1% ( -24% - 24%) 0.420
PKLookup 138.18 (1.1%) 135.03
(1.6%) -2.3% ( -4% - 0%) 0.000
Fuzzy1 45.86 (1.3%) 45.15
(1.5%) -1.6% ( -4% - 1%) 0.000
HighSloppyPhrase 7.90 (5.1%) 7.78
(5.1%) -1.6% ( -11% - 9%) 0.332
Fuzzy2 38.89 (1.1%) 38.30
(1.3%) -1.5% ( -3% - 0%) 0.000
MedPhrase 14.90 (2.7%) 14.72
(3.6%) -1.2% ( -7% - 5%) 0.230
Respell 36.40 (1.2%) 36.05
(1.5%) -0.9% ( -3% - 1%) 0.029
LowPhrase 21.59 (2.1%) 21.43
(2.5%) -0.7% ( -5% - 3%) 0.304
BrowseDayOfYearTaxoFacets 4.58 (12.3%) 4.56
(10.4%) -0.6% ( -20% - 25%) 0.861
BrowseRandomLabelTaxoFacets 4.06 (8.1%) 4.04
(7.5%) -0.6% ( -14% - 16%) 0.817
BrowseDateTaxoFacets 4.57 (12.2%) 4.55
(10.5%) -0.4% ( -20% - 25%) 0.904
OrHighHigh 18.30 (3.4%) 18.22
(2.5%) -0.4% ( -6% - 5%) 0.663
Wildcard 42.52 (13.2%) 42.55
(12.7%) 0.1% ( -22% - 29%) 0.989
AndHighHighDayTaxoFacets 21.35 (2.1%) 21.36
(1.8%) 0.1% ( -3% - 4%) 0.926
OrHighMed 91.02 (3.1%) 91.16
(2.4%) 0.2% ( -5% - 5%) 0.860
MedTermDayTaxoFacets 22.74 (5.0%) 22.78
(3.0%) 0.2% ( -7% - 8%) 0.902
HighIntervalsOrdered 3.79 (2.9%) 3.80
(3.3%) 0.2% ( -5% - 6%) 0.814
IntNRQ 93.38 (8.2%) 93.60
(1.0%) 0.2% ( -8% - 10%) 0.897
HighTermTitleBDVSort 4.38 (5.9%) 4.40
(4.6%) 0.3% ( -9% - 11%) 0.841
OrHighMedDayTaxoFacets 8.05 (3.2%) 8.08
(4.2%) 0.3% ( -6% - 8%) 0.770
AndHighHigh 23.23 (2.8%) 23.31
(3.5%) 0.4% ( -5% - 6%) 0.705
AndHighMedDayTaxoFacets 42.68 (2.2%) 42.87
(1.6%) 0.5% ( -3% - 4%) 0.455
TermDTSort 667.66 (1.7%) 670.71
(1.3%) 0.5% ( -2% - 3%) 0.342
AndHighMed 98.30 (3.1%) 98.84
(3.3%) 0.5% ( -5% - 7%) 0.589
Prefix3 33.28 (3.4%) 33.47
(4.3%) 0.6% ( -6% - 8%) 0.645
OrHighLow 404.97 (3.6%) 407.82
(2.1%) 0.7% ( -4% - 6%) 0.446
LowSloppyPhrase 62.46 (2.6%) 62.91
(2.1%) 0.7% ( -3% - 5%) 0.334
OrNotHighHigh 713.35 (3.2%) 719.56
(2.5%) 0.9% ( -4% - 6%) 0.332
LowTerm 951.78 (1.9%) 960.95
(1.7%) 1.0% ( -2% - 4%) 0.093
MedSloppyPhrase 28.24 (2.4%) 28.57
(2.3%) 1.2% ( -3% - 5%) 0.115
MedTerm 1173.70 (2.1%) 1187.71
(2.7%) 1.2% ( -3% - 6%) 0.121
OrNotHighMed 576.27 (2.1%) 583.63
(1.7%) 1.3% ( -2% - 5%) 0.035
HighPhrase 201.44 (3.4%) 204.22
(1.7%) 1.4% ( -3% - 6%) 0.101
HighTermDayOfYearSort 1822.34 (2.1%) 1847.93
(1.5%) 1.4% ( -2% - 5%) 0.015
BrowseRandomLabelSSDVFacets 5.22 (7.4%) 5.30
(7.2%) 1.5% ( -12% - 17%) 0.515
OrHighNotLow 811.72 (3.1%) 824.52
(2.7%) 1.6% ( -4% - 7%) 0.086
HighTerm 963.95 (3.3%) 979.31
(3.6%) 1.6% ( -5% - 8%) 0.142
LowIntervalsOrdered 55.56 (3.7%) 56.49
(3.3%) 1.7% ( -5% - 8%) 0.133
MedIntervalsOrdered 12.72 (3.9%) 12.95
(3.7%) 1.8% ( -5% - 9%) 0.141
MedSpanNear 7.21 (3.7%) 7.37
(3.2%) 2.1% ( -4% - 9%) 0.049
OrHighNotHigh 781.73 (2.7%) 799.12
(2.7%) 2.2% ( -3% - 7%) 0.009
AndHighLow 514.79 (4.0%) 526.55
(1.3%) 2.3% ( -2% - 7%) 0.015
LowSpanNear 22.27 (2.6%) 22.80
(2.2%) 2.4% ( -2% - 7%) 0.002
OrNotHighLow 477.71 (5.1%) 489.15
(1.3%) 2.4% ( -3% - 9%) 0.042
OrHighNotMed 913.86 (2.3%) 935.89
(2.3%) 2.4% ( -2% - 7%) 0.001
HighSpanNear 14.42 (4.9%) 14.83
(3.9%) 2.8% ( -5% - 12%) 0.044
BrowseDayOfYearSSDVFacets 7.33 (21.1%) 7.79
(17.2%) 6.3% ( -26% - 56%) 0.301
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
