RamakrishnaChilaka commented on PR #15140: URL: https://github.com/apache/lucene/pull/15140#issuecomment-3239697892
Reran benchmarks with arity 3 ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value PKLookup 112.57 (9.9%) 105.75 (7.8%) -6.1% ( -21% - 12%) 0.032 BrowseMonthTaxoFacets 1.55 (9.8%) 1.51 (9.8%) -2.9% ( -20% - 18%) 0.353 HighTermTitleSort 21.94 (7.6%) 21.35 (9.7%) -2.7% ( -18% - 15%) 0.328 range 1988.08 (7.4%) 1937.90 (7.5%) -2.5% ( -16% - 13%) 0.284 AndHighLow 578.51 (6.5%) 566.10 (6.6%) -2.1% ( -14% - 11%) 0.301 HighSloppyPhrase 0.47 (6.7%) 0.46 (7.0%) -1.7% ( -14% - 12%) 0.419 OrHighMedDayTaxoFacets 2.07 (7.6%) 2.04 (6.0%) -1.5% ( -14% - 13%) 0.486 BrowseRandomLabelTaxoFacets 1.11 (5.9%) 1.10 (7.6%) -0.6% ( -13% - 13%) 0.771 Respell 18.55 (7.2%) 18.44 (4.9%) -0.6% ( -11% - 12%) 0.772 MedTermDayTaxoFacets 19.47 (3.2%) 19.37 (3.0%) -0.5% ( -6% - 5%) 0.580 HighPhrase 13.08 (4.8%) 13.06 (5.1%) -0.1% ( -9% - 10%) 0.924 LowSpanNear 33.87 (4.7%) 33.85 (4.9%) -0.1% ( -9% - 9%) 0.963 AndHighMedDayTaxoFacets 107.22 (3.9%) 107.31 (2.9%) 0.1% ( -6% - 7%) 0.939 HighTermTitleBDVSort 14.65 (4.0%) 14.66 (4.3%) 0.1% ( -7% - 8%) 0.931 HighTermDayOfYearSort 45.00 (5.1%) 45.06 (5.5%) 0.1% ( -10% - 11%) 0.935 HighIntervalsOrdered 18.87 (7.1%) 18.90 (8.5%) 0.1% ( -14% - 16%) 0.953 AndHighHighDayTaxoFacets 6.24 (5.1%) 6.25 (4.5%) 0.2% ( -8% - 10%) 0.901 TermDTSort 43.90 (6.8%) 44.17 (7.5%) 0.6% ( -12% - 16%) 0.787 BrowseDayOfYearTaxoFacets 1.50 (8.7%) 1.52 (12.0%) 1.3% ( -17% - 24%) 0.699 LowSloppyPhrase 49.24 (3.8%) 49.90 (6.3%) 1.3% ( -8% - 11%) 0.415 LowIntervalsOrdered 108.45 (5.2%) 109.91 (7.4%) 1.3% ( -10% - 14%) 0.507 AndHighHigh 80.95 (11.3%) 82.26 (12.0%) 1.6% ( -19% - 28%) 0.662 OrHighHigh 64.43 (12.6%) 65.50 (14.3%) 1.7% ( -22% - 32%) 0.698 HighSpanNear 10.63 (4.7%) 10.83 (5.3%) 1.8% ( -7% - 12%) 0.254 MedSloppyPhrase 39.59 (14.4%) 40.35 (11.9%) 1.9% ( -21% - 33%) 0.649 IntNRQ 198.78 (4.5%) 202.61 (7.0%) 1.9% ( -9% - 14%) 0.302 MedPhrase 56.91 (2.7%) 58.01 (4.9%) 1.9% ( -5% - 9%) 0.121 BrowseDateSSDVFacets 0.41 (11.6%) 0.42 (10.8%) 2.0% ( -18% - 27%) 0.572 MedIntervalsOrdered 36.71 (4.5%) 37.45 (4.4%) 2.0% ( -6% - 11%) 0.154 BrowseRandomLabelSSDVFacets 1.27 (7.6%) 1.31 (8.7%) 2.6% ( -12% - 20%) 0.308 Wildcard 161.19 (7.4%) 165.48 (8.2%) 2.7% ( -12% - 19%) 0.280 Prefix3 219.37 (5.6%) 225.28 (6.3%) 2.7% ( -8% - 15%) 0.155 BrowseDayOfYearSSDVFacets 2.08 (14.6%) 2.14 (13.1%) 2.7% ( -21% - 35%) 0.533 OrNotHighMed 60.56 (7.0%) 62.25 (6.8%) 2.8% ( -10% - 17%) 0.202 MedSpanNear 81.72 (3.7%) 84.06 (4.8%) 2.9% ( -5% - 11%) 0.035 Fuzzy2 21.39 (4.1%) 22.02 (5.1%) 2.9% ( -5% - 12%) 0.044 Fuzzy1 27.20 (6.0%) 28.05 (10.3%) 3.1% ( -12% - 20%) 0.242 OrHighNotHigh 80.30 (11.7%) 83.06 (11.6%) 3.4% ( -17% - 30%) 0.353 HighTermMonthSort 85.65 (7.5%) 88.62 (11.8%) 3.5% ( -14% - 24%) 0.268 AndHighMed 204.92 (10.9%) 212.49 (11.4%) 3.7% ( -16% - 29%) 0.295 OrNotHighHigh 94.39 (8.5%) 97.93 (9.9%) 3.7% ( -13% - 24%) 0.200 LowPhrase 121.30 (3.8%) 126.06 (5.2%) 3.9% ( -4% - 13%) 0.006 OrHighNotMed 134.97 (12.0%) 140.59 (13.2%) 4.2% ( -18% - 33%) 0.296 BrowseMonthSSDVFacets 2.11 (11.5%) 2.23 (17.1%) 5.7% ( -20% - 38%) 0.219 BrowseDateTaxoFacets 1.40 (5.9%) 1.49 (15.8%) 5.8% ( -14% - 29%) 0.123 OrHighLow 122.42 (9.9%) 129.57 (12.4%) 5.8% ( -14% - 31%) 0.099 IntSet 276.23 (7.6%) 293.37 (7.9%) 6.2% ( -8% - 23%) 0.011 MedTerm 174.33 (14.5%) 187.06 (17.4%) 7.3% ( -21% - 45%) 0.149 OrNotHighLow 355.78 (6.5%) 382.90 (6.5%) 7.6% ( -5% - 22%) 0.000 HighTerm 161.21 (14.0%) 173.70 (17.6%) 7.8% ( -20% - 45%) 0.124 OrHighMed 129.57 (7.2%) 139.74 (9.6%) 7.8% ( -8% - 26%) 0.003 OrHighNotLow 208.81 (7.5%) 236.41 (12.8%) 13.2% ( -6% - 36%) 0.000 LowTerm 352.74 (13.3%) 399.51 (17.0%) 13.3% ( -15% - 50%) 0.006 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org