kkewwei commented on PR #16715: URL: https://github.com/apache/lucene/pull/16715#issuecomment-5834680354
I added a benchmark task set in luceneutil with wikimediumall: https://github.com/mikemccand/luceneutil/compare/main...kkewwei:must_not_task?expand=1 Since there was no existing task covering this scenario, I added`MostNotIODVRange` . It shows an approximately 3x performance improvement for this type of query, with no performance impact on related tasks. ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value BrowseMonthSSDVFacets 3.49 (24.6%) 3.40 (21.3%) -2.7% ( -39% - 57%) 0.706 BrowseRandomLabelTaxoFacets 2.26 (3.2%) 2.20 (3.5%) -2.7% ( -9% - 4%) 0.012 BrowseDayOfYearTaxoFacets 3.57 (10.2%) 3.49 (8.1%) -2.1% ( -18% - 18%) 0.466 BrowseDateTaxoFacets 3.48 (10.0%) 3.41 (8.2%) -2.1% ( -18% - 17%) 0.473 BrowseRandomLabelSSDVFacets 1.84 (9.8%) 1.81 (8.8%) -1.9% ( -18% - 18%) 0.510 IntSet 255.29 (3.3%) 250.56 (3.3%) -1.9% ( -8% - 4%) 0.075 BrowseDateSSDVFacets 0.74 (9.1%) 0.73 (10.0%) -1.2% ( -18% - 19%) 0.683 MedSpanNear 16.61 (1.7%) 16.46 (2.3%) -0.9% ( -4% - 3%) 0.138 BrowseDayOfYearSSDVFacets 3.20 (14.2%) 3.18 (20.2%) -0.7% ( -30% - 39%) 0.902 AndHighHighDayTaxoFacets 9.31 (5.7%) 9.25 (6.4%) -0.6% ( -12% - 12%) 0.746 HighSpanNear 5.81 (2.5%) 5.77 (2.8%) -0.6% ( -5% - 4%) 0.487 HighTermTitleBDVSort 2.36 (9.5%) 2.35 (10.2%) -0.4% ( -18% - 21%) 0.893 LowIntervalsOrdered 32.26 (3.1%) 32.14 (6.5%) -0.4% ( -9% - 9%) 0.810 HighIntervalsOrdered 2.15 (5.9%) 2.15 (6.6%) -0.2% ( -11% - 12%) 0.904 MedIntervalsOrdered 16.45 (3.4%) 16.42 (4.1%) -0.2% ( -7% - 7%) 0.860 BM25MSM2 3.16 (2.1%) 3.15 (3.1%) -0.1% ( -5% - 5%) 0.873 AndHighMed 114.47 (2.4%) 114.36 (2.3%) -0.1% ( -4% - 4%) 0.892 MedPhrase 6.33 (2.9%) 6.33 (4.4%) -0.0% ( -7% - 7%) 0.999 PKLookup 166.12 (3.9%) 166.16 (4.2%) 0.0% ( -7% - 8%) 0.984 LowSpanNear 2.18 (1.8%) 2.18 (4.1%) 0.0% ( -5% - 6%) 0.965 HighTermTitleSort 72.70 (3.3%) 72.77 (3.9%) 0.1% ( -6% - 7%) 0.933 OrHighMed 44.11 (1.9%) 44.16 (2.6%) 0.1% ( -4% - 4%) 0.877 LowSloppyPhrase 4.50 (3.5%) 4.51 (3.4%) 0.2% ( -6% - 7%) 0.878 HighPhrase 13.63 (2.4%) 13.66 (3.7%) 0.2% ( -5% - 6%) 0.812 AndHighLow 330.10 (5.8%) 330.89 (6.3%) 0.2% ( -11% - 13%) 0.901 AndHighMedDayTaxoFacets 15.26 (5.1%) 15.30 (5.4%) 0.3% ( -9% - 11%) 0.858 OrHighMedDayTaxoFacets 2.87 (3.5%) 2.88 (3.9%) 0.3% ( -6% - 7%) 0.778 MostNotLowHigh 43.05 (3.5%) 43.22 (4.4%) 0.4% ( -7% - 8%) 0.750 LowTerm 612.85 (2.5%) 615.33 (2.6%) 0.4% ( -4% - 5%) 0.621 MedSloppyPhrase 19.27 (4.0%) 19.36 (3.7%) 0.4% ( -7% - 8%) 0.724 HighTerm 393.62 (2.6%) 395.45 (3.5%) 0.5% ( -5% - 6%) 0.634 Wildcard 9.66 (2.8%) 9.71 (2.8%) 0.5% ( -5% - 6%) 0.594 MedTerm 438.19 (3.8%) 440.52 (4.3%) 0.5% ( -7% - 9%) 0.681 LowPhrase 46.58 (3.2%) 46.84 (3.5%) 0.6% ( -5% - 7%) 0.596 AndMissingHigh 2076.32 (4.0%) 2088.41 (4.0%) 0.6% ( -7% - 8%) 0.641 HighSloppyPhrase 2.16 (4.9%) 2.18 (5.2%) 0.6% ( -9% - 11%) 0.705 Fuzzy1 37.40 (2.8%) 37.63 (3.0%) 0.6% ( -5% - 6%) 0.498 OrNotHighLow 324.53 (5.4%) 326.63 (5.7%) 0.6% ( -9% - 12%) 0.711 Fuzzy2 36.93 (3.2%) 37.18 (3.6%) 0.7% ( -5% - 7%) 0.527 AndHighHigh 24.50 (2.2%) 24.68 (2.6%) 0.8% ( -3% - 5%) 0.323 OrHighHigh 33.84 (1.9%) 34.12 (2.2%) 0.8% ( -3% - 5%) 0.211 OrHighLow 312.47 (3.2%) 315.16 (3.9%) 0.9% ( -6% - 8%) 0.444 ConstMSM2 966.22 (3.1%) 974.68 (3.7%) 0.9% ( -5% - 7%) 0.413 Prefix3 143.63 (1.9%) 145.01 (2.4%) 1.0% ( -3% - 5%) 0.166 range 4588.95 (6.1%) 4641.12 (5.9%) 1.1% ( -10% - 13%) 0.549 Respell 29.06 (2.9%) 29.39 (3.9%) 1.1% ( -5% - 8%) 0.294 HighTermMonthSort 1582.51 (3.6%) 1607.89 (3.5%) 1.6% ( -5% - 9%) 0.154 OrNotHighMed 217.21 (4.2%) 220.74 (2.9%) 1.6% ( -5% - 9%) 0.156 MedTermDayTaxoFacets 5.59 (4.5%) 5.69 (3.3%) 1.8% ( -5% - 9%) 0.151 IntNRQ 272.10 (3.7%) 279.02 (5.8%) 2.5% ( -6% - 12%) 0.097 HighTermDayOfYearSort 159.11 (3.5%) 163.25 (3.1%) 2.6% ( -3% - 9%) 0.013 TermDTSort 120.11 (3.2%) 123.88 (3.6%) 3.1% ( -3% - 10%) 0.003 OrHighNotHigh 277.43 (6.1%) 288.03 (7.7%) 3.8% ( -9% - 18%) 0.082 OrNotHighHigh 165.88 (8.3%) 172.39 (7.4%) 3.9% ( -10% - 21%) 0.114 OrHighNotLow 226.74 (8.5%) 238.17 (7.9%) 5.0% ( -10% - 23%) 0.052 OrHighNotMed 184.67 (8.9%) 194.76 (9.9%) 5.5% ( -12% - 26%) 0.067 BrowseMonthTaxoFacets 4.18 (43.8%) 4.79 (59.8%) 14.5% ( -61% - 210%) 0.382 MostNotIODVRange 6.91 (39.0%) 27.56 (8.1%) 298.8% ( 181% - 566%) 0.000 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
