jpountz commented on PR #15151:
URL: https://github.com/apache/lucene/pull/15151#issuecomment-3250181785

   wikibigall on my machine gives the following results:
   
   ```
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                FilteredOrStopWords       44.09      (2.0%)       43.68      
(1.2%)   -0.9% (  -4% -    2%) 0.070
                    FilteredPrefix3      147.21      (2.1%)      146.02      
(2.0%)   -0.8% (  -4% -    3%) 0.208
                      TermTitleSort       84.02      (3.4%)       83.45      
(3.7%)   -0.7% (  -7% -    6%) 0.543
                 CombinedOrHighHigh       21.82      (2.9%)       21.67      
(3.2%)   -0.7% (  -6% -    5%) 0.477
                 FilteredOrHighHigh       64.80      (1.9%)       64.38      
(1.0%)   -0.6% (  -3% -    2%) 0.170
                        CountPhrase        4.16      (1.8%)        4.13      
(1.7%)   -0.6% (  -4% -    2%) 0.269
                       CombinedTerm       37.20      (2.0%)       37.03      
(2.6%)   -0.5% (  -4% -    4%) 0.533
                  CombinedOrHighMed       82.29      (2.7%)       81.99      
(3.3%)   -0.4% (  -6% -    5%) 0.704
                         TermDTSort      383.61      (2.3%)      382.24      
(2.7%)   -0.4% (  -5% -    4%) 0.651
         FilteredOr2Terms2StopWords      142.98      (1.4%)      142.64      
(0.7%)   -0.2% (  -2% -    1%) 0.498
                      TermMonthSort     3268.83      (2.6%)     3263.88      
(2.8%)   -0.2% (  -5% -    5%) 0.860
                   FilteredOr3Terms      161.33      (1.1%)      161.11      
(0.8%)   -0.1% (  -2% -    1%) 0.659
                        CountOrMany       28.41      (1.9%)       28.39      
(3.2%)   -0.1% (  -5% -    5%) 0.936
                     FilteredIntNRQ      296.73      (1.0%)      296.54      
(1.2%)   -0.1% (  -2% -    2%) 0.855
            CountFilteredOrHighHigh      134.69      (1.0%)      134.61      
(1.7%)   -0.1% (  -2% -    2%) 0.901
                    CountAndHighMed      297.37      (1.3%)      297.31      
(1.2%)   -0.0% (  -2% -    2%) 0.958
                   CountAndHighHigh      350.18      (2.0%)      350.11      
(3.8%)   -0.0% (  -5% -    5%) 0.983
                  TermDayOfYearSort      282.87      (2.0%)      282.81      
(1.4%)   -0.0% (  -3% -    3%) 0.974
                CountFilteredOrMany       26.60      (2.0%)       26.60      
(3.1%)   -0.0% (  -4% -    5%) 0.999
                    AndHighOrMedMed       48.78      (1.3%)       48.79      
(1.2%)    0.0% (  -2% -    2%) 0.978
             CountFilteredOrHighMed      146.46      (0.9%)      146.48      
(1.2%)    0.0% (  -2% -    2%) 0.966
                       FilteredTerm      153.98      (2.2%)      154.04      
(1.5%)    0.0% (  -3% -    3%) 0.941
                  FilteredOrHighMed      148.23      (1.3%)      148.37      
(0.8%)    0.1% (  -1% -    2%) 0.777
                         OrHighRare      281.29      (8.3%)      281.70      
(3.8%)    0.1% ( -10% -   13%) 0.943
                     FilteredOrMany       15.81      (2.0%)       15.83      
(1.6%)    0.1% (  -3% -    3%) 0.799
                    CountOrHighHigh      332.30      (2.1%)      332.99      
(4.0%)    0.2% (  -5% -    6%) 0.838
                CountFilteredPhrase       24.86      (2.4%)       24.98      
(1.3%)    0.5% (  -3% -    4%) 0.417
                FilteredAndHighHigh       77.70      (1.8%)       78.09      
(1.2%)    0.5% (  -2% -    3%) 0.293
                             OrMany       22.44      (4.3%)       22.55      
(3.8%)    0.5% (  -7% -    8%) 0.682
                CombinedAndHighHigh       22.19      (1.3%)       22.32      
(1.6%)    0.6% (  -2% -    3%) 0.204
                     CountOrHighMed      339.36      (2.4%)      341.52      
(1.9%)    0.6% (  -3% -    4%) 0.346
        FilteredAnd2Terms2StopWords      212.32      (1.9%)      213.73      
(1.4%)    0.7% (  -2% -    3%) 0.196
                 CombinedAndHighMed       84.39      (1.2%)       85.02      
(1.6%)    0.7% (  -2% -    3%) 0.091
                  FilteredAnd3Terms      185.09      (2.9%)      186.51      
(1.9%)    0.8% (  -3% -    5%) 0.321
                     FilteredPhrase       31.03      (1.5%)       31.27      
(1.1%)    0.8% (  -1% -    3%) 0.059
               FilteredAndStopWords       64.07      (2.0%)       64.58      
(1.2%)    0.8% (  -2% -    4%) 0.120
                           Or3Terms      222.41      (6.2%)      224.23      
(5.2%)    0.8% ( -10% -   13%) 0.653
                          CountTerm     8641.68      (4.1%)     8727.93      
(4.3%)    1.0% (  -7% -    9%) 0.449
                 Or2Terms2StopWords      197.83      (5.0%)      199.85      
(4.5%)    1.0% (  -8% -   11%) 0.496
                          OrHighMed      243.82      (7.2%)      246.48      
(6.0%)    1.1% ( -11% -   15%) 0.602
                 FilteredAndHighMed      151.68      (3.8%)      153.36      
(2.5%)    1.1% (  -5% -    7%) 0.279
                   AndMedOrHighHigh       80.46      (5.0%)       81.47      
(4.1%)    1.3% (  -7% -   10%) 0.384
                        OrStopWords       46.75      (8.1%)       47.37      
(6.8%)    1.3% ( -12% -   17%) 0.575
                         OrHighHigh       73.81      (9.1%)       74.95      
(7.5%)    1.5% ( -13% -   19%) 0.558
                And2Terms2StopWords      196.07      (6.2%)      199.96      
(4.1%)    2.0% (  -7% -   13%) 0.235
                          And3Terms      228.82      (7.7%)      233.77      
(5.2%)    2.2% (  -9% -   16%) 0.297
                       AndStopWords       44.61      (9.5%)       45.68      
(6.4%)    2.4% ( -12% -   20%) 0.348
                               Term      617.63      (8.3%)      636.08      
(5.3%)    3.0% (  -9% -   18%) 0.176
                         AndHighMed      188.71     (10.7%)      194.64      
(7.2%)    3.1% ( -13% -   23%) 0.275
                        AndHighHigh       64.17     (11.8%)       66.29      
(8.0%)    3.3% ( -14% -   26%) 0.300
   ```
   
   p-values are high due to quite high run-over-run variance, but queries that 
we'd have expected to get a speedup are at the bottom so it may give a tiny 
speedup in practice.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to