[jira] [Commented] (LUCENE-8978) "Max Bottom" Based Early Termination For Concurrent Search
[ https://issues.apache.org/jira/browse/LUCENE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929280#comment-16929280 ] Atri Sharma commented on LUCENE-8978: - Both the runs are for wikimedium2m with concurrent searches enabled > "Max Bottom" Based Early Termination For Concurrent Search > -- > > Key: LUCENE-8978 > URL: https://issues.apache.org/jira/browse/LUCENE-8978 > Project: Lucene - Core > Issue Type: Improvement >Reporter: Atri Sharma >Priority: Major > Time Spent: 4h 50m > Remaining Estimate: 0h > > When running a search concurrently, collectors which have collected the > number of hits requested locally i.e. their local priority queue is full can > then globally publish their bottom hit's score, and other collectors can then > use that score as the filter. If multiple collectors have full priority > queues, the maximum of all bottom scores will be considered as the global > bottom score. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8978) "Max Bottom" Based Early Termination For Concurrent Search
[
https://issues.apache.org/jira/browse/LUCENE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929277#comment-16929277
]
Atri Sharma commented on LUCENE-8978:
-
Run with propagating global minimum scores
||Task ('HighSpanNear', None)||P50 Base 63.640386||P50 Cmp 65.506369||Pct Diff
2.93207366781||P90 Base 68.082931||P90 Cmp 68.719427||Pct Diff
0.9348833704||P99 Base 98.544661||P99 Cmp 90.023821||Pct Diff
-8.64667848418||P999 Base 98.544661||P999 Cmp 90.023821||Pct Diff
-8.64667848418||P100 Base 120.85372||P100 Cmp 115.88214||Pct Diff -4.1137169795
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 25.833619||P50 Cmp
25.713409||Pct Diff -0.465323886677||P90 Base 28.549801||P90 Cmp 35.187339||Pct
Diff 23.2489816654||P99 Base 34.097888||P99 Cmp 61.883127||Pct Diff
81.4866862135||P999 Base 34.097888||P999 Cmp 61.883127||Pct Diff
81.4866862135||P100 Base 214.305793||P100 Cmp 275.876451||Pct Diff 28.7302816868
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.600415||P50 Cmp
5.241538||Pct Diff 13.9361992342||P90 Base 54.632331||P90 Cmp 41.589045||Pct
Diff -23.8746649855||P99 Base 140.777103||P99 Cmp 113.980705||Pct Diff
-19.0346280957||P999 Base 140.777103||P999 Cmp 113.980705||Pct Diff
-19.0346280957||P100 Base 212.259622||P100 Cmp 232.746881||Pct Diff
9.65198128922
||Task ('HighTerm', None)||P50 Base 0.707935||P50 Cmp 0.767744||Pct Diff
8.44837449766||P90 Base 2.481444||P90 Cmp 2.45366||Pct Diff -1.11967064338||P99
Base 2.819463||P99 Cmp 3.250364||Pct Diff 15.283087595||P999 Base
2.819463||P999 Cmp 3.250364||Pct Diff 15.283087595||P100 Base 5.743958||P100
Cmp 67.726682||Pct Diff 1079.09431093
||Task ('LowTerm', None)||P50 Base 0.662316||P50 Cmp 0.730491||Pct Diff
10.2934248908||P90 Base 1.215188||P90 Cmp 3.100794||Pct Diff 155.169899637||P99
Base 10.361147||P99 Cmp 8.509808||Pct Diff -17.8680893148||P999 Base
10.361147||P999 Cmp 8.509808||Pct Diff -17.8680893148||P100 Base
40.860202||P100 Cmp 43.746191||Pct Diff 7.06308059857
||Task ('AndHighLow', None)||P50 Base 1.000578||P50 Cmp 1.001309||Pct Diff
0.0730577726074||P90 Base 1.841719||P90 Cmp 1.74311||Pct Diff
-5.35418269562||P99 Base 2.803872||P99 Cmp 7.829637||Pct Diff
179.243738659||P999 Base 2.803872||P999 Cmp 7.829637||Pct Diff
179.243738659||P100 Base 8.888941||P100 Cmp 26.286796||Pct Diff 195.724721314
||Task ('MedTerm', None)||P50 Base 0.702324||P50 Cmp 0.760572||Pct Diff
8.29360807832||P90 Base 1.789433||P90 Cmp 5.539351||Pct Diff 209.559005562||P99
Base 4.193817||P99 Cmp 14.309771||Pct Diff 241.211144883||P999 Base
4.193817||P999 Cmp 14.309771||Pct Diff 241.211144883||P100 Base 12.924386||P100
Cmp 69.040778||Pct Diff 434.190003301
||Task ('AndHighHigh', None)||P50 Base 8.716311||P50 Cmp 8.766923||Pct Diff
0.580658491878||P90 Base 22.896812||P90 Cmp 14.794421||Pct Diff
-35.3865463891||P99 Base 76.380162||P99 Cmp 27.420985||Pct Diff
-64.0993364219||P999 Base 76.380162||P999 Cmp 27.420985||Pct Diff
-64.0993364219||P100 Base 192.565741||P100 Cmp 209.282678||Pct Diff
8.68115839982
||Task ('LowSloppyPhrase', None)||P50 Base 2.504543||P50 Cmp 2.496497||Pct Diff
-0.321256213209||P90 Base 5.864326||P90 Cmp 17.025432||Pct Diff
190.322059176||P99 Base 17.061955||P99 Cmp 26.972014||Pct Diff
58.0827871132||P999 Base 17.061955||P999 Cmp 26.972014||Pct Diff
58.0827871132||P100 Base 28.311233||P100 Cmp 38.382978||Pct Diff 35.5750842784
||Task ('Wildcard', None)||P50 Base 4.622608||P50 Cmp 4.604615||Pct Diff
-0.389239148117||P90 Base 13.902747||P90 Cmp 9.311908||Pct Diff
-33.0210928819||P99 Base 212.077852||P99 Cmp 217.640103||Pct Diff
2.62274016242||P999 Base 212.077852||P999 Cmp 217.640103||Pct Diff
2.62274016242||P100 Base 256.120499||P100 Cmp 348.976972||Pct Diff 36.254994568
||Task ('HighSloppyPhrase', None)||P50 Base 40.021589||P50 Cmp 40.71495||Pct
Diff 1.73246744401||P90 Base 41.349646||P90 Cmp 42.092274||Pct Diff
1.7959718446||P99 Base 43.137416||P99 Cmp 63.876883||Pct Diff
48.0776757699||P999 Base 43.137416||P999 Cmp 63.876883||Pct Diff
48.0776757699||P100 Base 889.481117||P100 Cmp 748.568262||Pct Diff
-15.8421412559
||Task ('HighIntervalsOrdered', None)||P50 Base 17.065112||P50 Cmp
17.259941||Pct Diff 1.1416801718||P90 Base 18.188702||P90 Cmp 18.965857||Pct
Diff 4.27273479988||P99 Base 18.315874||P99 Cmp 50.189647||Pct Diff
174.022670171||P999 Base 18.315874||P999 Cmp 50.189647||Pct Diff
174.022670171||P100 Base 302.418464||P100 Cmp 329.078973||Pct Diff 8.81576761133
||Task ('IntNRQ', None)||P50 Base 4.603492||P50 Cmp 5.553211||Pct Diff
20.6304040498||P90 Base 61.351885||P90 Cmp 61.48353||Pct Diff
0.214573684248||P99 Base 164.30294||P99 Cmp 163.250118||Pct Diff
-0.640780986634||P999 Base 164.30294||P999 Cmp 163.250118||Pct Diff
-0.640780986634||P100 Base 224.633428||P100 Cmp 224.348545||Pct Diff
-0.126821285032
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.121258||P50 Cmp
0.121229||Pct Dif
[jira] [Commented] (LUCENE-8978) "Max Bottom" Based Early Termination For Concurrent Search
[
https://issues.apache.org/jira/browse/LUCENE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929030#comment-16929030
]
Atri Sharma commented on LUCENE-8978:
-
||Task ('HighSpanNear', None)||P50 Base 11.060489||P50 Cmp 11.859525||Pct Diff
7.22423755405||P90 Base 15.826127||P90 Cmp 15.409751||Pct Diff
-2.63094059589||P99 Base 17.0499||P99 Cmp 15.787728||Pct Diff
-7.4028117467||P999 Base 17.0499||P999 Cmp 15.787728||Pct Diff
-7.4028117467||P100 Base 369.613225||P100 Cmp 411.489965||Pct Diff 11.3298813916
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 26.011344||P50 Cmp
25.870156||Pct Diff -0.542793944058||P90 Base 27.199846||P90 Cmp 26.948776||Pct
Diff -0.923056696718||P99 Base 50.355332||P99 Cmp 62.389047||Pct Diff
23.8975983715||P999 Base 50.355332||P999 Cmp 62.389047||Pct Diff
23.8975983715||P100 Base 265.301527||P100 Cmp 242.147844||Pct Diff
-8.72730860686
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.855392||P50 Cmp
5.073211||Pct Diff 4.48612593999||P90 Base 91.615585||P90 Cmp 90.944365||Pct
Diff -0.73264827158||P99 Base 139.177491||P99 Cmp 134.249562||Pct Diff
-3.54075142797||P999 Base 139.177491||P999 Cmp 134.249562||Pct Diff
-3.54075142797||P100 Base 413.078905||P100 Cmp 399.62664||Pct Diff
-3.25658484061
||Task ('IntNRQ', None)||P50 Base 4.003539||P50 Cmp 4.117275||Pct Diff
2.84088652565||P90 Base 68.282386||P90 Cmp 67.613176||Pct Diff
-0.980062413168||P99 Base 168.038952||P99 Cmp 162.14838||Pct Diff
-3.50548008655||P999 Base 168.038952||P999 Cmp 162.14838||Pct Diff
-3.50548008655||P100 Base 183.270534||P100 Cmp 180.209181||Pct Diff
-1.67040109132
||Task ('LowTerm', None)||P50 Base 0.736588||P50 Cmp 0.802246||Pct Diff
8.91380255991||P90 Base 1.433158||P90 Cmp 9.655967||Pct Diff 573.754533694||P99
Base 9.67953||P99 Cmp 41.953847||Pct Diff 333.428554899||P999 Base
9.67953||P999 Cmp 41.953847||Pct Diff 333.428554899||P100 Base 57.585597||P100
Cmp 212.693297||Pct Diff 269.351553306
||Task ('AndHighLow', None)||P50 Base 1.54347||P50 Cmp 1.634274||Pct Diff
5.88310754339||P90 Base 2.434604||P90 Cmp 3.283687||Pct Diff 34.8756101608||P99
Base 3.374315||P99 Cmp 10.557446||Pct Diff 212.8767172||P999 Base
3.374315||P999 Cmp 10.557446||Pct Diff 212.8767172||P100 Base 41.81324||P100
Cmp 50.963314||Pct Diff 21.8831977622
||Task ('MedTerm', None)||P50 Base 0.89585||P50 Cmp 0.944529||Pct Diff
5.43383378914||P90 Base 1.404803||P90 Cmp 1.912129||Pct Diff 36.1136757254||P99
Base 1.721718||P99 Cmp 2.879041||Pct Diff 67.2190800119||P999 Base
1.721718||P999 Cmp 2.879041||Pct Diff 67.2190800119||P100 Base 57.913331||P100
Cmp 6.156178||Pct Diff -89.3700156878
||Task ('AndHighHigh', None)||P50 Base 9.298414||P50 Cmp 9.193083||Pct Diff
-1.13278458025||P90 Base 17.43996||P90 Cmp 28.767063||Pct Diff
64.9491340576||P99 Base 29.387967||P99 Cmp 36.807631||Pct Diff
25.2472857343||P999 Base 29.387967||P999 Cmp 36.807631||Pct Diff
25.2472857343||P100 Base 109.854089||P100 Cmp 107.673127||Pct Diff
-1.98532619027
||Task ('LowSloppyPhrase', None)||P50 Base 5.680762||P50 Cmp 5.562709||Pct Diff
-2.0781190974||P90 Base 10.573096||P90 Cmp 8.783411||Pct Diff
-16.9267828458||P99 Base 11.119536||P99 Cmp 10.675304||Pct Diff
-3.99505878663||P999 Base 11.119536||P999 Cmp 10.675304||Pct Diff
-3.99505878663||P100 Base 279.186923||P100 Cmp 253.176147||Pct Diff
-9.3166168818
||Task ('Wildcard', None)||P50 Base 5.493537||P50 Cmp 5.347662||Pct Diff
-2.65539305551||P90 Base 251.824224||P90 Cmp 242.036414||Pct Diff
-3.88676269682||P99 Base 410.472925||P99 Cmp 411.681977||Pct Diff
0.294550974343||P999 Base 410.472925||P999 Cmp 411.681977||Pct Diff
0.294550974343||P100 Base 473.53058||P100 Cmp 467.82275||Pct Diff -1.20537727468
||Task ('HighSloppyPhrase', None)||P50 Base 11.728682||P50 Cmp 11.905609||Pct
Diff 1.50849856787||P90 Base 78.56345||P90 Cmp 23.156508||Pct Diff
-70.5250876839||P99 Base 165.526231||P99 Cmp 24.095868||Pct Diff
-85.4428703811||P999 Base 165.526231||P999 Cmp 24.095868||Pct Diff
-85.4428703811||P100 Base 239.459867||P100 Cmp 154.765063||Pct Diff
-35.369101746
||Task ('HighIntervalsOrdered', None)||P50 Base 18.723819||P50 Cmp
19.239293||Pct Diff 2.75303878979||P90 Base 20.32576||P90 Cmp 20.59||Pct
Diff 2.22377416638||P99 Base 21.323183||P99 Cmp 21.997505||Pct Diff
3.16238902982||P999 Base 21.323183||P999 Cmp 21.997505||Pct Diff
3.16238902982||P100 Base 365.748746||P100 Cmp 306.958046||Pct Diff
-16.0740674146
||Task ('HighTerm', None)||P50 Base 0.982074||P50 Cmp 1.08638||Pct Diff
10.6209919008||P90 Base 1.859062||P90 Cmp 4.64411||Pct Diff 149.809312438||P99
Base 2.090176||P99 Cmp 25.399617||Pct Diff 1115.19034761||P999 Base
2.090176||P999 Cmp 25.399617||Pct Diff 1115.19034761||P100 Base 4.26937||P100
Cmp 54.324505||Pct Diff 1172.4243858
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.111432||P50 Cmp
0.116611||Pct Diff 4.64767750736||P90 Base 0.177541||P90 Cm
