[
https://issues.apache.org/jira/browse/LUCENE-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295018#comment-14295018
]
Tommaso Teofili commented on LUCENE-6202:
-----------------------------------------
sample run execution with the added impls:
{noformat}
[junit4] Suite: org.apache.lucene.search.suggest.LookupBenchmarkTest
[junit4] 2> -- construction time
[junit4] 2> FuzzySuggester input: 50001, time[ms]: 521 [+- 34.59]
[junit4] 2> AnalyzingSuggester input: 50001, time[ms]: 515 [+- 11.77]
[junit4] 2> AnalyzingInfixSuggester input: 50001, time[ms]: 497 [+- 133.96]
[junit4] 2> JaspellLookup input: 50001, time[ms]: 25 [+- 2.07]
[junit4] 2> TSTLookup input: 50001, time[ms]: 110 [+- 3.75]
[junit4] 2> FSTCompletionLookup input: 50001, time[ms]: 188 [+- 5.63]
[junit4] 2> WFSTCompletionLookup input: 50001, time[ms]: 185 [+- 4.73]
[junit4] 2> BlendedInfixSuggester input: 50001, time[ms]: 1005 [+- 49.96]
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T11:58:19, stalled
for 67.8s at: LookupBenchmarkTest.testConstructionTime
[junit4] 2> FreeTextSuggester input: 50001, time[ms]: 314 [+- 10.11]
[junit4] OK 72.3s | LookupBenchmarkTest.testConstructionTime
[junit4] 2> -- prefixes: 6-9, num: 7, onlyMorePopular: false
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T11:59:31, stalled
for 67.6s at: LookupBenchmarkTest.testPerformanceOnPrefixes6_9
[junit4] 2> FuzzySuggester queries: 50001, time[ms]: 4276 [+- 53.95],
~kQPS: 12
[junit4] 2> AnalyzingSuggester queries: 50001, time[ms]: 497 [+- 9.90],
~kQPS: 101
[junit4] 2> AnalyzingInfixSuggester queries: 50001, time[ms]: 676 [+-
9.37], ~kQPS: 74
[junit4] 2> JaspellLookup queries: 50001, time[ms]: 100 [+- 4.88],
~kQPS: 498
[junit4] 2> TSTLookup queries: 50001, time[ms]: 76 [+- 4.12], ~kQPS:
655
[junit4] 2> FSTCompletionLookup queries: 50001, time[ms]: 354 [+- 8.31],
~kQPS: 141
[junit4] 2> WFSTCompletionLookup queries: 50001, time[ms]: 138 [+- 5.30],
~kQPS: 362
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:00:31, stalled
for 128s at: LookupBenchmarkTest.testPerformanceOnPrefixes6_9
[junit4] 2> BlendedInfixSuggester queries: 50001, time[ms]: 2242 [+-
23.44], ~kQPS: 22
[junit4] 2> FreeTextSuggester queries: 50001, time[ms]: 292 [+- 6.77],
~kQPS: 171
[junit4] OK 179s | LookupBenchmarkTest.testPerformanceOnPrefixes6_9
[junit4] 2> -- prefixes: 100-200, num: 7, onlyMorePopular: false
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:02:31, stalled
for 68.4s at: LookupBenchmarkTest.testPerformanceOnFullHits
[junit4] 2> FuzzySuggester queries: 50001, time[ms]: 4795 [+- 59.51],
~kQPS: 10
[junit4] 2> AnalyzingSuggester queries: 50001, time[ms]: 471 [+- 11.24],
~kQPS: 106
[junit4] 2> AnalyzingInfixSuggester queries: 50001, time[ms]: 493 [+-
7.22], ~kQPS: 101
[junit4] 2> JaspellLookup queries: 50001, time[ms]: 76 [+- 3.92], ~kQPS:
655
[junit4] 2> TSTLookup queries: 50001, time[ms]: 28 [+- 2.39], ~kQPS:
1782
[junit4] 2> FSTCompletionLookup queries: 50001, time[ms]: 326 [+- 8.92],
~kQPS: 153
[junit4] 2> WFSTCompletionLookup queries: 50001, time[ms]: 93 [+- 4.83],
~kQPS: 538
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:03:31, stalled
for 128s at: LookupBenchmarkTest.testPerformanceOnFullHits
[junit4] 2> BlendedInfixSuggester queries: 50001, time[ms]: 1007 [+-
13.82], ~kQPS: 50
[junit4] 2> FreeTextSuggester queries: 50001, time[ms]: 276 [+- 6.39],
~kQPS: 181
[junit4] OK 155s | LookupBenchmarkTest.testPerformanceOnFullHits
[junit4] 2> -- prefixes: 2-4, num: 7, onlyMorePopular: false
[junit4] 2> FuzzySuggester queries: 50001, time[ms]: 3071 [+- 43.34],
~kQPS: 16
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:05:07, stalled
for 69.2s at: LookupBenchmarkTest.testPerformanceOnPrefixes2_4
[junit4] 2> AnalyzingSuggester queries: 50001, time[ms]: 1025 [+- 15.09],
~kQPS: 49
[junit4] 2> AnalyzingInfixSuggester queries: 50001, time[ms]: 1115 [+-
18.78], ~kQPS: 45
[junit4] 2> JaspellLookup queries: 50001, time[ms]: 169 [+- 3.69],
~kQPS: 295
[junit4] 2> TSTLookup queries: 50001, time[ms]: 586 [+- 13.19],
~kQPS: 85
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:06:07, stalled
for 129s at: LookupBenchmarkTest.testPerformanceOnPrefixes2_4
[junit4] 2> FSTCompletionLookup queries: 50001, time[ms]: 467 [+- 8.43],
~kQPS: 107
[junit4] 2> WFSTCompletionLookup queries: 50001, time[ms]: 413 [+- 7.17],
~kQPS: 121
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:07:07, stalled
for 189s at: LookupBenchmarkTest.testPerformanceOnPrefixes2_4
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:08:07, stalled
for 249s at: LookupBenchmarkTest.testPerformanceOnPrefixes2_4
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:09:07, stalled
for 309s at: LookupBenchmarkTest.testPerformanceOnPrefixes2_4
[junit4] HEARTBEAT J0 PID([email protected]): 2015-01-28T12:10:07, stalled
for 369s at: LookupBenchmarkTest.testPerformanceOnPrefixes2_4
[junit4] 2> BlendedInfixSuggester queries: 50001, time[ms]: 13714 [+-
210.26], ~kQPS: 4
[junit4] 2> FreeTextSuggester queries: 50001, time[ms]: 516 [+- 7.44],
~kQPS: 97
[junit4] OK 425s | LookupBenchmarkTest.testPerformanceOnPrefixes2_4
[junit4] 2> -- RAM consumption
[junit4] 2> FuzzySuggester size[B]: 773,064
[junit4] 2> AnalyzingSuggester size[B]: 773,064
[junit4] 2> AnalyzingInfixSuggester size[B]: 34,348
[junit4] 2> JaspellLookup size[B]: 8,616,416
[junit4] 2> TSTLookup size[B]: 9,313,880
[junit4] 2> FSTCompletionLookup size[B]: 375,160
[junit4] 2> WFSTCompletionLookup size[B]: 450,160
[junit4] 2> BlendedInfixSuggester size[B]: 55,404
[junit4] 2> FreeTextSuggester size[B]: 250,008
[junit4] OK 6.50s | LookupBenchmarkTest.testStorageNeeds
{noformat}
> Add FreeTextSuggester and BlendedInfixSuggester to the LookupBenchmarkTest
> --------------------------------------------------------------------------
>
> Key: LUCENE-6202
> URL: https://issues.apache.org/jira/browse/LUCENE-6202
> Project: Lucene - Core
> Issue Type: Test
> Components: core/other
> Affects Versions: 4.10.3
> Reporter: Tommaso Teofili
> Assignee: Tommaso Teofili
> Priority: Minor
> Fix For: Trunk
>
>
> {{LookupBenchmarkTest}} doesn't include {{FreeTextSuggester}} and
> {{BlendedInfixSuggester}} in its benchmarked {{Lookup}} extensions so I
> suggest to add them in order to be able to benchmark them.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
