[
https://issues.apache.org/jira/browse/LUCENE-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12656964#action_12656964
]
Michael McCandless commented on LUCENE-1483:
--------------------------------------------
Can you post your inefficient remapping version?
I too created the fallback version (just set subord to -1 when value
isn't found in the new index & respect that in the two compare
methods). I confirmed it gives correct top 50 results. This then
brings ord perf to 97.6 searches/sec (vs trunk 107.1 searches/sec), so
that's our number to beat since it seems to be bug-free.
Then I ran "MatchAllDocsQuery" (to test a much larger result set --
this returns 2M hits but previous query "text" returned ~97K hits),
sorting by title, queue size=100. Trunk still has unbelievely slow
warming (95 sec), and then gets 7.6 searches/sec. Patch ord search
(with fallback) gets 30.7 searches/sec.
This is very interesting and odd -- I can't explain why ord searching
w/ fallback is so much faster than current trunk when the number of
hits is large (2M). I think this is very important because it's the
big slow queries that are most important to improve here, even if it's
at some cost to the queries that are already fast.
Ie, we still need to do more tests, but if this result holds (and we
need to explain the difference), I think it's a strong vote for the
ord+fallback approach. Not to mention, it also sidesteps the absurdly
slow warming time of FieldCache.StringIndex on a Multi*Reader.
> Change IndexSearcher to use MultiSearcher semantics for multiple subreaders
> ---------------------------------------------------------------------------
>
> Key: LUCENE-1483
> URL: https://issues.apache.org/jira/browse/LUCENE-1483
> Project: Lucene - Java
> Issue Type: Improvement
> Affects Versions: 2.9
> Reporter: Mark Miller
> Priority: Minor
> Attachments: LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch, LUCENE-1483.patch,
> LUCENE-1483.patch, LUCENE-1483.patch
>
>
> FieldCache and Filters are forced down to a single segment reader, allowing
> for individual segment reloading on reopen.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
