[
https://issues.apache.org/jira/browse/LUCENE-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977482#comment-15977482
]
Michael McCandless commented on LUCENE-7792:
--------------------------------------------
bq. Some day we could think of changing reThrow to return a dummy
RuntimeException so that:
+1! I get tired of typing that javac dig ;)
bq. It could be probably made more elegant if null executor was substituted
with a "same thread" executor
bq. Search for "Executor" in Solr's SimpleFacets.java which uses this technique.
I agree this would be cleaner, but I really need a "same thread" (direct)
{{ExecutorService}} here, I think? Solr is using {{Executor}} there.
I found this:
http://stackoverflow.com/questions/6581188/is-there-an-executorservice-that-uses-the-current-thread/6583868
but that looked quite a bit more complex than the if/then.
> Add optional concurrency to OfflineSorter
> -----------------------------------------
>
> Key: LUCENE-7792
> URL: https://issues.apache.org/jira/browse/LUCENE-7792
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: master (7.0), 6.6
>
> Attachments: LUCENE-7792.patch
>
>
> OfflineSorter is a heavy operation and is really an embarrassingly concurrent
> problem at heart, and if you have enough hardware concurrency (e.g. fast
> SSDs, multiple CPU cores) it can be a big speedup.
> E.g., after reading a partition from the input, one thread can sort and write
> it, while another thread reads the next partition, etc. Merging partitions
> can also be done in the background. Some things still cannot be concurrent,
> e.g. the initial read from the input must be a single thread, as well as the
> final merge and writing to the final output.
> I think I found a fairly non-invasive way to add optional concurrency to this
> class, by adding an optional ExecutorService to OfflineSorter's ctor (similar
> to IndexSearcher) and using futures to represent each partition as we sort,
> and creating Callable classes for sorting and merging partitions.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
