[ 
https://issues.apache.org/jira/browse/LUCENE-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791029#action_12791029
 ] 

Michael McCandless commented on LUCENE-2164:
--------------------------------------------

bq. do we want to go down the "Ergonomics" route and make the default number of 
threads vary based on Runtime.getRuntime().availableProcessors()

Good idea!  How about something like this:

{code}
max(1, min(3, numberOfCores / 2))
{code}

Ie, number of cores divided by 2, but floored at 1 and ceiling'd at 3?

I think 1 BG thread is always good since you gain CPU + IO
concurrency.  Too many thread (I'm guess above 3) will swamp the IO
system (unless IO system is SSD).

This would just be a dynamic default, ie, if you call
setMaxThreadCount yourself, you override it.


> Make CMS smarter about thread priorities
> ----------------------------------------
>
>                 Key: LUCENE-2164
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2164
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>            Priority: Minor
>             Fix For: 3.1
>
>         Attachments: LUCENE-2164.patch
>
>
> Spinoff from LUCENE-2161...
> The hard throttling CMS does (blocking the incoming thread that wants
> to launch a new merge) can be devastating when it strikes during NRT
> reopen.
> It can easily happen if a huge merge is off and running, but then a
> tiny merge is needed to clean up recently created segments due to
> frequent reopens.
> I think a small change to CMS, whereby it assigns a higher thread
> priority to tiny merges than big merges, should allow us to increase
> the max merge thread count again, and greatly reduce the chance that
> NRT's reopen would hit this.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org

Reply via email to