[ 
https://issues.apache.org/jira/browse/LUCENE-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234379#comment-16234379
 ] 

Michael McCandless commented on LUCENE-8018:
--------------------------------------------

Hi [~jvassev], hmm it should not prevent merging, but rather prevent deleting 
of index files that are still in use by old searchers, even if they have been 
merged away in the latest index.  I.e. if you print the latest searcher you 
should see a "contained" number of segments in it.

Also, if you refresh every 10 seconds, and every such searcher is used (i.e. a 
new search always happens within the 10 seconds), then shouldn't you at worst 
every have 30 * 6 = 180 live searchers?

Do you use {{SearcherLifetimeManager}} to track all these searchers?

> FieldInfos retains garbage if non-sparse
> ----------------------------------------
>
>                 Key: LUCENE-8018
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8018
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: core/store
>    Affects Versions: 6.5
>         Environment: Lucene 6.5.0, java 8
> openjdk version "1.8.0_45-internal"
> OpenJDK Runtime Environment (build 1.8.0_45-internal-b14)
> OpenJDK 64-Bit Server VM (build 25.45-b02, mixed mode)
>            Reporter: Julian Vassev
>            Assignee: Adrien Grand
>            Priority: Major
>              Labels: easyfix, performance
>             Fix For: master (8.0), 7.2
>
>         Attachments: LUCENE-8018.patch
>
>
> A heap dump revealed a lot of TreeMap.Entry instances (millions of them) for 
> a system with about ~1000 active searchers.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to