[ 
https://issues.apache.org/jira/browse/LUCENE-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234330#comment-16234330
 ] 

Julian Vassev commented on LUCENE-8018:
---------------------------------------

Hi Michael,
Thank you for your interest in this matter.

Yes, the default session timeout is 30 minutes. As new documents are indexed 
almost every 10 seconds, every new session creates a searcher. This also 
prevents efficient merging and during a synthetic test I can observe segment 
file count grow as much 2.5x the number of documents.

I tried with using NRTCachingDirectory but it seems to make no difference.

> FieldInfos retains garbage if non-sparse
> ----------------------------------------
>
>                 Key: LUCENE-8018
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8018
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: core/store
>    Affects Versions: 6.5
>         Environment: Lucene 6.5.0, java 8
> openjdk version "1.8.0_45-internal"
> OpenJDK Runtime Environment (build 1.8.0_45-internal-b14)
> OpenJDK 64-Bit Server VM (build 25.45-b02, mixed mode)
>            Reporter: Julian Vassev
>            Assignee: Adrien Grand
>            Priority: Major
>              Labels: easyfix, performance
>             Fix For: master (8.0), 7.2
>
>         Attachments: LUCENE-8018.patch
>
>
> A heap dump revealed a lot of TreeMap.Entry instances (millions of them) for 
> a system with about ~1000 active searchers.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to