[
https://issues.apache.org/jira/browse/LUCENE-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234330#comment-16234330
]
Julian Vassev commented on LUCENE-8018:
---------------------------------------
Hi Michael,
Thank you for your interest in this matter.
Yes, the default session timeout is 30 minutes. As new documents are indexed
almost every 10 seconds, every new session creates a searcher. This also
prevents efficient merging and during a synthetic test I can observe segment
file count grow as much 2.5x the number of documents.
I tried with using NRTCachingDirectory but it seems to make no difference.
> FieldInfos retains garbage if non-sparse
> ----------------------------------------
>
> Key: LUCENE-8018
> URL: https://issues.apache.org/jira/browse/LUCENE-8018
> Project: Lucene - Core
> Issue Type: Bug
> Components: core/store
> Affects Versions: 6.5
> Environment: Lucene 6.5.0, java 8
> openjdk version "1.8.0_45-internal"
> OpenJDK Runtime Environment (build 1.8.0_45-internal-b14)
> OpenJDK 64-Bit Server VM (build 25.45-b02, mixed mode)
> Reporter: Julian Vassev
> Assignee: Adrien Grand
> Priority: Major
> Labels: easyfix, performance
> Fix For: master (8.0), 7.2
>
> Attachments: LUCENE-8018.patch
>
>
> A heap dump revealed a lot of TreeMap.Entry instances (millions of them) for
> a system with about ~1000 active searchers.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]