[
https://issues.apache.org/jira/browse/NIFI-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467818#comment-15467818
]
ASF subversion and git services commented on NIFI-2681:
-------------------------------------------------------
Commit 088125451b7f15684752a914a3a83a834fac1a50 in nifi's branch
refs/heads/master from [~markap14]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=0881254 ]
NIFI-2681: Refactored IndexManager into an interface and renamed the existing
implementation to CachingIndexManager. Implemented a new SimpleIndexManager
that performs no caching of IndexSearchers.
This closes #958.
Signed-off-by: Bryan Bende <[email protected]>
> Avoid caching Provenance Index Searchers
> ----------------------------------------
>
> Key: NIFI-2681
> URL: https://issues.apache.org/jira/browse/NIFI-2681
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Reporter: Mark Payne
> Assignee: Mark Payne
> Priority: Critical
> Fix For: 1.1.0
>
>
> In NIFI-2600 and NIFI-2452, we addressed two bugs where the Provenance
> Repository closes a cached IndexSearcher too soon. The IndexManager keeps the
> searchers cached in an effort to offer better performance when performing a
> Provenance Query. This was done because it was recommended in the Lucene
> documentation. However, we occasionally still see nodes crashing with
> segfaults due to the Lucene Searching. We should update the Persistent
> Provenance Repository to stop caching Index Searchers in order to trade a
> slight performance improvement for significantly better reliability.
> Playing around with the idea in order to test it out shows very favorable
> results. On a system where I could cause a seg fault almost every time that I
> ran a large provenance query, I updated the code to no longer cache the
> readers and saw perfect stability with no noticeable performance degradation.
> I will cleanup the code and submit a PR for these changes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
