Mark Payne created NIFI-2087:
--------------------------------

             Summary: Provenance Repository still removing events from Lucene 
Index
                 Key: NIFI-2087
                 URL: https://issues.apache.org/jira/browse/NIFI-2087
             Project: Apache NiFi
          Issue Type: Bug
          Components: Core Framework
            Reporter: Mark Payne
             Fix For: 1.0.0


NIFI-756 was implemented in NiFi 0.3.0 to change the way in which we remove 
events from the Lucene Indexes. It appears, though, that we still are using the 
DeleteIndexAction to remove events from the Lucene Index, in addition to the 
code that was added. As a result, we are removing events from the lucene index, 
in addition to the newer mechanism of just deleting the index files when they 
are no longer relevant.

We should be able to simply stop using the DeleteIndexAction in 
PersistentProvenanceRepository and then test by starting NiFi with a small 
index shard size (say 25 MB), create a lot of data, such that some of the data 
ages off. We should  then be able to verify that queries no longer show the 
data and be able to look in the provenance repository directory to verify that 
the old index-* directories are getting deleted.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to