Mark Bean created NIFI-11669:
--------------------------------

             Summary: Allow expired entries in distributed cache to be pruned
                 Key: NIFI-11669
                 URL: https://issues.apache.org/jira/browse/NIFI-11669
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
    Affects Versions: 1.21.0
            Reporter: Mark Bean


DetectDuplicate processor adds entries to a DistributedMapCacheClient service. 
The processor also has an Age Off Duration property. The cached value is 
removed from the cache only if a subsequent duplicate is detected and the 
(optional) Age Off Duration has expired. The result is that entries which are 
beyond their age off duration remain in the cache needlessly and continue to 
consume memory.

There should be a proactive pruning process to eliminate the expired entries. 

Two thoughts come to mind: using a DistributedMapCache implementation which 
expires entries. This is the most flexible as other users of the cache would 
benefit as well. Alternatively, the DetectDuplicate processor could 
periodically prune the cache.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to