Joe Skora created NIFI-3039:
-------------------------------
Summary: Provenance Repository - Fix PurgeOldEvent and Rollover
Size Limits
Key: NIFI-3039
URL: https://issues.apache.org/jira/browse/NIFI-3039
Project: Apache NiFi
Issue Type: Bug
Components: Core Framework
Affects Versions: 0.7.1, 1.0.0, 1.1.0, 0.8.0
Reporter: Joe Skora
Assignee: Joe Skora
Current {purgeOldEvents} logic triggers cleanup when 90% of space is used, but
it only removes one file if usage is under 100%, causing thrashing around 100%
usage. In testing, cleanup up to 70% after hitting 90% makes the system run
more smoothly.
Also, {rollover} will not trigger cleanup unless 110% of the allowed space is
in use, changing this to 100% also make a difference in testing.
Before these changes, a test system that generates huge amounts of provenance
would become unstable and stop processing provenance until restarted. With
these changes, the system consistently recovers even under heavy load.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
