Brandon DeVries created NIFI-5700:
-------------------------------------
Summary: limit the size of nifi's flowfile repository
Key: NIFI-5700
URL: https://issues.apache.org/jira/browse/NIFI-5700
Project: Apache NiFi
Issue Type: Improvement
Components: Core Framework
Affects Versions: 1.7.1
Reporter: Brandon DeVries
Creating this ticket so as not to lose the discussion from the dev list [1].
Internally, our team has been working with the idea of setting FlowFile count
and heap usage limits, resulting in first stalls and then stops of writes to
the FlowFile repository. Yes, stopping writes to the FlowFile repository isn't
good... however, "overfilling" the FlowFile repository can potentially be bad
to the point of being unrecoverable. Putting this safeguard in place may mean
requiring manual intervention to get data moving again, but it should prevent
the system from failing entirely.
[1]
[http://apache-nifi-developer-list.39713.n7.nabble.com/Is-there-a-configuration-to-limit-the-size-of-nifi-s-flowfile-repository-td18554.html]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
