Mark Payne created NIFI-16238:
---------------------------------

             Summary: Allow specifying a max journal size for flowfile repo and 
local state
                 Key: NIFI-16238
                 URL: https://issues.apache.org/jira/browse/NIFI-16238
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Core Framework
            Reporter: Mark Payne
            Assignee: Mark Payne


Both the local state provider and the FlowFile Repository make use of the 
{{SequentialAccessWriteAheadLog}} and checkpoint periodically based on a time 
threshold. But under heavy load we can write significant amounts of data, 
resulting on {{IOException: No space left on device}} issues. We should allow 
configuring a max journal size and if configured checkpoint when the journal 
exceeds that threshold. This allows us to avoid overfilling the disk even under 
heavy load.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to