Filip Maretić created NIFI-14095:
------------------------------------

             Summary: GetFile - "KeepSourceFile" set to true can fill up 
content repostiory
                 Key: NIFI-14095
                 URL: https://issues.apache.org/jira/browse/NIFI-14095
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Configuration
    Affects Versions: 1.28.1, 2.0.0
            Reporter: Filip Maretić
             Fix For: 2.1.0


Just setting the *KeepSourceFile* property to *true* can cause continuous 
ingestion of files into NiFi. If the file is big (e.g. 20 GB) this can cause 
the content repository (e.g. size of 400 GB) to be filled in an instant. This 
renders the NiFi node unusable and a cleanup is needed. There is no reason for 
this to happen, the flow should at least have enough time to process a chunk of 
such a huge file before attempting to load the same file again.

A quick solution would be just to add
{code:java}
@DefaultSchedule(strategy = SchedulingStrategy.TIMER_DRIVEN, period = "1 min")
{code}

This is anyone present on the ListFile processor, so why not to add it here 
also?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to