Michael Moser created NIFI-697:
----------------------------------

             Summary: MergeContent and queue swapping
                 Key: NIFI-697
                 URL: https://issues.apache.org/jira/browse/NIFI-697
             Project: Apache NiFi
          Issue Type: Bug
          Components: Core Framework
    Affects Versions: 0.1.0
            Reporter: Michael Moser
            Priority: Minor


MergeContent will not place more files into bins than the nifi.properties 
nifi.queue.swap.threshold (default 20,000).  This is probably worth a 
documentation note.  Perhaps in the Maximum Number of Entries description in 
BinFiles.  It says "The maximum number of files to include in a bundle. If not 
specified, there is no maximum."  The maximum seems to be = 
nifi.queue.swap.threshold.

Test Case: GenerateFlowFile and put about 81,000 files into a queue to 
MergeContent.  Wait for most of them to be swapped out.  Set Minimum Number of 
Entries to 25000.  Set Max Bin Age to 1 min.  When you start MergeContent, it 
will wait the Max Bin Age duration, then it will merge 20,000 files (the 
nifi.queue.swap.threshold).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to