Joseph Witt created NIFI-579:
--------------------------------

             Summary: MergeContent should handle 10s of thousands+ item merges 
more efficiently
                 Key: NIFI-579
                 URL: https://issues.apache.org/jira/browse/NIFI-579
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: Joseph Witt
            Priority: Minor
             Fix For: 0.1.1


The way MergeContent works it opens the file handles for all items to be merged 
then writes all their content to a new resulting output file.

It creates problems when merging thousands, tens of thousands, and more objects 
as it means there are massive amounts of open file handles.  This seems 
avoidable and users should not be required to leave unlimited number of open 
file handles for it to work nicely.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to