[
https://issues.apache.org/jira/browse/NIFI-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997318#comment-14997318
]
Michael Moser edited comment on NIFI-697 at 11/9/15 8:43 PM:
-------------------------------------------------------------
I tested this using the latest code from master, 0.4.0-SNAPSHOT. I
successfully merged 115,000 FlowFiles with the default
nifi.queue.swap.threshold=20000. The issue is fixed.
was (Author: mosermw):
I tested this using the latest code from master, 0.4.0-SNAPSHOT. The issue is
fixed.
> MergeContent and queue swapping
> -------------------------------
>
> Key: NIFI-697
> URL: https://issues.apache.org/jira/browse/NIFI-697
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 0.1.0
> Reporter: Michael Moser
> Assignee: Mark Payne
> Priority: Minor
> Fix For: 0.4.0
>
>
> MergeContent will not place more files into bins than the nifi.properties
> nifi.queue.swap.threshold (default 20,000). This is probably worth a
> documentation note. Perhaps in the Maximum Number of Entries description in
> BinFiles. It says "The maximum number of files to include in a bundle. If
> not specified, there is no maximum." The maximum seems to be =
> nifi.queue.swap.threshold.
> Test Case: GenerateFlowFile and put about 81,000 files into a queue to
> MergeContent. Wait for most of them to be swapped out. Set Minimum Number
> of Entries to 25000. Set Max Bin Age to 1 min. When you start MergeContent,
> it will wait the Max Bin Age duration, then it will merge 20,000 files (the
> nifi.queue.swap.threshold).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
