[
https://issues.apache.org/jira/browse/NIFI-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867953#comment-15867953
]
ASF subversion and git services commented on NIFI-3431:
-------------------------------------------------------
Commit a90fa9c285cce2beb1fea8fb266df402f8926fcf in nifi's branch
refs/heads/master from [~ijokarumawak]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=a90fa9c ]
NIFI-3431: Support batch update in Notify processor
- Added Signal Counter Delta property
- Added Signal Buffer Count property
- Added processor property name and display name
- Changed IOException handling from routing it to failure to throw
RuntimeException, so that NiFi framework can yield the processor for a while
and try again
Signed-off-by: Pierre Villard <[email protected]>
This closes #1466.
> Support batch update in Notify processor
> ----------------------------------------
>
> Key: NIFI-3431
> URL: https://issues.apache.org/jira/browse/NIFI-3431
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Affects Versions: 1.2.0
> Reporter: Koji Kawamura
> Assignee: Koji Kawamura
>
> NIFI-3216 added ability to wait for N signals. It supports waiting for N
> fragments split by SplitXXXX processors. However, since Notify processor has
> to increase count one by one by calling expensive replace cache operation
> over network, it doesn't provide a practical performance when user configured
> a flow looks like below as N glow:
> {code}
> Split
> --> (original) -> Wait for N
> --> (split) -> Do something -> Notify 1
> {code}
> This JIRA improves Notify processor by:
> - Add "Signal Buffer Count" to specify max number of flow files that can be
> buffered and update cache at once
> - Add "Signal Counter Delta" to specify delta grater than 1, EL supported
> "Signal Buffer Count" would be useful in a flow like this:
> {code}
> Split
> --> (original) -> Wait for N
> --> (split) -> Filter or something -> Notify M
> {code}
> Buffer incoming M flow files and perform cache replace operation once.
> So does "Signal Counter Delta":
> {code}
> Split
> --> (original) -> Wait for N
> --> (split) -> Filter or something -> Merge M -> PutXXX -> Notify M
> {code}
> Specify 'M' via Attribute Expression Language.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
