[
https://issues.apache.org/jira/browse/NIFI-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986737#comment-15986737
]
ASF subversion and git services commented on NIFI-1202:
-------------------------------------------------------
Commit a41a2a9b1ab79b558831177e91e8fde49d6e748a in nifi's branch
refs/heads/master from [~ijokarumawak]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=a41a2a9 ]
NIFI-1202: Site-to-Site batch settings.
- Added batchCount, batchSize, batchDuration to limit flow files to be
included in a single Site-to-Site transaction.
- Added batch throttling logic when StandardRemoteGroupPort transfers
flow files to a remote input port using the batch limit configurations,
so that users can limit batch not only for pulling data, but also pushing
data.
- Added destination list shuffle to provide better load distribution.
Previously, the load distribution algorithm produced the same host
consecutively.
- Added new batch settings to FlowConfiguration.xsd.
- Added new batch settings to Flow Fingerprint.
- Added new batch settings to Audit.
- Sort ports by name at 'Remote Process Group Ports' dialog.
- Show 'No value set' when a batch configuration is not set
- Updated batch settings tooltip to clearly explain how it works the
configuration works differently for input and output ports.
- Updated DTO by separating batch settings to BatchSettingsDTO to indicate
count, size and duration are a set of configurations.
- This closes #1306
> Allow user to configure Batch Size for site-to-site
> ---------------------------------------------------
>
> Key: NIFI-1202
> URL: https://issues.apache.org/jira/browse/NIFI-1202
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework, Core UI, Documentation & Website
> Reporter: Mark Payne
> Assignee: Koji Kawamura
> Attachments: configure-remote-port-window.png,
> WIP-added-batch-settings-ui.png
>
>
> Currently, there is no way for a user to specify the batch size that
> Site-to-Site will use. The framework decides this for you. However, if we
> want to use the List/Fetch Pattern, it will be helpful to specify a small
> batch size so that a small number of things that are listed are still well
> distributed across the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
