[
https://issues.apache.org/jira/browse/NIFI-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Koji Kawamura updated NIFI-2825:
--------------------------------
Status: Patch Available (was: Open)
> Remote Process Group should use num of queued flow files in remote nodes to
> distribute load
> -------------------------------------------------------------------------------------------
>
> Key: NIFI-2825
> URL: https://issues.apache.org/jira/browse/NIFI-2825
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.0.0
> Environment: Clustered
> Reporter: Koji Kawamura
> Assignee: Koji Kawamura
> Fix For: 1.1.0
>
>
> A RPG (Site-to-Site client) should take into account of the number of queued
> flow files in each remote cluster nodes, to calculate the load distribution
> balance among target nodes. So that it can send more data to nodes those have
> less queued files, or receive more data from nodes those have more queued
> files.
> However, after the clustering mechanism has changed since 1.0, this load
> distribution logic is not handled appropriately. Site-to-Site remote
> component always returns flow file count as 0. So RPG distribute load evenly,
> even if a remote cluster has unbalanced load among nodes.
> We need to fix the remote node API to expose queued flow file count correctly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
