Koji Kawamura created NIFI-2825:
-----------------------------------
Summary: Remote Process Group should use num of queued flow files
in remote nodes to distribute load
Key: NIFI-2825
URL: https://issues.apache.org/jira/browse/NIFI-2825
Project: Apache NiFi
Issue Type: Bug
Components: Core Framework
Affects Versions: 1.0.0
Environment: Clustered
Reporter: Koji Kawamura
Assignee: Koji Kawamura
Fix For: 1.1.0
A RPG (Site-to-Site client) should take into account of the number of queued
flow files in each remote cluster nodes, to calculate the load distribution
balance among target nodes. So that it can send more data to nodes those have
less queued files, or receive more data from nodes those have more queued files.
However, after the clustering mechanism has changed since 1.0, this load
distribution logic is not handled appropriately. Site-to-Site remote component
always returns flow file count as 0. So RPG distribute load evenly, even if a
remote cluster has unbalanced load among nodes.
We need to fix the remote node API to expose queued flow file count correctly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
