[ https://issues.apache.org/jira/browse/NIFI-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tamas Palfy reassigned NIFI-7081: --------------------------------- Assignee: Tamas Palfy > Improve handling of Load Balanced Connections when one node is slow > ------------------------------------------------------------------- > > Key: NIFI-7081 > URL: https://issues.apache.org/jira/browse/NIFI-7081 > Project: Apache NiFi > Issue Type: Improvement > Components: Core Framework > Reporter: Mark Payne > Assignee: Tamas Palfy > Priority: Major > > When a connection is configured to use Round Robin load balancing, the > FlowFIle Queue works by queuing up one FlowFile to be processed locally, one > to be sent to Node 2, one to be sent to Node 3, the next one to be locally > processed, etc. (in this case, assuming a 3-node cluster). > If one node in a cluster is slow, though, we can have a situation where the > local partition is empty and the partition for Node 2 is empty. But Node 3's > partition is full, because Node 3 is not processing the data quickly enough. > As a result, on Node 1, the queue ends up applying backpressure, with all > FlowFiles in the queue waiting to be pushed to Node 3. > In such a situation, we end up preventing any data from being processed by > Node 1 or Node 2. It would be advantageous to improve this so that Node 1 and > Node 2 could still be busy processing data. -- This message was sent by Atlassian Jira (v8.3.4#803005)