Hello everyone, We’re experiencing a peculiar issue with a load balancing connection. It’s partitioning files based on an attribute in a 6-node cluster with a dedicated Zookeeper cluster. We’re running version 1.27.0 and using a volatile Flowfile and Provenance repository.
Occasionally, the connection breaks, and the queue becomes full with “ghost files.” This means the queue displays 10k Flowfiles per affected node (maximum back pressure), but the processor doesn’t process any of them. Additionally, right-clicking and viewing the queue list shows an empty list. As a result, the affected nodes accumulate back pressure, causing the flow to fill up and stop processing. A restart resolves the issue, but it’s not an ideal solution. So far, I haven’t been able to reproduce the problem. Has anyone experienced similar issues or has an idea about why this is happening? Thanks, Christian
