Christian What processor is following this? (MergeContent/MergeRecord - something else?)
Please show an image of what you're seeing. Thanks On Tue, Dec 10, 2024 at 12:27 PM Christian Wahl <christian.w...@abusix.com> wrote: > Hello everyone, > > We’re experiencing a peculiar issue with a load balancing connection. It’s > partitioning files based on an attribute in a 6-node cluster with a > dedicated Zookeeper cluster. We’re running version 1.27.0 and using a > volatile Flowfile and Provenance repository. > > Occasionally, the connection breaks, and the queue becomes full with > “ghost files.” This means the queue displays 10k Flowfiles per affected > node (maximum back pressure), but the processor doesn’t process any of > them. Additionally, right-clicking and viewing the queue list shows an > empty list. > > As a result, the affected nodes accumulate back pressure, causing the flow > to fill up and stop processing. > > A restart resolves the issue, but it’s not an ideal solution. So far, I > haven’t been able to reproduce the problem. > > Has anyone experienced similar issues or has an idea about why this is > happening? > > Thanks, > Christian