Re: How to report on a full queue in Apache NiFi (Version 1.27.0)?

Fri, 11 Apr 2025 01:22:52 -0700

Dear Stephane

I’m using a site2sitereporting service. Created a flow where I filter on connections, and calculate how many procent each connection is full. Both for flow files and for bytes (amount in queue vs. Max back pressure allowed). Later I filter connections with queues reach a threshold and send info to another system, which give me some alarms. I also create some parent group names, so I know in which group there might be a problem. 

Kind regards 
Jens

Den 9. apr. 2025 kl. 20.35 skrev stephane kouajip <stephanekoua...@gmail.com>:


I will take a look.

Thanks 

On Wed, Apr 9, 2025 at 1:25 PM Daniel Chaffelson <chaffel...@gmail.com> wrote:
Hi Stephane,
I have code in NiPyAPI[1] for purging all connections in a process group, which was created to easily reset test flows.
I expect you could use it as an example to instead inspect connection status to determine capacity issues using some scheduled fetch and analyse process.

I am not aware of a native method inside NiFi for your requirement, but other wiser minds may offer further insight.


On Wed, Apr 9, 2025 at 1:29 PM stephane kouajip <stephanekoua...@gmail.com> wrote:

Hi NiFi Community,

I'm working with Apache NiFi version 1.27.0, and I need help figuring out how to report or monitor when a queue is full. I want to be able to track and get alerts if any queue in my NiFi instance reaches its full capacity.

I’ve looked through the NiFi documentation and community discussions, but I haven't found a clear approach to monitor the queues effectively. Can anyone provide advice or best practices for reporting on a full queue? Specifically, I'm looking for a way to:

  • Monitor when a queue reaches its maximum capacity.

  • Set up alerts or notifications based on queue status.

  • Log or report this event for monitoring or troubleshooting purposes.

Any help or pointers would be greatly appreciated. Thanks in advance!

Reply via email to