Hi,

Sometimes we have flowfiles stuck without reason in queues before out ports
in consumer groups with batch output flowfile concurrency configured. We
don't know why, and we haven't been able to find out where the problem is.
So our operation teams has to check periodically, and change the flowfile
concurrency to streaming to unstack these flowfiles.

Thanks to all.

El lun, 2 ene 2023 a las 10:02, Pierre Villard (<pierre.villard...@gmail.com>)
escribió:

> I think it'd be good to take a step back. How can a flow file get stuck in
> a relationship? 1 - Is it because you have a self loop failure
> relationship? 2 - Is it because you have "dead ends" with a failure
> relationship going to a funnel? 3 - or is it because a flow file is failing
> and is being rolled back in the input relationship?
> With 1, you should leverage the retry feature that has been recently added
> With 2, this is a bad practice but you could indeed using reporting tasks
> to check flow files in those specific queues
> With 3, bulletins would be generated and I recommend having monitoring in
> place for the bulletins (with reporting tasks)
>
> Le sam. 31 déc. 2022 à 16:49, Jorge Machado <jom...@me.com> a écrit :
>
>> Activate prometheus exporter and you will have a metric for  number of
>> objects in the queue
>>
>> On 31. Dec 2022, at 07:08, nayan sharma <nayansharm...@gmail.com> wrote:
>>
>> Hi Users,
>> Is there anyway through which I can monitor or raise alert if any flow
>> file got stuck in nifi queue.
>>
>> For now operation team needs to manually check for these. If you can
>> suggest way through which I can achieve this that would be great.
>>
>> Thanks,
>> Nayan
>> --
>> Thanks & Regards,
>> Nayan Sharma
>>  *+91-8095382952*
>>
>> <https://www.linkedin.com/in/nayan-sharma>
>> <http://stackoverflow.com/users/3687426/nayan-sharma?tab=profile>
>>
>>
>>

-- 
Guillermo Muñoz Salgado

Reply via email to