Eric, Mark,
This is an example of an exchange in this forum that is of immeasurable
help to to on-lookers. Thanks for discussing it so thoroughly!
Russ
On 11/23/20 5:55 PM, Eric Secules wrote:
Hello everyone,
I was wondering if there was a metric for the amount of time
tImer-driven processors spend in a queue ready and waiting to be run.
I use NiFi in an atypical way and my flow has over 2000 processors
running on a single node, but there are usually less than 10
connections that have one or more flowfiles in them at any given time.
I have a theory that the number of processors in use is slowing down
the system overall. But I would need to see some more metrics to know
whether that's the case and tell whether anything I am doing is
helping. Are there some logs that I could look for or internal stats I
could poke at with a debugger?
Should I be able to see increased throughput by increasing the number
of timer-driven threads, or is there a different mechanism responsible
for going through all the runnable processors to see whether they have
input to process. I also noticed "nifi.bored.yield.duration" would it
be good to increase the yield duration in this setting?
Thanks,
Eric
