Re: Prometheus reporting task

2020-06-01 Thread Pavel S
Interesting observation, I set it to "All Process groups" and in Prometheus metrics only came up this one specific process, that same process that comes up for All Components. It's almost as if other processes are not matching whatever criteria the Task reports on. On Mon, Jun 1, 2020 at 5:56 PM

Re: Prometheus reporting task

2020-06-01 Thread Andy LoPresto
At a quick glance it does not look like there is much logging. Perhaps Matt Burgess can offer more context around this? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 1, 2020, at 2:45 PM, Pavel S

Re: Prometheus reporting task

2020-06-01 Thread Pavel S
Yes I did enable it on "All Components". I will check it again, I wish there was more documentation on this. Is there a log anywhere that I can see about what the reporting task is doing? On Mon, Jun 1, 2020 at 5:19 PM Andy LoPresto wrote: > Yolanda replied to a similar question a while ago

Re: Prometheus reporting task

2020-06-01 Thread Andy LoPresto
Yolanda replied to a similar question a while ago with some good notes on setting this up [1]. Specifically, you should be able to configure the reporting task to be scoped to the root process group, a specific process group, or the entire canvas. [1]

Re: MergeRecord performance

2020-06-01 Thread Robert R. Bruno
I have back pressure object threshold set to 10 on that queue and my swap threshold is 20. I don't think though when I had the issue the number of flow files was very high in the queue in question since the issue was now at updaterecord after I did a mergecontent that greatly reduced the

Prometheus reporting task

2020-06-01 Thread Pavel S
Hello I have upgraded Nifi to version 1.10.0 just to be able to enable Prometheus Reporting Task. Enabling the task was easy and installing Prometheus itself was easy and pointing it to Nifi to scrape. I have number of processors running in my Nifi. However, the metrics that get exposed only are

Re: MergeRecord performance

2020-06-01 Thread Mark Payne
Hey Robert, How big are the FlowFile queues that you have in front of your MergeContent/MergeRecord processors? Or, more specifically, what do you have configured for the back pressure threshold? I ask because there was a fix in 1.11.0 [1] that had to do with ordering when swapping and

Re: NiFi NARs Included in Docker

2020-06-01 Thread Chris Sampson
On purpose/conscious decision as part of 1.10.0, see the release notes and migration guide [1] 1. https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.10.0 Cheers, Chris Sampson On Mon, 1 Jun 2020, 18:42 Eric Secules, wrote: > Hello everyone, > > I noticed

NiFi NARs Included in Docker

2020-06-01 Thread Eric Secules
Hello everyone, I noticed that not all the NARs from the NiFi project are included in the Docker image on Dockerhub. For example, the nifi-atlas-nar is not included in the Docker image. Is this on purpose or an oversight? Thanks, Eric