Re: ExecuteStateless processor

2023-06-12 Thread Mark Payne
Hello, I recommend running: lsof -p This will give you a listing of all file handles that NiFi has open. From that, you should be able to better understand what files (or sockets) are open. Thanks -Mark On Jun 12, 2023, at 11:47 AM, Fields, Bradley E CTR (USA) wrote: We have been trying

ExecuteStateless processor

2023-06-12 Thread Fields, Bradley E CTR (USA)
We have been trying to use the ExecuteStatless processor with our kafka dataflow but we are having major issues. We have followed the only youtube video that we have found to make sure our setup is good. The issue we have is as soon as this processor is turned on, we start seeing the errors of

RE: DeleteHDFS behavior when idle

2023-06-12 Thread Isha Lamboo
Thanks Bryan and Mark, I've created a Jira ticket describing things as well as I can. I see Bryan already has a better idea of the cause than my guess in the ticket, I will add that as a comment. Regards, Isha -Oorspronkelijk bericht- Van: Bryan Bende Verzonden: maandag 12 juni

Re: [DISCUSS] Release NiFi NAR Maven Plugin 1.5.1

2023-06-12 Thread Bryan Bende
+1 Thanks Nandor, I agree it would be nice to get that fix out. On Mon, Jun 12, 2023 at 10:05 AM Kevin Doran wrote: > +1 > > On Jun 12, 2023 at 05:35:57, Nandor Soma Abonyi > > wrote: > > > Hello Apache NiFi Community, > > > > I'd like to initiate a discussion about the next release of > >

Re: DeleteHDFS behavior when idle

2023-06-12 Thread Bryan Bende
The processor has @TriggerWhenEmpty so it is going to keep executing regardless of whether the incoming queue has data or not. I believe this was done early on for some processors that used Kerberos in order to allow the processor to have a chance to renew the Kerberos ticket, however we since

Re: [DISCUSS] Release NiFi NAR Maven Plugin 1.5.1

2023-06-12 Thread Kevin Doran
+1 On Jun 12, 2023 at 05:35:57, Nandor Soma Abonyi wrote: > Hello Apache NiFi Community, > > I'd like to initiate a discussion about the next release of > nifi-nar-maven-plugin. > > Currently, nifi-nar-maven-plugin doesn’t use remote repositories, which was > fixed in [1]. Though it is the

Re: DeleteHDFS behavior when idle

2023-06-12 Thread Mark Payne
Isha, If you have an incoming connection, and you’re seeing this, then it’s a bug. If there is no incoming connection and this processor is used as a source processor, it’s normal. Either way, it has rather little overhead, and you can further reduce the overhead by increasing the Yield

DeleteHDFS behavior when idle

2023-06-12 Thread Isha Lamboo
Hi all, I have a question about behavior I see on one of our NiFi 1.18 clusters that has a lot of xHDFS processors. When I look at the number of tasks in the summary, the DeleteHDFS processors have a very high number (800-1000+) of tasks even if they have nothing in their incoming queues. The

[DISCUSS] Release NiFi NAR Maven Plugin 1.5.1

2023-06-12 Thread Nandor Soma Abonyi
Hello Apache NiFi Community, I'd like to initiate a discussion about the next release of nifi-nar-maven-plugin. Currently, nifi-nar-maven-plugin doesn’t use remote repositories, which was fixed in [1]. Though it is the only change since the last release, I consider it significant enough to