Re: The mystery of ListSFTP that stops working

Hey Mark, Changing the scheduling doesn't seem to make a difference. I have noticed some instances where a nifi.sh dump causes a switch of the primary node and that unleashes the stuck processor but still not clear why it happens. I took a thread dump of the primary node while the thing was

Automated Testing of Flows

I would like to find a way to automatically run integration/upgrade tests on flows, rather than just one or two processors like the mock framework supports. Preferably something Template driven, where I can provide a template xml file, and an accompanying config file to setup the test, then run

Re: The mystery of ListSFTP that stops working

Andre, So I am guessing that backpressure is not an issue then if you're not seeing it run :) Have you tried reducing the scheduling period from 5 mins to something like 5 seconds? Of course, you may not want to actually be running it every 5 seconds in a production environment, but I am

Re: The mystery of ListSFTP that stops working

Mark, Timer driven, Primary Node, 5 min Yield is set to 1 sec Backpressure = 10k flows or 1GB nifi.administrative.yield.duration=30 sec Cheers On Thu, Nov 16, 2017 at 1:32 AM, Mark Payne wrote: > Hey Andre, > > I have not seen this personally. Can you share how you have

Re: The mystery of ListSFTP that stops working

Hey Andre, I have not seen this personally. Can you share how you have the Scheduling Tab configured? Is it set to Timer-Driven with a period of "0 secs"? Also, what is the Yield Duration set to? Is there any backpressure configured on any of the outbound connections? Additionally, what is the

Re: [DISCUSS] Apache NiFi MiNiFi C++ 0.3.0

Everyone, I've been getting through some apache LDAP issues, hence the delay; however, we do have three remaining issues -- https://issues.apache.org/jira/projects/MINIFICPP/versions/12341640. One is still under development. We can move it, but that would mean we can't compile in CENTOS 6.

Re: The mystery of ListSFTP that stops working

Same behavior seen with putHbase processor. Nifi restart was only fix. Would like to see root cause and way to get control of processor without nifi-restart. > Op 15 nov. 2017 om 10:58 heeft Andre het volgende > geschreven: > > Folks, > > Has anyone ever seen a

The mystery of ListSFTP that stops working

Folks, Has anyone ever seen a situation where ListSFTP simply stops working? I have observed a few occurrences of seems to be some weird bug. Symptoms are: - Processor looks healthy (i.e. no bulletins) - State is stalled (i.e. no changes to new files or timestamps) - No signs of a stuck thread