Hello we definitely want to work with you to get to the bottom of this. Doesn't sound like we're at the JIRA stage just yet as it is still a bit unclear what is happening.
We have recently updated the flow to include default settings which will make back pressure kick in which will help some. Looking at the gists you previously sent it looks like you probably have a 512MB heap (the default) or close to it and it looked like it was full. When you start seeing performance problems and sluggishness I suspect that GC issues may be the culprit. What size heap do you have and have you tried increasing it? To do a quick look at GC behavior while running the following command and its output is valuable run 'jps' See the PID of the 'NiFi' process run 'jstat -gcutil -h10 <PID of 'NiFi' process> 1000 20' If you could share that gist it would probably be revealing. Perhaps try that while things are looking good and while things are looking sluggish. Thanks Joe On Sat, Jun 25, 2016 at 3:48 AM, ddewaele <[email protected]> wrote: > That did the trick... I assumed it would be something like that, but assumed > it would apply sufficient back-pressure to stop the flow from getting > flooded.... > > With the 10000 x 100 approach things have stabilised, but I'm still seeing > frequent hangs in the UI, forcing me to restart Nifi (This usually happens > when I edit the flow, stop/start processors, deleting/editing/adding > connections). The refresh icon appears in the toolbar and sits there > forever. The date/time on the left of it remains stale. > > - At 1 point it "crashed" when all queues were empty and 90% of the flow was > stopped. I was simply modifying the flow (I did a copy - paste of a > processor, the refresh icon kicked in and remained there. cpu was spiking as > well). > > There was some logging in the logfiles but the ui / api were not responding. > > > > > Is this a known issue (perhaps with a JIRA ticket already created )? > > > > > > -- > View this message in context: > http://apache-nifi-developer-list.39713.n7.nabble.com/UI-can-take-a-very-long-time-to-become-available-tp12201p12246.html > Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
