Re: Where are my processes?
Hi, I did check if there was any GC issue going on using VisualVM and didn't see anything obvious. I will try to take a dump and dig for information thanks for the suggestion. I really appreciate it Jean-Sébastien Vachon Co-Founder & Architect Brizo Data, Inc. www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com> From: Mark Payne Sent: Monday, March 28, 2022 7:56 PM To: users@nifi.apache.org Subject: Re: Where are my processes? Jean-Sebastian, I’d recommend grabbing a thread dump (bin/nifi.sh dump dump1.txt) and check the thread dump to see what the processors are doing. Would also grep logs for “waiting for” to see if it shows anything. Thanks -Mark Sent from my iPhone On Mar 28, 2022, at 7:27 PM, Jean-Sebastien Vachon wrote: Some additional information as I haven't found what's happening. The average task time is about 15 seconds.. Is there any reason why the process wouldn't show up in top or ps? I setup a watch updated every 1s and I can see at most a few instances of my process. I ramped up to 35 concurrent processes and I saw a few more processes but with an average of 15 s, I was expecting to see way more than a few. Any thoughts? Jean-Sébastien Vachon Co-Founder & Architect Brizo Data, Inc. www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com> From: Jean-Sebastien Vachon Sent: Friday, March 25, 2022 9:40 AM To: users@nifi.apache.org Subject: Where are my processes? Hi all, A strange thing seems to be happening on my server this morning I can't find the processes reported by Nifi. Nifi shows 15 running processes for one of my processor (ExecuteStreamCommand with Python script) but when I look at the OS, I can see at most 2 of them. I understand that very short-lived processes will be harder to spot at the OS level but the discrepancy seems too large to make any sense. If I stop the processor, It takes a good minute for any activity to stop but I can't see anything in the list of processes. My throughput is also 4-5 times slower than usual with that processor. There does not seem to be any issue with GC and the global setting for maximum thread count is set to 600 (I went from 500 to 600 with no effect). There is nothing else running in Nifi on this server at the moment. Any idea? I'm using Nifi 1.13.2 Thanks
Re: Where are my processes?
Jean-Sebastian, I’d recommend grabbing a thread dump (bin/nifi.sh dump dump1.txt) and check the thread dump to see what the processors are doing. Would also grep logs for “waiting for” to see if it shows anything. Thanks -Mark Sent from my iPhone On Mar 28, 2022, at 7:27 PM, Jean-Sebastien Vachon wrote: Some additional information as I haven't found what's happening. The average task time is about 15 seconds.. Is there any reason why the process wouldn't show up in top or ps? I setup a watch updated every 1s and I can see at most a few instances of my process. I ramped up to 35 concurrent processes and I saw a few more processes but with an average of 15 s, I was expecting to see way more than a few. Any thoughts? Jean-Sébastien Vachon Co-Founder & Architect Brizo Data, Inc. www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com> From: Jean-Sebastien Vachon Sent: Friday, March 25, 2022 9:40 AM To: users@nifi.apache.org Subject: Where are my processes? Hi all, A strange thing seems to be happening on my server this morning I can't find the processes reported by Nifi. Nifi shows 15 running processes for one of my processor (ExecuteStreamCommand with Python script) but when I look at the OS, I can see at most 2 of them. I understand that very short-lived processes will be harder to spot at the OS level but the discrepancy seems too large to make any sense. If I stop the processor, It takes a good minute for any activity to stop but I can't see anything in the list of processes. My throughput is also 4-5 times slower than usual with that processor. There does not seem to be any issue with GC and the global setting for maximum thread count is set to 600 (I went from 500 to 600 with no effect). There is nothing else running in Nifi on this server at the moment. Any idea? I'm using Nifi 1.13.2 Thanks
Re: Where are my processes?
Some additional information as I haven't found what's happening. The average task time is about 15 seconds.. Is there any reason why the process wouldn't show up in top or ps? I setup a watch updated every 1s and I can see at most a few instances of my process. I ramped up to 35 concurrent processes and I saw a few more processes but with an average of 15 s, I was expecting to see way more than a few. Any thoughts? Jean-Sébastien Vachon Co-Founder & Architect Brizo Data, Inc. www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com> From: Jean-Sebastien Vachon Sent: Friday, March 25, 2022 9:40 AM To: users@nifi.apache.org Subject: Where are my processes? Hi all, A strange thing seems to be happening on my server this morning I can't find the processes reported by Nifi. Nifi shows 15 running processes for one of my processor (ExecuteStreamCommand with Python script) but when I look at the OS, I can see at most 2 of them. I understand that very short-lived processes will be harder to spot at the OS level but the discrepancy seems too large to make any sense. If I stop the processor, It takes a good minute for any activity to stop but I can't see anything in the list of processes. My throughput is also 4-5 times slower than usual with that processor. There does not seem to be any issue with GC and the global setting for maximum thread count is set to 600 (I went from 500 to 600 with no effect). There is nothing else running in Nifi on this server at the moment. Any idea? I'm using Nifi 1.13.2 Thanks
Where are my processes?
Hi all, A strange thing seems to be happening on my server this morning I can't find the processes reported by Nifi. Nifi shows 15 running processes for one of my processor (ExecuteStreamCommand with Python script) but when I look at the OS, I can see at most 2 of them. I understand that very short-lived processes will be harder to spot at the OS level but the discrepancy seems too large to make any sense. If I stop the processor, It takes a good minute for any activity to stop but I can't see anything in the list of processes. My throughput is also 4-5 times slower than usual with that processor. There does not seem to be any issue with GC and the global setting for maximum thread count is set to 600 (I went from 500 to 600 with no effect). There is nothing else running in Nifi on this server at the moment. Any idea? I'm using Nifi 1.13.2 Thanks
