At this point, would it be more advisable to attempt to split up the load? Has anyone had experience with running two separate instances of NFSEN on the same machine? My main concern here is I'm guessing this would disrupt the dddflow plugin we are using.
As it stands, we have 17 separate collector processes due to the port configurations (I've also attached our nfsen.conf). Would it be more beneficial to aggregate or split these up (or if that would have little to no affect) -----Original Message----- From: Brent Jones Sent: Tuesday, 13 June 2017 4:31 PM To: 'nfsen-discuss@lists.sourceforge.net' Subject: RE: [Nfsen-discuss] Stuttered Graphing in NFSEN I have noticed the following event, Get a few entries like this, Jun 13 16:25:01 nfsen nfcapd[11482]: Ident: 'device1' Flows: 14269, Packets: 174340000, Bytes: 132945000000, Sequence Errors: 22, Bad Packets: 0 Jun 13 16:25:01 nfsen nfcapd[11482]: Ident: 'device2' Flows: 210, Packets: 20070000, Bytes: 19666970000, Sequence Errors: 12, Bad Packets: 0 Jun 13 16:25:01 nfsen nfcapd[11482]: Ident: 'device3' Flows: 21618, Packets: 245700000, Bytes: 174133960000, Sequence Errors: 21, Bad Packets: 0 Followed by Jun 13 16:25:01 nfsen nfsen[11490]: nfsend: ERR Communication nfsend failed. Timeout on socket at /opt/nfsen/libexec/Nfcomm.pm line 1322, <$nfsen_sock> line 5. Jun 13 16:25:03 nfsen nfcapd[11488]: Update existing sampler id: 1, mode: 2, interval: 4096 Jun 13 16:25:04 nfsen nfcapd[11445]: Process_v9: Option field Type: 50, length 2 not supported Followed by a few Jun 13 16:25:06 nfsen systemd: Started Session 211 of user root. I'm not sure if this is usual operation? -----Original Message----- From: Brent Jones Sent: Tuesday, 13 June 2017 1:41 PM To: 'Jens Hektor'; nfsen-discuss@lists.sourceforge.net Subject: RE: [Nfsen-discuss] Stuttered Graphing in NFSEN Yes, getting a lot of the following messages: Jun 13 12:57:38 nfsen nfsen[14798]: Behind schedule Jun 13 13:03:37 nfsen nfsen[14798]: Behind schedule Jun 13 13:09:09 nfsen nfsen[14798]: Behind schedule Post CPU upgrade, CPU usage is remaining under 20% on average but the nfdump process hits 100% pretty regularily The disks are SSD over NFS. I haven't seen anything telling in the iowait but seems the next best target. I may have to look into using the local storage over NFS-SSD but I think these are 15k disks :( Thanks for taking the time to assist! -----Original Message----- From: Jens Hektor [mailto:hek...@itc.rwth-aachen.de] Sent: Tuesday, 13 June 2017 12:34 PM To: nfsen-discuss@lists.sourceforge.net Subject: Re: [Nfsen-discuss] Stuttered Graphing in NFSEN Do you get any output from fgrep schedu /var/log/messages 30 kflows/s is quite a number. Are your disks fast enough? (SSD or something rotating?) Too me it looks familiar when my CPUs do not process the RRDs in time. On 13.06.2017 03:49, Brent Jones wrote: > Hey guys, > > We've recently expanded our usage of NFSEN and we've noted the > following issues in our graph, > > [cid:image003.png@01D2E43B.0DE8CE10] > [cid:image004.png@01D2E43B.0DE8CE10] > > I've upped the processor count to 16 (up from 4) and set the profilers > to 16 but it's still happening. It also has $BUFFLEN = 10000000000; > > Does anyone have any suggestions about how I could resolve this? If you need > any extra config info, please let me know. > > Centos 7 > 16CPU, 4GB RAM > NFSEN 1.3.8 > nfcapd: Version: 1.6.15 Confidentiality: This email and any attachments are confidential and may be subject to copyright, legal or some other professional privilege. They are intended solely for the attention and use of the named addressee(s). They may only be copied, distributed or disclosed with the consent of the copyright owner. If you have received this email by mistake or by breach of the confidentiality clause, please notify the sender immediately by return email and delete or destroy all copies of the email. Any confidentiality, privilege or copyright is not waived or lost because this email has been sent to you by mistake.
nfsen.conf
Description: nfsen.conf
------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________ Nfsen-discuss mailing list Nfsen-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfsen-discuss
