Re: [Nagios-users] Nagios check latency
I guess that depends on your definition of stable. I've been using it in large production environments for almost a year. Dan On Aug 20, 2013 9:43 PM, Muhamad Faiz muhamad.f...@asia.xchanging.com wrote: Hi Andreas Ericsson, Until it is in Stable release, we will not update it. I guess misconfiguration was done somewhere. Regards, Faiz -Original Message- From: Andreas Ericsson [mailto:a...@op5.se] Sent: Tuesday, August 13, 2013 5:10 PM To: Nagios Users List Cc: Muhamad Faiz Subject: Re: [Nagios-users] Nagios check latency On 2013-08-13 05:49, Muhamad Faiz wrote: Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Change to Nagios 4 and your latency will most likely go away. -- Andreas Ericsson andreas.erics...@op5.se OP5 AB www.op5.se Tel: +46 8-230225 Fax: +46 8-230231 Considering the successes of the wars on alcohol, poverty, drugs and terror, I think we should give some serious thought to declaring war on peace. CONFIDENTIALITY NOTICE: This message and any attachment are confidential and may also be privileged. If you are not the intended recipient of this e-mail you may not copy, forward, disclose or otherwise use it or any part of it in any form whatsoever. If you are not the intended recipient please telephone or e-mail the sender and delete this message and any attachment from your system. -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk ___ Nagios-users mailing list Nagios-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nagios-users ::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. ::: Messages without supporting info will risk being sent to /dev/null -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk___ Nagios-users mailing list Nagios-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nagios-users ::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. ::: Messages without supporting info will risk being sent to /dev/null
Re: [Nagios-users] Nagios check latency
Hi Andreas Ericsson, Until it is in Stable release, we will not update it. I guess misconfiguration was done somewhere. Regards, Faiz -Original Message- From: Andreas Ericsson [mailto:a...@op5.se] Sent: Tuesday, August 13, 2013 5:10 PM To: Nagios Users List Cc: Muhamad Faiz Subject: Re: [Nagios-users] Nagios check latency On 2013-08-13 05:49, Muhamad Faiz wrote: Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Change to Nagios 4 and your latency will most likely go away. -- Andreas Ericsson andreas.erics...@op5.se OP5 AB www.op5.se Tel: +46 8-230225 Fax: +46 8-230231 Considering the successes of the wars on alcohol, poverty, drugs and terror, I think we should give some serious thought to declaring war on peace. CONFIDENTIALITY NOTICE: This message and any attachment are confidential and may also be privileged. If you are not the intended recipient of this e-mail you may not copy, forward, disclose or otherwise use it or any part of it in any form whatsoever. If you are not the intended recipient please telephone or e-mail the sender and delete this message and any attachment from your system. -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk ___ Nagios-users mailing list Nagios-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nagios-users ::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. ::: Messages without supporting info will risk being sent to /dev/null
Re: [Nagios-users] Nagios check latency
Hi Phil, check_result_reaper_frequency=10 max_check_result_reaper_time=30 Regards, Faiz Monitoring From: Randal, Phil [mailto:phil.ran...@hoopleltd.co.uk] Sent: Tuesday, August 13, 2013 5:17 PM To: Nagios Users List Subject: Re: [Nagios-users] Nagios check latency What are your check_result_reaper_frequency and max_check_result_reaper_time set to? I use 3 and 15 respectively here. Cheers, Phil -- Phil Randal Infrastructure Engineer Hoople Ltd | Thorn Office Centre | Hereford HR2 6JT Tel: 01432 260415 | Email: phil.ran...@hoopleltd.co.ukmailto:phil.ran...@hoopleltd.co.uk From: Muhamad Faiz [mailto:muhamad.f...@asia.xchanging.com] Sent: 13 August 2013 04:49 To: Nagios Users List Subject: [Nagios-users] Nagios check latency Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Modification in my Nagios.cfg file is only as below. Other than this, is default. # MODIFIED admin_email=muhamad.f...@asia.xchanging.commailto:admin_email=muhamad.f...@asia.xchanging.com admin_pager=muhamad.f...@asia.xchanging.commailto:admin_pager=muhamad.f...@asia.xchanging.com translate_passive_host_checks=1 log_event_handlers=0 use_large_installation_tweaks=1 enable_environment_macros=0 enable_embedded_perl=0 use_embedded_perl_implicitly=0 max_concurrent_checks=1600 service_perfdata_file_processing_command=process-service-perfdata-file-pnp-bulk host_perfdata_file_processing_command=process-host-perfdata-file-pnp-bulk service_perfdata_file_processing_interval=60 host_perfdata_file_processing_interval=60 status_update_interval=40 # /usr/local/nagios/bin/nagios -s /usr/local/nagios/etc/nagios.cfg Nagios Core 3.5.0 Copyright (c) 2009-2011 Nagios Core Development Team and Community Contributors Copyright (c) 1999-2009 Ethan Galstad Last Modified: 03-15-2013 License: GPL Website: http://www.nagios.org Timing information on object configuration processing is listed below. You can use this information to see if precaching your object configuration would be useful. Object Config Source: Config files (uncached) OBJECT CONFIG PROCESSING TIMES (* = Potential for precache savings with -u option) -- Read: 0.415803 sec Resolve: 0.006900 sec * Recomb Contactgroups: 0.001862 sec * Recomb Hostgroups:3.819786 sec * Dup Services: 0.637380 sec * Recomb Servicegroups: 3.419804 sec * Duplicate:0.000417 sec * Inherit: 0.013748 sec * Recomb Contacts: 0.00 sec * Sort: 0.00 sec * Register: 0.616385 sec Free: 0.029930 sec TOTAL:8.962015 sec * = 7.899897 sec (88.15%) estimated savings RETENTION DATA TIMES -- Read and Process: 0.863815 sec TOTAL:0.863815 sec Timing information on configuration verification is listed below. CONFIG VERIFICATION TIMES (* = Potential for speedup with -x option) -- Object Relationships: 0.080360 sec Circular Paths: 0.001152 sec * Misc: 0.011244 sec TOTAL:0.092756 sec * = 0.001152 sec (1.2%) estimated savings EVENT SCHEDULING TIMES - Get service info:0.051265 sec Get host info info: 0.032301 sec Get service params: 0.10 sec Schedule service times: 0.002476 sec Schedule service events: 0.002514 sec Get host params: 0.00 sec Schedule host times: 0.000937 sec Schedule host events:0.001287 sec TOTAL: 0.090790 sec Projected scheduling information for host and service checks is listed below. This information assumes that you are going to start running Nagios with your current config files. HOST SCHEDULING INFORMATION --- Total hosts: 11753 Total scheduled hosts: 7 Host inter-check delay method: SMART Average host check interval: 300.00 sec Host inter-check delay: 42.86 sec Max host check spread: 30 min First scheduled check: Tue Aug 13 11:43:54 2013 Last scheduled check:Tue Aug 13 11:43:54 2013 SERVICE SCHEDULING INFORMATION --- Total services: 18662 Total scheduled services: 170 Service inter-check delay method: SMART Average service check interval: 535.76 sec Inter-check delay: 3.15 sec Interleave factor method: SMART Average services per host: 1.59 Service interleave factor: 1 Max service check spread: 30 min First scheduled check: Tue Aug 13 11:52:49 2013 Last scheduled check
Re: [Nagios-users] Nagios check latency
Hi Jim Avery, I do a lot of configuration recently so starting and stopping was done quite a lot as well. I guess two Nagios instance was running. Regards, Faiz From: Jim Avery [mailto:j...@jimavery.me.uk] Sent: Tuesday, August 13, 2013 9:14 PM To: nagios List Subject: Re: [Nagios-users] Nagios check latency On 13 Aug 2013 05:22, Muhamad Faiz muhamad.f...@asia.xchanging.commailto:muhamad.f...@asia.xchanging.com wrote: My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ... Any advice will be much appreciated. If you haven't stopped / started the nagios daemon lately, then do that (/etc/init.d/nagios stop then /etc/init.d/nagios start , NOT /etc/init.d/nagios reload). I find that after a couple of weeks the service check latency starts creeping up, and stopping/starting the nagios daemon sorts it. I hope that helps. Jim CONFIDENTIALITY NOTICE: This message and any attachment are confidential and may also be privileged. If you are not the intended recipient of this e-mail you may not copy, forward, disclose or otherwise use it or any part of it in any form whatsoever. If you are not the intended recipient please telephone or e-mail the sender and delete this message and any attachment from your system. -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk___ Nagios-users mailing list Nagios-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nagios-users ::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. ::: Messages without supporting info will risk being sent to /dev/null
Re: [Nagios-users] Nagios check latency
Hi Justin, Is this the right way to check this? I have stop and start back only one line exist now. I'm watching the latency now. [root@nagios ~]# ps faux | grep nagios.cfg root 21594 0.0 0.0 103244 832 pts/0S+ 10:42 0:00 \_ grep nagios.cfg nagios 29669 52.4 13.6 1677324 1095904 ? Rsl Aug13 6014:30 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21086 0.3 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21291 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21293 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21295 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21296 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21338 0.6 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21346 0.4 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21453 1.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21519 1.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21521 2.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21530 2.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21538 2.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21547 2.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21555 1.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21579 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21586 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21589 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21591 2.0 13.6 1677324 1094328 ? R10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg Regards, Faiz Monitoring -Original Message- From: Justin Pryzby [mailto:just...@norchemlab.com] Sent: Tuesday, August 13, 2013 9:51 PM To: nagios-users@lists.sourceforge.net Subject: Re: [Nagios-users] Nagios check latency Could you check that you're not accidentally running 2 nagios daemons? On Tue, Aug 13, 2013 at 03:49:19AM +, Muhamad Faiz wrote: Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Modification in my Nagios.cfg file is only as below. Other than this, is default. # MODIFIED admin_email=muhamad.f...@asia.xchanging.com admin_pager=muhamad.f...@asia.xchanging.com translate_passive_host_checks=1 log_event_handlers=0 use_large_installation_tweaks=1 enable_environment_macros=0 enable_embedded_perl=0 use_embedded_perl_implicitly=0 max_concurrent_checks=1600 service_perfdata_file_processing_command=process-service-perfdata-file -pnp-bulk host_perfdata_file_processing_command=process-host-perfdata-file-pnp-b ulk service_perfdata_file_processing_interval=60 host_perfdata_file_processing_interval=60 status_update_interval=40 # /usr/local/nagios/bin/nagios -s /usr/local/nagios/etc/nagios.cfg Nagios Core 3.5.0 Copyright (c) 2009-2011 Nagios Core Development Team and Community Contributors Copyright (c) 1999-2009 Ethan Galstad Last Modified: 03-15-2013 License: GPL Website: http://www.nagios.org Timing information on object configuration processing is listed below. You can use this information to see if precaching your object configuration would be useful. Object Config Source: Config files (uncached) OBJECT CONFIG PROCESSING TIMES (* = Potential for precache savings with -u option) -- Read: 0.415803 sec Resolve: 0.006900 sec * Recomb Contactgroups: 0.001862 sec * Recomb Hostgroups:3.819786 sec * Dup Services: 0.637380 sec * Recomb Servicegroups: 3.419804 sec * Duplicate:0.000417 sec
Re: [Nagios-users] Nagios check latency
I would have written: ps -fC nagios3 (but I guess your daemon is called nagios). Note that all the 2ndary lines are commands being run (checks, notifications). This will show only the parent scheduler processes: ps -O ppid -C nagios3 |awk '$2==1' Justin On Wed, Aug 21, 2013 at 02:49:27AM +, Muhamad Faiz wrote: Hi Justin, Is this the right way to check this? I have stop and start back only one line exist now. I'm watching the latency now. [root@nagios ~]# ps faux | grep nagios.cfg root 21594 0.0 0.0 103244 832 pts/0S+ 10:42 0:00 \_ grep nagios.cfg nagios 29669 52.4 13.6 1677324 1095904 ? Rsl Aug13 6014:30 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21086 0.3 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21291 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21293 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21295 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21296 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21338 0.6 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21346 0.4 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21453 1.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21519 1.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21521 2.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21530 2.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21538 2.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21547 2.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21555 1.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21579 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21586 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21589 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21591 2.0 13.6 1677324 1094328 ? R10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg Regards, Faiz Monitoring -Original Message- From: Justin Pryzby [mailto:just...@norchemlab.com] Sent: Tuesday, August 13, 2013 9:51 PM To: nagios-users@lists.sourceforge.net Subject: Re: [Nagios-users] Nagios check latency Could you check that you're not accidentally running 2 nagios daemons? On Tue, Aug 13, 2013 at 03:49:19AM +, Muhamad Faiz wrote: Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Modification in my Nagios.cfg file is only as below. Other than this, is default. # MODIFIED admin_email=muhamad.f...@asia.xchanging.com admin_pager=muhamad.f...@asia.xchanging.com translate_passive_host_checks=1 log_event_handlers=0 use_large_installation_tweaks=1 enable_environment_macros=0 enable_embedded_perl=0 use_embedded_perl_implicitly=0 max_concurrent_checks=1600 service_perfdata_file_processing_command=process-service-perfdata-file -pnp-bulk host_perfdata_file_processing_command=process-host-perfdata-file-pnp-b ulk service_perfdata_file_processing_interval=60 host_perfdata_file_processing_interval=60 status_update_interval=40 # /usr/local/nagios/bin/nagios -s /usr/local/nagios/etc/nagios.cfg Nagios Core 3.5.0 Copyright (c) 2009-2011 Nagios Core Development Team and Community Contributors Copyright (c) 1999-2009 Ethan Galstad Last Modified: 03-15-2013 License: GPL Website: http://www.nagios.org Timing information on object configuration processing is listed below. You can use this information to see if precaching your object configuration would be useful. Object Config Source
Re: [Nagios-users] Nagios check latency
One line, # ps -O ppid -C nagios | awk '$2==1' 22561 1 R ?00:07:02 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg Latency is OK now! # ./check_nagios_latency.sh -w 30 -c 60 OK: Latency at 3.388 seconds. | latency=3.388;30;60 Regards, Faiz -Original Message- From: Justin Pryzby [mailto:just...@norchemlab.com] Sent: Wednesday, August 21, 2013 11:30 AM To: Nagios Users List Subject: Re: [Nagios-users] Nagios check latency I would have written: ps -fC nagios3 (but I guess your daemon is called nagios). Note that all the 2ndary lines are commands being run (checks, notifications). This will show only the parent scheduler processes: ps -O ppid -C nagios3 |awk '$2==1' Justin On Wed, Aug 21, 2013 at 02:49:27AM +, Muhamad Faiz wrote: Hi Justin, Is this the right way to check this? I have stop and start back only one line exist now. I'm watching the latency now. [root@nagios ~]# ps faux | grep nagios.cfg root 21594 0.0 0.0 103244 832 pts/0S+ 10:42 0:00 \_ grep nagios.cfg nagios 29669 52.4 13.6 1677324 1095904 ? Rsl Aug13 6014:30 /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21086 0.3 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21291 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21293 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21295 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21296 0.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21338 0.6 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21346 0.4 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21453 1.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21519 1.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21521 2.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21530 2.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21538 2.5 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21547 2.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21555 1.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21579 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21586 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21589 4.0 13.6 1677328 1094340 ? S10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg nagios 21591 2.0 13.6 1677324 1094328 ? R10:42 0:00 \_ /usr/local/nagios/bin/nagios -d /usr/local/nagios/etc/nagios.cfg Regards, Faiz Monitoring -Original Message- From: Justin Pryzby [mailto:just...@norchemlab.com] Sent: Tuesday, August 13, 2013 9:51 PM To: nagios-users@lists.sourceforge.net Subject: Re: [Nagios-users] Nagios check latency Could you check that you're not accidentally running 2 nagios daemons? On Tue, Aug 13, 2013 at 03:49:19AM +, Muhamad Faiz wrote: Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Modification in my Nagios.cfg file is only as below. Other than this, is default. # MODIFIED admin_email=muhamad.f...@asia.xchanging.com admin_pager=muhamad.f...@asia.xchanging.com translate_passive_host_checks=1 log_event_handlers=0 use_large_installation_tweaks=1 enable_environment_macros=0 enable_embedded_perl=0 use_embedded_perl_implicitly=0 max_concurrent_checks=1600 service_perfdata_file_processing_command=process-service-perfdata-fi le -pnp-bulk host_perfdata_file_processing_command=process-host-perfdata-file-pnp -b ulk service_perfdata_file_processing_interval=60 host_perfdata_file_processing_interval=60 status_update_interval=40 # /usr/local
Re: [Nagios-users] Nagios check latency
On 2013-08-13 05:49, Muhamad Faiz wrote: Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Change to Nagios 4 and your latency will most likely go away. -- Andreas Ericsson andreas.erics...@op5.se OP5 AB www.op5.se Tel: +46 8-230225 Fax: +46 8-230231 Considering the successes of the wars on alcohol, poverty, drugs and terror, I think we should give some serious thought to declaring war on peace. -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ Nagios-users mailing list Nagios-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nagios-users ::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. ::: Messages without supporting info will risk being sent to /dev/null
Re: [Nagios-users] Nagios check latency
What are your check_result_reaper_frequency and max_check_result_reaper_time set to? I use 3 and 15 respectively here. Cheers, Phil -- Phil Randal Infrastructure Engineer Hoople Ltd | Thorn Office Centre | Hereford HR2 6JT Tel: 01432 260415 | Email: phil.ran...@hoopleltd.co.ukmailto:phil.ran...@hoopleltd.co.uk From: Muhamad Faiz [mailto:muhamad.f...@asia.xchanging.com] Sent: 13 August 2013 04:49 To: Nagios Users List Subject: [Nagios-users] Nagios check latency Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Modification in my Nagios.cfg file is only as below. Other than this, is default. # MODIFIED admin_email=muhamad.f...@asia.xchanging.commailto:admin_email=muhamad.f...@asia.xchanging.com admin_pager=muhamad.f...@asia.xchanging.commailto:admin_pager=muhamad.f...@asia.xchanging.com translate_passive_host_checks=1 log_event_handlers=0 use_large_installation_tweaks=1 enable_environment_macros=0 enable_embedded_perl=0 use_embedded_perl_implicitly=0 max_concurrent_checks=1600 service_perfdata_file_processing_command=process-service-perfdata-file-pnp-bulk host_perfdata_file_processing_command=process-host-perfdata-file-pnp-bulk service_perfdata_file_processing_interval=60 host_perfdata_file_processing_interval=60 status_update_interval=40 # /usr/local/nagios/bin/nagios -s /usr/local/nagios/etc/nagios.cfg Nagios Core 3.5.0 Copyright (c) 2009-2011 Nagios Core Development Team and Community Contributors Copyright (c) 1999-2009 Ethan Galstad Last Modified: 03-15-2013 License: GPL Website: http://www.nagios.org Timing information on object configuration processing is listed below. You can use this information to see if precaching your object configuration would be useful. Object Config Source: Config files (uncached) OBJECT CONFIG PROCESSING TIMES (* = Potential for precache savings with -u option) -- Read: 0.415803 sec Resolve: 0.006900 sec * Recomb Contactgroups: 0.001862 sec * Recomb Hostgroups:3.819786 sec * Dup Services: 0.637380 sec * Recomb Servicegroups: 3.419804 sec * Duplicate:0.000417 sec * Inherit: 0.013748 sec * Recomb Contacts: 0.00 sec * Sort: 0.00 sec * Register: 0.616385 sec Free: 0.029930 sec TOTAL:8.962015 sec * = 7.899897 sec (88.15%) estimated savings RETENTION DATA TIMES -- Read and Process: 0.863815 sec TOTAL:0.863815 sec Timing information on configuration verification is listed below. CONFIG VERIFICATION TIMES (* = Potential for speedup with -x option) -- Object Relationships: 0.080360 sec Circular Paths: 0.001152 sec * Misc: 0.011244 sec TOTAL:0.092756 sec * = 0.001152 sec (1.2%) estimated savings EVENT SCHEDULING TIMES - Get service info:0.051265 sec Get host info info: 0.032301 sec Get service params: 0.10 sec Schedule service times: 0.002476 sec Schedule service events: 0.002514 sec Get host params: 0.00 sec Schedule host times: 0.000937 sec Schedule host events:0.001287 sec TOTAL: 0.090790 sec Projected scheduling information for host and service checks is listed below. This information assumes that you are going to start running Nagios with your current config files. HOST SCHEDULING INFORMATION --- Total hosts: 11753 Total scheduled hosts: 7 Host inter-check delay method: SMART Average host check interval: 300.00 sec Host inter-check delay: 42.86 sec Max host check spread: 30 min First scheduled check: Tue Aug 13 11:43:54 2013 Last scheduled check:Tue Aug 13 11:43:54 2013 SERVICE SCHEDULING INFORMATION --- Total services: 18662 Total scheduled services: 170 Service inter-check delay method: SMART Average service check interval: 535.76 sec Inter-check delay: 3.15 sec Interleave factor method: SMART Average services per host: 1.59 Service interleave factor: 1 Max service check spread: 30 min First scheduled check: Tue Aug 13 11:52:49 2013 Last scheduled check: Tue Aug 13 11:58:39 2013 CHECK PROCESSING INFORMATION Check result reaper interval: 10 sec Max concurrent service checks: 1600 PERFORMANCE SUGGESTIONS --- I have no suggestions - things look okay. Any
Re: [Nagios-users] Nagios check latency
On 13 Aug 2013 05:22, Muhamad Faiz muhamad.f...@asia.xchanging.com wrote: My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ... Any advice will be much appreciated. If you haven't stopped / started the nagios daemon lately, then do that (/etc/init.d/nagios stop then /etc/init.d/nagios start , NOT /etc/init.d/nagios reload). I find that after a couple of weeks the service check latency starts creeping up, and stopping/starting the nagios daemon sorts it. I hope that helps. Jim -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ Nagios-users mailing list Nagios-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nagios-users ::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. ::: Messages without supporting info will risk being sent to /dev/null
Re: [Nagios-users] Nagios check latency
Could you check that you're not accidentally running 2 nagios daemons? On Tue, Aug 13, 2013 at 03:49:19AM +, Muhamad Faiz wrote: Hi guys, My Nagios setup are having high service check latency. Check nagios latency result is 240 seconds! ./check_nagios_latency.sh -w 30 -c 60 CRITICAL: Latency at 240.183 seconds! Modification in my Nagios.cfg file is only as below. Other than this, is default. # MODIFIED admin_email=muhamad.f...@asia.xchanging.com admin_pager=muhamad.f...@asia.xchanging.com translate_passive_host_checks=1 log_event_handlers=0 use_large_installation_tweaks=1 enable_environment_macros=0 enable_embedded_perl=0 use_embedded_perl_implicitly=0 max_concurrent_checks=1600 service_perfdata_file_processing_command=process-service-perfdata-file-pnp-bulk host_perfdata_file_processing_command=process-host-perfdata-file-pnp-bulk service_perfdata_file_processing_interval=60 host_perfdata_file_processing_interval=60 status_update_interval=40 # /usr/local/nagios/bin/nagios -s /usr/local/nagios/etc/nagios.cfg Nagios Core 3.5.0 Copyright (c) 2009-2011 Nagios Core Development Team and Community Contributors Copyright (c) 1999-2009 Ethan Galstad Last Modified: 03-15-2013 License: GPL Website: http://www.nagios.org Timing information on object configuration processing is listed below. You can use this information to see if precaching your object configuration would be useful. Object Config Source: Config files (uncached) OBJECT CONFIG PROCESSING TIMES (* = Potential for precache savings with -u option) -- Read: 0.415803 sec Resolve: 0.006900 sec * Recomb Contactgroups: 0.001862 sec * Recomb Hostgroups:3.819786 sec * Dup Services: 0.637380 sec * Recomb Servicegroups: 3.419804 sec * Duplicate:0.000417 sec * Inherit: 0.013748 sec * Recomb Contacts: 0.00 sec * Sort: 0.00 sec * Register: 0.616385 sec Free: 0.029930 sec TOTAL:8.962015 sec * = 7.899897 sec (88.15%) estimated savings RETENTION DATA TIMES -- Read and Process: 0.863815 sec TOTAL:0.863815 sec Timing information on configuration verification is listed below. CONFIG VERIFICATION TIMES (* = Potential for speedup with -x option) -- Object Relationships: 0.080360 sec Circular Paths: 0.001152 sec * Misc: 0.011244 sec TOTAL:0.092756 sec * = 0.001152 sec (1.2%) estimated savings EVENT SCHEDULING TIMES - Get service info:0.051265 sec Get host info info: 0.032301 sec Get service params: 0.10 sec Schedule service times: 0.002476 sec Schedule service events: 0.002514 sec Get host params: 0.00 sec Schedule host times: 0.000937 sec Schedule host events:0.001287 sec TOTAL: 0.090790 sec Projected scheduling information for host and service checks is listed below. This information assumes that you are going to start running Nagios with your current config files. HOST SCHEDULING INFORMATION --- Total hosts: 11753 Total scheduled hosts: 7 Host inter-check delay method: SMART Average host check interval: 300.00 sec Host inter-check delay: 42.86 sec Max host check spread: 30 min First scheduled check: Tue Aug 13 11:43:54 2013 Last scheduled check:Tue Aug 13 11:43:54 2013 SERVICE SCHEDULING INFORMATION --- Total services: 18662 Total scheduled services: 170 Service inter-check delay method: SMART Average service check interval: 535.76 sec Inter-check delay: 3.15 sec Interleave factor method: SMART Average services per host: 1.59 Service interleave factor: 1 Max service check spread: 30 min First scheduled check: Tue Aug 13 11:52:49 2013 Last scheduled check: Tue Aug 13 11:58:39 2013 CHECK PROCESSING INFORMATION Check result reaper interval: 10 sec Max concurrent service checks: 1600 PERFORMANCE SUGGESTIONS --- I have no suggestions - things look okay. Any advice will be much appreciated. Regards, Faiz CONFIDENTIALITY NOTICE: This message and any attachment are confidential and may also be privileged. If you are not the intended recipient of this e-mail you may not copy, forward, disclose or otherwise use it or any part of it in any form
