Dear Carl > The new version (1.9.3 as of this writing) uses an IDO interface > with a FIFO to buffer the configuration when it's being written to > the database and thereby allows the main scheduling loop to start > more quickly. (Note that this has ramifications if you're using > Icinga Web; Web may go temporarily wonky while the database gets > rewritten while the CGI-based interface may look sane.) > > The sad answer here is to either upgrade to the new version or to > better schedule when/why restarts are allowed. We now updated the server to Wheezy and installed the icinga-backport, which is version 1.9.3.
Unfortunately the problem wasn't solved with this update. When reloading the Daemon some passive services get red but recover after a few minutes (some of them reach hard state before this happens). A restart is much worse, almost all of the passive services become red. Some facts which might be of interest: - We disabled performance data processing which improved but didn't solve the situation - The external commands check interval is set to -1, external_command_buffer_slots to 32768 - ido2db runs and is configured using the new module objects, it isn't enabled in icinga.cfg (as written in the comments) - /var/lib/icinga/spool/checkresults is tmpfs - On a restart it takes up to half an hour until all services become green again - There are 416 hosts and 2363 Services, more than half of them passive - When the "red phase" happens, we see in the logs that the external commands are read but there are no entries that these comamnds are translated to passive checks (which indicats that Icinga somehow can't handle the load of external commands) - The load (8 cores machine, 12GB ram) increases to 1.8 when it happens We also read the tuning page (http://docs.icinga.org/latest/en/tuning.html) but didn't find a way to solve our issue with it. Do you have an idea what could be the bottleneck? Kind regards Denis ------------------------------------------------------------------------------ October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60134071&iu=/4140/ostg.clktrk _______________________________________________ icinga-users mailing list icinga-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/icinga-users
