Hi
I noticed that sometimes, LiveStatus stopped being updated while all
other components of shinken are still fully functional.
I also noticed that when this happens, the brokerd consumes more and
more memory, until it's OOM-killed. I understand the latter is caused by
brokerd queuing events for livestatus. Maybe the broker should decide to
restart a module that has more than 'x' queued events, with 'x' being
configurable ?
Excerpt from broker.debug :
Begin Loop : managing old broks 23
External Queue len (Livestatus) : 0
External Queue len (NPCD) : 0
External Queue len (WebUI) : 0
Begin Loop : managing old broks 0
External Queue len (Livestatus) : 0
External Queue len (NPCD) : 0
External Queue len (WebUI) : 0
Traceback (most recent call last):
File
"/usr/local/lib/python2.6/dist-packages/multiprocessing-2.6.2.1-py2.6-linux-x86_64.egg/multiprocessing/queues.py",
line 242, in _feed
send(obj)
RuntimeError: dictionary changed size during iteration
Begin Loop : managing old broks 20
External Queue len (Livestatus) : 19
External Queue len (NPCD) : 13
External Queue len (WebUI) : 10
Begin Loop : managing old broks 0
External Queue len (Livestatus) : 20
External Queue len (NPCD) : 0
External Queue len (WebUI) : 0
Begin Loop : managing old broks 8
External Queue len (Livestatus) : 37
External Queue len (NPCD) : 0
External Queue len (WebUI) : 0
Begin Loop : managing old broks 3
External Queue len (Livestatus) : 61
External Queue len (NPCD) : 0
External Queue len (WebUI) : 0
moving perfdata_file /var/spool/pnp4nagios/nagios/perfdata.dump (113
lines) to /var/lib/shinken/perfdata/perfdata.1319745592
Begin Loop : managing old broks 16
External Queue len (Livestatus) : 77
External Queue len (NPCD) : 0
External Queue len (WebUI) : 0
--
Vincent RIQUER - Équipe Exploitation - B2F-CONCEPT
------------------------------------------------------------------------------
The demand for IT networking professionals continues to grow, and the
demand for specialized networking skills is growing even more rapidly.
Take a complimentary Learning@Cisco Self-Assessment and learn
about Cisco certifications, training, and career opportunities.
http://p.sf.net/sfu/cisco-dev2dev
_______________________________________________
Shinken-devel mailing list
Shinken-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/shinken-devel
