[Bug 58871] Set up Icinga monitoring for mail queue
https://bugzilla.wikimedia.org/show_bug.cgi?id=58871 Tim Landscheidt t...@tim-landscheidt.de changed: What|Removed |Added Status|PATCH_TO_REVIEW |NEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 58871] Set up Icinga monitoring for mail queue
https://bugzilla.wikimedia.org/show_bug.cgi?id=58871 --- Comment #3 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 143111 had a related patch set uploaded by Yuvipanda: toollabs: Send exim queue length to graphite https://gerrit.wikimedia.org/r/143111 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 58871] Set up Icinga monitoring for mail queue
https://bugzilla.wikimedia.org/show_bug.cgi?id=58871 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|NEW |PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 58871] Set up Icinga monitoring for mail queue
https://bugzilla.wikimedia.org/show_bug.cgi?id=58871 --- Comment #4 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 143111 merged by coren: toollabs: Send exim queue length to graphite https://gerrit.wikimedia.org/r/143111 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 58871] Set up Icinga monitoring for mail queue
https://bugzilla.wikimedia.org/show_bug.cgi?id=58871 --- Comment #2 from Tim Landscheidt t...@tim-landscheidt.de --- Also, /var/log/exim4/panic should either be empty or not exist. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 58871] Set up Icinga monitoring for mail queue
https://bugzilla.wikimedia.org/show_bug.cgi?id=58871
--- Comment #1 from Tim Landscheidt t...@tim-landscheidt.de ---
Some lessons learned from cleaning the stuck queues:
- We need to check the queues on *every* host, not just tools-mail. We could
use different thresholds for tools-mail and the rest as the latter only needs
to talk to tools-mail, but I don't think that's necessary.
- Sometimes there are leftovers in /var/spool/exim4/{input,msglog} that are
results of exim hiccups (OOM?) where only -D or only -H files exist.
Correlating them with the queue is hard; easier: Check for any files there that
are older than the Icinga threshold + x days. This will not detect hiccups
instantly, but not *so* late.
--
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
