On 11/25/2013 12:18 AM, David Lang wrote:
On Mon, 25 Nov 2013, Pavel Levshin wrote:
Date: Mon, 25 Nov 2013 12:05:15 +0400
From: Pavel Levshin <[email protected]>
Reply-To: rsyslog-users <[email protected]>
To: [email protected]
Subject: Re: [rsyslog] Rsyslog with RELP not sending/receiving
messages for
long intervals
23.11.2013 7:01, Erik Steffl:
Another possibly interesting message is:
7975.038523942:7fe2064cf700: main Q: doEnqSingleObject: LightDelay
mark reached for light delayable message - blocking a bit.
which was received approximately once per second during following
interval (this is also when the traffic went down to zero):
1385087975 Fri Nov 22 02:39:35 UTC 2013
1385088546 Fri Nov 22 02:49:06 UTC 2013
Does this shed any light on what's going on?
I bet this is the problem. This blocks main queue for a second.
There are possible workarounds, including increasing main queue size
(this watermark is set to 70% by default).
searching through the documentation, this seems to be a tcp input option
old style
$InputTCPFlowControl defaults on set to off to disable
new style
FlowControl='off' on the module load
is this for RELP too? We don't use tcp module at all, these are the
loaded modules:
ubuntu@domU-12-31-39-06-75-11:~$ grep -E '^\$ModLoad|module'
/etc/rsyslog.conf /etc/rsyslog.d/*
/etc/rsyslog.conf:$ModLoad imuxsock # provides support for local system
logging
/etc/rsyslog.conf:$ModLoad imklog # provides kernel logging support
(previously done by rklogd)
/etc/rsyslog.d/31-yummly.conf:module(load="mmjsonparse")
/etc/rsyslog.d/31-yummly.conf:module(load="omrelp")
/etc/rsyslog.d/31-yummly.conf:module(load="imudp")
/etc/rsyslog.d/41-yummly-collector.conf:module(load="mmjsonparse")
/etc/rsyslog.d/41-yummly-collector.conf:module(load="imrelp"
ruleset="collector")
On the affected system the bursts are coming over /dev/log and going
out over RELP, steady traffic is coming via RELP and going into set of
files.
erik
it still seems wrong that this triggers problems for such a long time.
unless some output is blocking and causing the queue to not drain, it
seems like it shoudl very quicly open up again.
David Lang
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
