Hi all, just wanted to follow up on my results with performance tweaking
here:
I resolved my pdns issue and log delay/loss issue with the following
changes:
1. Disabled imux socket rate limiting (this seemed to have the most
effect on stopping the loss of messages, on the pdns server I found
through debugging to have been losing about 1,000 msgs every few seconds
to this and the other default queue timeout settings. The delay on the
pdns server was enough to cause pdns to stop working within an hr of
reboot.):
#Disable imuxsock rate limit
$IMUXSockRateLimitInterval 0
$SystemLogRateLimitInterval 0
2. Changed the queue types, timeouts, and limits to ensure it was
caching to disk so I wouldnt lose any messages on MainQueue
(client/server) and also all ActionQueue on client.
$MainMsgQueueFileName client_main_queue
$MainMsgQueueType LinkedList
$MainMsgQueueSaveOnShutdown on
$MainMsgQueueMaxFileSize 1,000M
$MainMsgQueueTimeoutActionCompletion 10,000
$MainMsgQueueTimeoutEnqueue 10,000
$MainMsgQueueDiscardMark 80,000
$MainMsgQueueSize 100,000
$ActionQueueType LinkedList
$ActionQueueFileName clientlocal_messages
$ActionResumeRetryCount -1
$ActionQueueSaveOnShutdown on
$ActionQueueMaxFileSize 500M
$ActionQueueTimeoutActionCompletion 10,000
$ActionQueueTimeoutEnqueue 10,000
$ActionQueueSize 20,000
$ActionQueueDiscardMark 18,000
Only thing I havent determined now is why my rsyslogd server process is
stuck at 100% cpu.
Hope this helps resolve your issue.
Thanks,
On 05/22/2012 11:27 AM, Rainer Gerhards wrote:
Excellent, small config is always good! I'll try to reproduce this tomorrow
morning. Thanks for your persistence!
Rainer
-----Original Message-----
From: [email protected] [mailto:rsyslog-
[email protected]] On Behalf Of Marcin Miroslaw
Sent: Tuesday, May 22, 2012 5:25 PM
To: [email protected]
Subject: Re: [rsyslog] rsyslog-5.8.11 omit syncing is always on?
W dniu 22.05.2012 13:48, Rainer Gerhards pisze:
Hi Folks,
just to break the silence: this issue is on my list of things to look
at. As
usual, it's just quite busy (and thankfully with paid work as well),
so this
waits on a timeslot...
Hi!
I know you have many work. I asked Julio about his use case because i
have a little problem to reproduce situation on test box.
Now meseems i can reproduce problem with maximally stripped config
file[1].
This steps should allow to reproduce situation:
1. start rsyslog with given config
2. cat "some text file, a several dozen of lines should be enough">>
/var/log/exim/exim_main.log
3. try to use logger and log any message
4. if it works wait sometime, eventually repeat step 2
5. try to use logger
David, you didn't hit such problem because you probably doesn't monitor
files and send logs via relp. (In my tests it looks like both situation
are needed: filemonitor and sending via relp).
Regards,
Marcin
[1] - config file:
$ModLoad immark.so
$ModLoad imuxsock.so
$ModLoad imklog.so
$ModLoad imrelp.so
$ModLoad omrelp.so
$ModLoad imfile
$WorkDirectory /var/spool/rsyslog
$ActionQueueType LinkedList
$ActionQueueFileName dbq
$ActionResumeRetryCount -1
$MainMsgQueueMaxDiskSpace 312M
$MainMsgQueueSaveOnShutdown on
$MainMsgQueueCheckpointInterval 80
$MainMsgQueueSyncQueueFiles on
$MainMsgQueueTimeoutShutdown 10000
$InputFileName /var/log/exim/exim_main.log
$InputFileTag meteor.exim_main:
$InputFileStateFile meteor.exim_main
$InputFileFacility mail
$InputFilePollInterval 1
$InputRunFileMonitor
*.* :omrelp:10.10.100.101:20514
*.* /var/log/wszystko.log
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
