Robert, since 7.5.5 added the ability for imudp to use multiple threads, could
you please give it a try with 2 threads on the input?
I expect that you will see rsyslog receiving all 395K messages each second with
this change.
Then we can go back to tuning the output and applying your filters.
David Lang
On Thu, 10 Oct 2013, David Lang wrote:
Date: Thu, 10 Oct 2013 13:25:01 -0700 (PDT)
From: David Lang <[email protected]>
Reply-To: rsyslog-users <[email protected]>
To: Robert <[email protected]>
Cc: rsyslog-users <[email protected]>
Subject: Re: [rsyslog] Tr : Re: perfomance tweaking (fwd)
Ok, this looks like it's giving good information
One more test I would like to try is to comment out the action, so there is
no output, only the input and pstats.
Also, do you have a different mail client you can use? the one you are using
has two problems
1. every time you reply to a message it starts a new thread (it's not
maintaining the right headers)
2. when you reply to a message, your mail client eliminates all formatting of
the message, putting it all in one big lump of text
This makes it very hard to help you.
David Lang
On Thu, 10 Oct 2013, Robert wrote:
Date: Thu, 10 Oct 2013 15:40:06 -0400
From: Robert <[email protected]>
To: David Lang <[email protected]>
Cc: rsyslog-users <[email protected]>, rmkml <[email protected]>
Subject: Re: [rsyslog] Tr : Re: perfomance tweaking (fwd)
David,
Attached are the results when resetCounters are enabled:
module(load="imuxsock") # needs to be done just once Roberto 8-9-13
module(load="imklog")
module(load="impstats"
interval="10"
log.syslog="off"
log.file="/var/log/pstats"
resetCounters="on")
----- Original Message -----
From: David Lang
Sent: 10/10/13 12:55 PM
To: Rainer Gerhards
Subject: Re: [rsyslog] Tr : Re: perfomance tweaking (fwd)
Ok, let's do one test to check for overhead of resetcounters and then use
them, it makes it much easier for me to see what's going on. David Lang On
Thu, 10 Oct 2013, Rainer Gerhards wrote: > David, > > FYI: the delta stats
summed up. It was me mis-reading the values -- > actually I got the size
wrong by one magnitude ;) > > Rainer > > > On Thu, Oct 10, 2013 at 6:14 PM,
David Lang <[email protected]> wrote: > >> by the way, the following command
line may help you see what's happeing >> (with relative stats) >> >> grep
imudp pstats |grep -v "=0" >> >> grep imudp pstats |grep -v "=0" >> >>
Also, when we are writing out to /dev/null, let's make a run with ziplevel
>> and asyncwrite removed (since they only benefit us by saving I/O and
moving >> it to a different thread) >> >> >> David Lang >> >> On Thu, 10
Oct 2013, Robert wrote: >> >> Date: Thu, 10 Oct 2013 09:46:38 -0400 >>>
From: Robert <[email protected]> >>> To: Rainer Gerhards
<[email protected]> >>> Cc: David Lang <dav!
[email protected]>, rsyslog-users <[email protected] >>>> , >>> rmkml
<[email protected]> >>> Subject: Re: [rsyslog] Tr : Re: perfomance tweaking
(fwd) >>> >>> These are the results with 1000 for both timeREquery and
batchsize, >>> writing out to /dev/null >>> >>> ----- Original Message -----
From: Rainer Gerhards >>> Sent: 10/10/13 08:48 AM >>> To: Robert >>>
Subject: Re: [rsyslog] Tr : Re: perfomance tweaking (fwd) >>> >>> umm.. again
the ML thread is broken :-( >>> >>> On Thu, Oct 10, 2013 at 2:43 PM, Robert <
[email protected] > wrote:From >>> the documentation does that mean that I
should lessen my timeRequery and >>> batchSize? to something lower ? >>> >>>
A relatively large batch size is a good thing. I would be conservative >>>
with timeRequery in a large batch environment. As I wrote in the doc, I'd >>>
recommend not to go higer than 10. >>> >>> Rainer >>> >>> Robert. >>> >>> >>>
>>> >>> Robert. >>> >> >
Robert.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
