On Fri, 20 Sep 2013, Robert wrote:

Hello Everyone,

So I went ahead and made those changes

# Provides UDP syslog reception
module(load="imudp"
TimeRequery="10"
SchedulingPolicy="fifo"
SchedulingPriority="10") # needs to be done just once
input(type="imudp" port="514")

that looks right

When I added the actionqueue on each of the logs, it queued alot of them and 
the cpu took a big hit:

that's expected splitting things into lots of queues adds significant CPU overhead. since there is only one action for each queue, you definantly don't want 8 threads per queue.


I have added the old syntax because Im not sure how to write with the new sytanx? whenever I write it it doesnt perform as well as the old syntax but this is my current configuration file and I am currently emulating 250k mps and Im logging about 245k mps. Do you see any other things on the config that I could change to stabilize the logs? After reading the action/main queue, omiobuffers, and queue sizes, its getting a little mixed up, Im not sure which I should change to improve my system. Thanks for all the help everyone

what does the per-thread CPU utilization look like (top with the H flag)?

I would also want to know what it looks like if you remove all of the actionqueue clauses.

David Lang



# Set Main Message Queue Size - default is 10000
$MainMsgQueueType FixedArray #LinkedList
$MainMsgQueueSize 20000000
$MainMsgQueueWorkerThreads 8
#$MainMsgQueueWorkerTimeoutThreadShutdown -1
$MainMsgQueueDequeueBatchSize 1000
#$MainMsgQueueSaveOnShutdown on
$InputUDPMaxSessions 40000000

#### RULES ####

$ActionQueueWorkerThreads 8
#$ActionQueueSize 10000000
$ActionQueueType FixedArray #LinkedList - use asynchronous processing
$OMFileAsyncWriting on
#$OMFileFlushOnTXEnd on
$OMFileIOBufferSize 1000k

:hostname, contains, "fdfw" /logs/f_fw
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of 
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE 
THAT.

Reply via email to