Hi all,
rsyslog version:rsyslog-8.15.0-1.el6.x86_64
CentOS 6.4
I have a problem when I using rsyslog to forwarding my app log to kafka, I
found the rsyslog process will crash after few hours every time.
The crash messages from dmesg is:
in:imfile[2243] trap divide error ip:7fee5a6ab85a sp:7fee56e05130 error:0
in rsyslogd[7fee5a678000+8e000]
in:imfile[10460] trap divide error ip:7f416858685a sp:7f4164ce0130 error:0
in rsyslogd[7f4168553000+8e000]
in:imfile[8276] trap divide error ip:7f757bff785a sp:7f7578751130 error:0
in rsyslogd[7f757bfc4000+8e000]
in:imfile[1612] trap divide error ip:7f61bd75685a sp:7f61b9eb0130 error:0
in rsyslogd[7f61bd723000+8e000]
My rsyslog.conf is configured as below:
module(load="imfile" PollingInterval="5")
module(load="omkafka")
$WorkDirectory /var/lib/rsyslog
input(type="imfile" File="/usr/local/tomcat6/logs/app1/log4j.log"
Tag="app1:" Severity="info" Facility="local0"
startmsg.regex="[0-9]{4}(-[0-9]{2}){2}")
local0.* action(type="omkafka" topic="misc"
broker="elkkafka1.p.example:9092,elkkafka2.p.example:9092,elkkafka3.p.example:9092"
partitions.auto="on"
confParam=["compression.codec=snappy","socket.keepalive.enable=true"]
queue.spoolDirectory="/usr/local/" queue.filename="rsyslogq"
queue.saveonshutdown="on" queue.size="1000000" queue.type="LinkedList"
queue.highwatermark="600000" queue.lowwatermark="20000"
queue.discardmark="800000" queue.maxfilesize="1g" queue.maxdiskspace="10g"
action.ResumeInterval="10" action.ResumeRetryCount="-1"
action.reportSuspension="on" action.reportSuspensionContinuation="on")
and the log4j-app.properties:
log4j.rootLogger =
INFO,consoleAppender,fileAppender,warnAppender,errorAppender
log4j.logger.org.hibernate=ERROR
log4j.logger.org.springframework=INFO
log4j.logger.kafka=WARN
log4j.logger.org.apache.mina=ERROR
log4j.logger.org.apache.zookeeper=WARN
log4j.logger.com.hikvision.messageserver=WARN
log4j.logger.com.hikvision.zookeeper=INFO
log4j.logger.com.alibaba.dubbo.monitor.dubbo=FATAL
#Console log
log4j.appender.consoleAppender = org.apache.log4j.ConsoleAppender
log4j.appender.consoleAppender.layout = org.apache.log4j.PatternLayout
log4j.appender.consoleAppender.layout.ConversionPattern = %d [%t] %5p %c{1}
- %m%n
#File Log
log4j.appender.fileAppender = org.apache.log4j.RollingFileAppender
log4j.appender.fileAppender.File=../logs/app1/log4j.log
log4j.appender.fileAppender.Append=true
log4j.appender.fileAppender.MaxFileSize=300MB
log4j.appender.fileAppender.MaxBackupIndex=2
log4j.appender.fileAppender.layout=org.apache.log4j.PatternLayout
log4j.appender.fileAppender.layout.ConversionPattern = %d [%t] %5p %c{1} -
%m%n
Anyone can help me to figure out this problem?
Thanks
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
