The package I installed is 5.8.10-6.el6.x86_64. That's what shipped with CentOS 6.4 x64
On Wed, Nov 6, 2013 at 9:41 AM, Pavel Levshin <[email protected]> wrote: > > What version of rsyslog are you using? > > > -- > Pavel Levshin > > 06.11.2013 21:02, G Jones: > >> I left rsyslog running overnight to see if it stopped writing to the >> file again, the last entry it shows happened at 16:49.56, I used kill >> -HUP and after the process finally stopped I rechecked the file. >> Nothing changed. However, I didn't realize that, for some reason, >> rsyslog decided that 16:49 was the end of a day and created a new file >> dated for 11/6 with it's first entry starting at 16:50 on 11/5 (which >> will need to be addressed as well since this also happened with my >> last config). I checked the newly created (though incorrectly dated) >> file and the last entry it shows is for 2013-11-05 at 18:23:52. On the >> relay side, I've checked my SIEM and the last received entry came in >> right before I sent rsyslog the kill command. >> >> What I fail to see here is why rsyslog will relay messages but not >> write those same messages to a file or simply stop writing them all >> together. Then there's the issue of what constitutes the end of a day >> before rsyslog creates a new file. >> >> On Tue, Nov 5, 2013 at 5:19 PM, David Lang <[email protected]> wrote: >>> >>> some of it is probably buffering on the output, if you send rsyslog a >>> kill >>> -HUP it will flush all data and close the files. Check and see if this >>> gets >>> the data in them as you expect. >>> >>> David Lang >>> >>> On Tue, 5 Nov 2013, G Jones wrote: >>> >>>> Date: Tue, 5 Nov 2013 16:25:03 -0800 >>>> From: G Jones <[email protected]> >>>> Reply-To: rsyslog-users <[email protected]> >>>> To: [email protected] >>>> Subject: [rsyslog] rsyslog writing to file lagging behind relayed logs >>>> >>>> >>>> Hello, new to the list and to Rsyslog. >>>> >>>> I have an Rsyslog machine I'm standing up on CentOS x64 to replace >>>> some Kiwi log servers. I need to be able to receive syslog on TCP and >>>> UDP, relay them to my SIEM and also store those logs locally on each >>>> Rsyslog machine. Relaying is working just fine. The problem is with >>>> the local files. I noticed that the files being written for each host >>>> I recieve is lagging behind by minutes to upwards of a full day >>>> behind. I'm running a tcpdump on both the rsyslog machine and the SIEM >>>> and can see when the logs are received on both, however running a tail >>>> -f on the files show that those entries are lagging behind. It gets >>>> progressively worse as time goes on. They start out in near perfect >>>> sync for the first couple of minutes, then the messages start to lag >>>> horribly. >>>> >>>> I just tried using this config, modified a bit for my environment: >>>> >>>> >>>> # Modules$ModLoad imtcp >>>> $ModLoad imudp >>>> $ModLoad imuxsock >>>> $ModLoad imklog# Templates# log every host in its own directory >>>> $template >>>> >>>> RemoteHost,"/var/opt/syslog/hosts/%HOSTNAME%/%$YEAR%/%$MONTH%/%$DAY%/syslog.log"### >>>> Rulesets# Local Logging >>>> $RuleSet local >>>> kern.* /var/log/messages >>>> *.info;mail.none;authpriv.none;cron.none >>>> /var/log/messages >>>> authpriv.* /var/log/secure >>>> mail.* >>>> -/var/log/maillog >>>> cron.* /var/log/cron >>>> *.emerg * >>>> uucp,news.crit /var/log/spooler >>>> local7.* >>>> /var/log/boot.log >>>> # use the local RuleSet as default if not specified otherwise >>>> $DefaultRuleset local >>>> # Remote Logging >>>> $RuleSet remote >>>> *.* ?RemoteHost >>>> # Send messages we receive to SIEM >>>> *.* @a.b.c.d:1514 >>>> ### Listeners >>>> # bind ruleset to tcp listener >>>> $InputTCPServerBindRuleset remote >>>> # and activate it: >>>> $InputTCPServerRun 1514 >>>> $InputUDPServerBindRuleset remote >>>> $UDPServerRun 514 >>>> >>>> This particular config does exactly the same thing: I can watch syslog >>>> messages come in, but they're not being written to the log file until >>>> much later, if at all. Any thoughts as to why this is happening? >>>> _______________________________________________ >>>> rsyslog mailing list >>>> http://lists.adiscon.net/mailman/listinfo/rsyslog >>>> http://www.rsyslog.com/professional-services/ >>>> What's up with rsyslog? Follow https://twitter.com/rgerhards >>>> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad >>>> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you >>>> DON'T >>>> LIKE THAT. >>>> >>> _______________________________________________ >>> rsyslog mailing list >>> http://lists.adiscon.net/mailman/listinfo/rsyslog >>> http://www.rsyslog.com/professional-services/ >>> What's up with rsyslog? Follow https://twitter.com/rgerhards >>> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad >>> of >>> sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T >>> LIKE THAT. >> >> _______________________________________________ >> rsyslog mailing list >> http://lists.adiscon.net/mailman/listinfo/rsyslog >> http://www.rsyslog.com/professional-services/ >> What's up with rsyslog? Follow https://twitter.com/rgerhards >> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad >> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T >> LIKE THAT. > > > _______________________________________________ > rsyslog mailing list > http://lists.adiscon.net/mailman/listinfo/rsyslog > http://www.rsyslog.com/professional-services/ > What's up with rsyslog? Follow https://twitter.com/rgerhards > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of > sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T > LIKE THAT. _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.

