Thanks David.
Following are the configs I used.
*syslogd 7.5.4*
module(load="imfile" PollingInterval="60")
input(type="imfile" File="/tmp/ne.original.log"
Tag="test.ne.ne-error"
StateFile="test.ne.ne-error"
ReadMode="1"
escapeLF="on")
if $syslogtag == 'test.ne.ne-error' then @@172.17.101.37:514
if $syslogtag == 'test.ne.ne-error' then /tmp/ne.client.log
& ~
*rsyslogd 5.8.6*
$ModLoad imfile
$InputFileName /tmp/ne.original.log
$InputFileTag test.ne.ne-error
$InputFileStateFile test.ne.ne-error
$InputFileReadMode 1
$InputRunFileMonitor
$Escape8BitCharactersOnReceive on
$EscapeControlCharactersOnReceive on
if $syslogtag == 'test.ne.ne-error' then /tmp/ne.error.new
& ~
On Mon, Nov 25, 2013 at 3:47 PM, David Lang <[email protected]> wrote:
> what is your config?
>
> David Lang
>
> On Mon, 25 Nov 2013, Bijohn Bijohn wrote:
>
> Date: Mon, 25 Nov 2013 14:48:22 +0530
>> From: Bijohn Bijohn <[email protected]>
>> Reply-To: rsyslog-users <[email protected]>
>> To: [email protected]
>> Subject: [rsyslog] Missing logs while polling logfile
>>
>>
>> I am facing an issue while writing lines of logs in a log file to another
>> using rsyslog.
>> rsyslog is* missing few lines of logs when polling the log file.*
>>
>>
>> If the polling interval is 10 sec, it misses few lines in every 10 sec. SO
>> I changed it to 60 sec. But it still misses some lines once in a minute.
>> Used a script to test this which writes lines of logs in 0.5 sec interval.
>>
>>
>> Log written @ client side
>>
>> Line-00
>> Line-01
>> Line-02
>> Line-03
>> Line-04
>> Line-05
>> Line-06
>> Line-07
>> Line-08
>> Line-09
>>
>> Line-10
>> Line-11
>> Line-12
>> Line-13
>> Line-14
>> Line-15
>> Line-16
>> Line-17
>> Line-18
>> Line-19
>>
>> Line-20
>> ..........
>> ...........
>> Line-99
>>
>> Anyone faced this issue? I have tried rsyslogd 7.5.4, rsyslogd 5.8.6
>>
>>
>> *Output*
>>
>>
>> Log written @ server side (rsyslogd 7.5.4) PollingInterval = 60
>> conf:
>> if $syslogtag == 'test.ne.ne-error' then @@172.17.101.37:514
>> (With multiline support)
>>
>> Nov 21 13:56:19 m4m-fe-new test.ne.ne-error Line-00 #012 Line-01 #012
>> Line-02 #012 Line-03 #012 Line-04 #012 Line-05 #012 Line-06 #012 Line-07
>> #012 Line-08 #012 Line-09
>> Nov 21 13:56:19 m4m-fe-new test.ne.ne-error Line-10 #012 Line-11 #012
>> Line-12 #012 Line-13 #012 Line-14 #012 Line-15 #012 Line-16 #012 Line-17
>> #012 Line-18 #012 Line-19
>> Nov 21 13:57:19 m4m-fe-new test.ne.ne-error *Line-27 #012 Line-28 #012
>> Line-29*
>>
>> Nov 21 13:57:19 m4m-fe-new test.ne.ne-error Line-30 #012 Line-31 #012
>> Line-32 #012 Line-33 #012 Line-34 #012 Line-35 #012 Line-36 #012 Line-37
>> #012 Line-38 #012 Line-39
>> Nov 21 13:57:19 m4m-fe-new test.ne.ne-error Line-40 #012 Line-41 #012
>> Line-42 #012 Line-43 #012 Line-44 #012 Line-45 #012 Line-46 #012 Line-47
>> #012 Line-48 #012 Line-49
>> Nov 21 13:57:19 m4m-fe-new test.ne.ne-error Line-50 #012 Line-51 #012
>> Line-52 #012 Line-53 #012 Line-54 #012 Line-55 #012 Line-56 #012 Line-57
>> #012 Line-58 #012 Line-59
>> Nov 21 13:57:19 m4m-fe-new test.ne.ne-error Line-60 #012 Line-61 #012
>> Line-62 #012 Line-63 #012 Line-64 #012 Line-65 #012 Line-66 #012 Line-67
>> #012 Line-68 #012 Line-69
>> Nov 21 13:57:19 m4m-fe-new test.ne.ne-error Line-70 #012 Line-71 #012
>> Line-72 #012 Line-73 #012 Line-74 #012 Line-75 #012 Line-76 #012 Line-77
>> #012 Line-78 #012 Line-79
>> Nov 21 13:57:19 m4m-fe-new test.ne.ne-error Line-80 #012 Line-81 #012
>> Line-82 #012 Line-83 #012 Line-84 #012 Line-85 #012 Line-86 #012 Line-87
>> #012 Line-88 #012 Line-89
>> Nov 21 13:57:19 m4m-fe-new test.ne.ne-error Line-90 #012 Line-91 #012
>> Line-92 #012 Line-93 #012 Line-94 #012 Line-95 #012 Line-96 #012 Line-97
>> #012 Line-98 #012 Line-99
>>
>>
>> rsyslogd 5.8.6 PollingInterval = 10 sec (default)
>> conf:
>> if $syslogtag == 'test.ne.ne-error' then /tmp/ne.error.new
>>
>> Nov 21 15:24:05 m4m-admin-new test.ne.ne-error Line-05
>> Line-06
>> Line-07
>> Line-08
>> Line-09
>> Nov 21 15:24:05 m4m-admin-new test.ne.ne-error Line-10
>> Line-11
>> Line-12
>> Line-13
>> Line-14
>> Line-15
>> Line-16
>> Line-17
>> Line-18
>> Line-19
>> Nov 21 15:24:15 m4m-admin-new test.ne.ne-error Line-25
>> Line-26
>> Line-27
>> Line-28
>> Line-29
>> Nov 21 15:24:15 m4m-admin-new test.ne.ne-error Line-30
>> Line-31
>> Line-32
>> Line-33
>> Line-34
>> Line-35
>> Line-36
>> Line-37
>> Line-38
>> Line-39
>> Nov 21 15:24:25 m4m-admin-new test.ne.ne-error Line-45
>> Line-46
>> Line-47
>> Line-48
>> Line-49
>> Nov 21 15:24:25 m4m-admin-new test.ne.ne-error Line-50
>> Line-51
>> Line-52
>> Line-53
>> Line-54
>> Line-55
>> Line-56
>> Line-57
>> Line-58
>> Line-59
>> Nov 21 15:24:35 m4m-admin-new test.ne.ne-error Line-65
>> Line-66
>> Line-67
>> Line-68
>> Line-69
>> Nov 21 15:24:35 m4m-admin-new test.ne.ne-error Line-70
>> Line-71
>> Line-72
>> Line-73
>> Line-74
>> Line-75
>> Line-76
>> Line-77
>> Line-78
>> Line-79
>> Nov 21 15:24:45 m4m-admin-new test.ne.ne-error Line-85
>> Line-86
>> Line-87
>> Line-88
>> Line-89
>> Nov 21 15:24:45 m4m-admin-new test.ne.ne-error Line-90
>> Line-91
>> Line-92
>> Line-93
>> Line-94
>> Line-95
>> Line-96
>> Line-97
>> Line-98
>> Line-99
>>
>>
>> --
>> Thanks
>> Bijohn
>> _______________________________________________
>> rsyslog mailing list
>> http://lists.adiscon.net/mailman/listinfo/rsyslog
>> http://www.rsyslog.com/professional-services/
>> What's up with rsyslog? Follow https://twitter.com/rgerhards
>> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
>> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
>> DON'T LIKE THAT.
>>
>> _______________________________________________
> rsyslog mailing list
> http://lists.adiscon.net/mailman/listinfo/rsyslog
> http://www.rsyslog.com/professional-services/
> What's up with rsyslog? Follow https://twitter.com/rgerhards
> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
> DON'T LIKE THAT.
>
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
