Hi, You are filtering the input in '1_in' using drop(), most likely this is why the source and destination files differ. Otherwise please provide a test case with input samples that can be used to reproduce the problem.
Regards, Botond On Mon, 3 Nov 2014 12:11:03 +0200 Maxim Nikolaev <m...@maximnik.com> wrote: > Hello > > I encountered strange problem with nxlog. I have large file (~2GB) of logs. > I read it with nxlog and write remotely to central server. On central > server I also have nxlog. > When I checked number of strokes in source and destination files I found > that only 30-40% of strokes are on central server. > I tried to check it to be sure. I set output to local file on one of > servers and found that problem exist. For one hiur I see in log file 849314 > strokes and in file that nxlog creates - 779719. It means almost 70000 > strokes weren't write by nxlog. > > I use simple config like this: > > ######################################## > # Global directives # > ######################################## > User root > Group nxlog > > LogFile /var/log/nxlog/nxlog.log > LogLevel INFO > > FlowControl FALSE > ######################################## > # Modules # > ######################################## > define LOGFILE "/var/log/nxlog/nxlog.log" > <Extension fileop> > Module xm_fileop > <Schedule> > Every 1 day > Exec file_cycle(%LOGFILE%, 2); > </Schedule> > </Extension> > > ######################################## > # Inputs # > ######################################## > <Input 1_in> > Module im_file > File "/path_to_file/access_log" > Exec if ($raw_event =~ /monitor/) drop(); > InputType LineBased > </Input> > > ################################################### > # Output # > ################################################### > > <Output 12_out> > Module om_tcp > Host <remote_server> > Port 6007 > OutputType LineBased > Exec $Hostname = hostname(); $raw_event = $Hostname + " " + $raw_event; > </Output> > > <Output 1_out> > Module om_file > File "/data/1_nx/" + $MessageSourceAddress + "_1nx" + "-" + > strftime(now(), "%Y%m%d") > CreateDir TRUE > </Output> > > <Route 1> > Path 1_in => 12_out, 1_out > </Route> ------------------------------------------------------------------------------ _______________________________________________ nxlog-ce-users mailing list nxlog-ce-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users
