Hi, If you are talking about the case when a log source emits the same sequence of lines then you maybe be able to use xm_multiline to join the events into one and then pm_norepeat can work with this.
Otherwise module variables, pm_evcorr and xm_perl may be of use for more complex log processing. Regards, Botond On Fri, 20 Sep 2013 14:30:32 +0530 Suraj Sharma <suraj.sha...@webyog.com> wrote: > So, do you have any suggestion for this that i can use and de-duplicate the > events data. > Because in case of our application failure we get 3 writes in our > application error logs per second and sending all those in emails will be > quite problematic. > > > On Fri, Sep 20, 2013 at 1:29 PM, Botond Botyanszki <b...@nxlog.org> wrote: > > > Hi, > > > > If I understand correctly you want to reduce any repeated pattern, e.g. > > ABCABCABCABC to (ABC)*4 > > pm_norepeat cannot do this. This would require quite complex algorithms > > to detect what the pattern is and to detect any repetitions. In addition > > it would need to keep all data in memory during the interval, this can > > be quite a lot of events. > > > > Regards, > > Botond > > > > On Thu, 19 Sep 2013 20:44:46 +0530 > > Suraj Sharma <suraj.sha...@webyog.com> wrote: > > > > > Is there a way to filter the events that happens in this order > > > > > > ABABAB ABABAB .... so on > > > |-1st sec-| |-2nd sec-| > > > > > > NOTE: > > > A and B are any event; > > > This whole pattern/series happens every seconds > > > > > > The no_repeat module says.. > > > "this module checks the previous message against the current. If they > > > match, the current message is dropped. The module waits one second for > > > duplicated messages to arrive" > > > So, does that means it will report all 6 events per seconds, not 2 events > > > per second..? > > > > > > Please explain.... > > > > > > -- > > > > > > Warm Regards, > > > *Suraj Sharma* > > > *Software Engineer* > > > *Webyog Softworks Pvt Ltd* > > > * > > > * > > > > > > ------------------------------------------------------------------------------ > > LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99! > > 1,500+ hours of tutorials including VisualStudio 2012, Windows 8, > > SharePoint > > 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack > > includes > > Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13. > > http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk > > _______________________________________________ > > nxlog-ce-users mailing list > > nxlog-ce-users@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users > > > > > > -- > > Warm Regards, > *Suraj Sharma* > *Software Engineer* > *Webyog Softworks Pvt Ltd* > * > * ------------------------------------------------------------------------------ LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99! 1,500+ hours of tutorials including VisualStudio 2012, Windows 8, SharePoint 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack includes Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13. http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk _______________________________________________ nxlog-ce-users mailing list nxlog-ce-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users
