Hi Rusty, Personally I have no experience with Redis. I know it's quite popular these days and a lot of people have already asked for redis modules. Other than the use-case being a large scale distributed environment I really don't see what additional benefit Redis would give over nxlog's built-in buffering capabilities when it's used as a buffer to feed logstash, i.e. nxlog => redis => logstash See this for more: http://www.mail-archive.com/nxlog-ce-users%40lists.sourceforge.net/msg00106.html
The redis modules are on the roadmap, it's just that there are more plans than what we can implement in a reasonable time. Also there was a guy at the #nxlog irc channel not a long ago who said he'd be doing the redis output module but I never heard back from him since. A really basic Redis output module would be very easy to do since the protocol is pretty simple and text based. In fact this might be already possible using om_tcp and formatting $raw_event as required by Redis within an Exec statement. On the other hand a proper implementation would need to do pipelining together with error handling. I've cc-ed the list in case someone has some thoughts to share. Regards, Botond On Wed, 30 Jul 2014 17:03:52 +0000 Rusty Chapin <rcha...@prepsportswear.com> wrote: > Are any redis modules planned? In my experience NXLog stops reading the > files when it loses connection to the upstream engine. Which is perfect. > However there are odd states that an engine could be in where it is receiving > data but not actually doing anything with it. A Redis module could be > helpful in this regard as it can provide a buffer for read data. At any rate > thanks so much for all of your help Botond. It is greatly appreciated! > > > -----Original Message----- > From: Botond Botyanszki [mailto:b...@nxlog.org] > Sent: Wednesday, July 30, 2014 9:45 AM > To: nxlog-ce-users@lists.sourceforge.net > Subject: Re: [nxlog-ce-users] NXLog and Redis > > Hi Pedro, > > There are no native nxlog modules for redis yet. > > Regards, > Botond > > On Tue, 29 Jul 2014 12:40:00 +0200 > Pedro Serrano <pedro.serr...@i4s.com> wrote: > > > Hi Botond, > > > > do you have any im_redis module? > > > > Regards > > > > > > 2014-07-29 11:53 GMT+02:00 Botond Botyanszki <b...@nxlog.org>: > > > > > Hi, > > > > > > On Mon, 28 Jul 2014 22:50:01 +0000 > > > Rusty Chapin <rcha...@prepsportswear.com> wrote: > > > > > > > I want to use a Redis cluster as a buffer for demonstrated > > > > application instability between NXLog, Logstash, and Elasticsearch. > > > <ad> > > > We have commercial module om_elasticsearch that supports bulk mode. > > > Contact me directly if you are interested. > > > </ad> > > > > > > > So the question is... what needs to be done to have NXLog > > > > communicate directly with Redis in a performant and stable manner? > > > > > > A native om_redis output module. > > > > > > Regards, > > > Botond > > > > > > > > > -------------------------------------------------------------------- > > > ---------- > > > Infragistics Professional > > > Build stunning WinForms apps today! > > > Reboot your WinForms applications with our WinForms controls. > > > Build a bridge from your legacy apps to the future. > > > > > > http://pubads.g.doubleclick.net/gampad/clk?id=153845071&iu=/4140/ost > > > g.clktrk _______________________________________________ > > > nxlog-ce-users mailing list > > > nxlog-ce-users@lists.sourceforge.net > > > https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users > > > > > > > > > > > -- > > > > *I4S - BBVA* > > > > *Pedro Serrano Alonso* > > > > Móvil: +34 630 830 062 (296163) - Tel. +34 91 374 32 77 > > > > *pedro.serr...@i4s.com <pedro.serr...@i4s.com>* > > > > C/ Clara del Rey 26, Planta 4. 28002, Madrid > > > > Antes de imprimir este mensaje, por favor comprueba que es necesario > > hacerlo. > > > > Before you print this message please consider if it is really necessary. > > ------------------------------------------------------------------------------ > Infragistics Professional > Build stunning WinForms apps today! > Reboot your WinForms applications with our WinForms controls. > Build a bridge from your legacy apps to the future. > http://pubads.g.doubleclick.net/gampad/clk?id=153845071&iu=/4140/ostg.clktrk > _______________________________________________ > nxlog-ce-users mailing list > nxlog-ce-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users ------------------------------------------------------------------------------ Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http://pubads.g.doubleclick.net/gampad/clk?id=153845071&iu=/4140/ostg.clktrk _______________________________________________ nxlog-ce-users mailing list nxlog-ce-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users
