Hi, Re last Q about Logstash as the middleman - no, Logstash is more like Rsyslog itself than Kafka.
Very confusing territory with a TON of overlap between various tools. :) Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Fri, Dec 6, 2013 at 12:23 PM, Mike Hoskins (michoski) <[email protected] > wrote: > -----Original Message----- > From: Rainer Gerhards <[email protected]> > Reply-To: rsyslog-users <[email protected]> > Date: Friday, December 6, 2013 10:08 AM > To: rsyslog-users <[email protected]> > Subject: Re: [rsyslog] Rsyslog ==> Kafka? omkafka? > > >On Fri, Dec 6, 2013 at 3:50 PM, Otis Gospodnetic > ><[email protected] > >> wrote: > > > >> Hi, > >> > >> What is the best way to send logs from Rsyslog to Kafka? > >> > >> I just came across https://github.com/edenhill/librdkafka and thought > it > >> would be cool if Rsyslog could use that ..... omkafka would be cool, no? > >> > >> > >Could you elaborate what Kafka is and why it would be cool if rsyslog > >connects to it (use cases!)? > > > >Thx, > >Rainer > > > >PS: pls also see me other msg earlier this week on implementing it. > > i'm just getting forcibly exposed to this myself (drinking from a > firehose). it's just another message broker, so in theory you could have > rsyslog agents filling a durable message store that could be consumed by > geographically dispersed (or not) clients. that could be of interest in > many use cases, in our case a good example would be security devices > generating logs and analytics consumers. this is actually interesting > enough i have been saving these emails and thinking of ways to contribute > myself, but time is my biggest weakness as i am sure it is for many. :-) > > again i'm just getting exposed to this in a live devops project, so i > might be oversimplifying. googling for "rabbitmq vs kafka" gives a lot of > good reading. generically i see this just as useful as supporting > amqp/stomp output. sorry i am still pretty new here, but just based on > some past archives from this list i wonder if logstash as a middleman > would be a quick answer for the OP? > > _______________________________________________ > rsyslog mailing list > http://lists.adiscon.net/mailman/listinfo/rsyslog > http://www.rsyslog.com/professional-services/ > What's up with rsyslog? Follow https://twitter.com/rgerhards > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > DON'T LIKE THAT. > _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
