-----Original Message----- From: Rainer Gerhards <[email protected]> Reply-To: rsyslog-users <[email protected]> Date: Friday, December 6, 2013 10:08 AM To: rsyslog-users <[email protected]> Subject: Re: [rsyslog] Rsyslog ==> Kafka? omkafka?
>On Fri, Dec 6, 2013 at 3:50 PM, Otis Gospodnetic ><[email protected] >> wrote: > >> Hi, >> >> What is the best way to send logs from Rsyslog to Kafka? >> >> I just came across https://github.com/edenhill/librdkafka and thought it >> would be cool if Rsyslog could use that ..... omkafka would be cool, no? >> >> >Could you elaborate what Kafka is and why it would be cool if rsyslog >connects to it (use cases!)? > >Thx, >Rainer > >PS: pls also see me other msg earlier this week on implementing it. i'm just getting forcibly exposed to this myself (drinking from a firehose). it's just another message broker, so in theory you could have rsyslog agents filling a durable message store that could be consumed by geographically dispersed (or not) clients. that could be of interest in many use cases, in our case a good example would be security devices generating logs and analytics consumers. this is actually interesting enough i have been saving these emails and thinking of ways to contribute myself, but time is my biggest weakness as i am sure it is for many. :-) again i'm just getting exposed to this in a live devops project, so i might be oversimplifying. googling for "rabbitmq vs kafka" gives a lot of good reading. generically i see this just as useful as supporting amqp/stomp output. sorry i am still pretty new here, but just based on some past archives from this list i wonder if logstash as a middleman would be a quick answer for the OP? _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
