-----Original Message----- From: David Lang <[email protected]> Reply-To: rsyslog-users <[email protected]> Date: Friday, December 6, 2013 1:03 PM To: rsyslog-users <[email protected]> Subject: Re: [rsyslog] Rsyslog ==> Kafka? omkafka?
>If you are using logstash, why bother using rsyslog? you don't need the >rsyslog >performance if you can then have rsyslog send the logs to logstash. that's not strictly true. you can have layers of each, and scale independently...not really assuming logstash is used in all message flows (it's not here), or that you only have a single logstash instance. i guess i should have specified to take this with a grain of salt. if you are familiar enough with logstash to think of how to creatively use it then it might be useful. >It's a good thing to get added modules to rsyslog to let it deliver to >things in >their native protocols (it's better if log related things can talk the >standard >logging protocols, but some tools that are useful for logs were not >designed for >them) agreed. > >The question is just how should they be written. > >OpenSource software is developed by people working on (or paying others >to work >on) things that they are interested in. > >Sometimes you can get someone else interested in something that you want >and >they will then do the development for you for free. yeah i get oss development, and am one of the biggest proponents of it internally. i was trying to have a free form discussion and figure out potential stop-gaps while the feature is in development. i certainly wasn't dictating anyone has to write something they're not interested in, nor would i ever think that way. sorry if that came across. >but you can't just say "it would be good to have omkafka", you need to >explain >to people who have never heard of kafka before why they should be >interested in >it. I don't think anyone has even posted a link to kafka to point us at >the >right thing to look at yet. > >Or you can create a simple omkafka module (or sponsor the development of >one) >and contribute it. Even if the first version isn't the fastest possible, >once >you get something that works at all, if others find it useful they will >help >improve it (sometimes including re-writitng it) yep this is what i tried to imply i was considering by showing interest and saving this thread. given my skillset i wouldn't be able to turn out something production grade, but might be able to get a PoC going as i get more experience with kafka in the current project i'm working on...that in turn might possibly pique other's interest. >When the initial post of "what's the best way people have found to get >logs from >rsyslog to kafka" was posted, I almost responded with a "what's kafka, >what >protocols does it understand" type response, but I decided to be quiet >and see >if someone else was familar with it. > >In several days we haven't had anyone else indicate that they knew much >about it >before the second round "wouldn't it be good to have a omkafka modules". > >This indicates that there are at least a couple people interested in >using >kafka, but not much else :-) > >If you want help, provide info, don't ask others to do a bunch of >research >before they can answer your questions. i'm the silly type that assume people writing code now how to google. :-) not being flippant, but when i got pulled into my first project and started hearing devs buzz about kafka i started searching and found a lot of info. so finding out what it is and how it works is easy, past that point it's up to you and others if you have interest to write code...if not someone else will. sorry to ruffle feathers! _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
