On Mon, 9 Dec 2013, Mike Hoskins (michoski) wrote:
-----Original Message-----
From: David Lang <[email protected]>
but you can't just say "it would be good to have omkafka", you need to
explain to people who have never heard of kafka before why they should be
interested in it. I don't think anyone has even posted a link to kafka to
point us at the right thing to look at yet.
Or you can create a simple omkafka module (or sponsor the development of one)
and contribute it. Even if the first version isn't the fastest possible, once
you get something that works at all, if others find it useful they will help
improve it (sometimes including re-writitng it)
yep this is what i tried to imply i was considering by showing interest and
saving this thread. given my skillset i wouldn't be able to turn out
something production grade, but might be able to get a PoC going as i get more
experience with kafka in the current project i'm working on...that in turn
might possibly pique other's interest.
the rsyslog module interface is not that bad to deal with. you don't have to
deal with most of the rsyslog internals, you can mostly take a template and put
in the stuff specific to your interface. The elasticsearch module is probably
one of the better matches for what you are doing to start with.
note that in v8 the modules are changing quite a bit, so you may want to start
there.
When the initial post of "what's the best way people have found to get logs
from rsyslog to kafka" was posted, I almost responded with a "what's kafka,
what protocols does it understand" type response, but I decided to be quiet
and see if someone else was familar with it.
In several days we haven't had anyone else indicate that they knew much about
it before the second round "wouldn't it be good to have a omkafka modules".
This indicates that there are at least a couple people interested in using
kafka, but not much else :-)
If you want help, provide info, don't ask others to do a bunch of research
before they can answer your questions.
i'm the silly type that assume people writing code now how to google. :-) not
being flippant, but when i got pulled into my first project and started
hearing devs buzz about kafka i started searching and found a lot of info.
so finding out what it is and how it works is easy, past that point it's up to
you and others if you have interest to write code...if not someone else will.
there's only so many hours in a day and google is not a precise tool, so it
helps to provide some links to get people started. I know that I've wasted a lot
of time in the past researching the wrong thing because google didn't find what
the other person was actually talking aobut. :-)
sorry to ruffle feathers!
not a big deal, you just had the bad luck of being the second person in a week
to show up with a similar request wihtout any other info being provided.
David Lang
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
