Navneet, Either way is fine. At LinkedIn, each app directly writes log data to a kafka cluster using the producer api.
Thanks, Jun On Wed, Apr 4, 2012 at 2:20 AM, navneet sharma <navneetsharma0...@gmail.com>wrote: > Hi, > > I am new to kafka. If i have an application which is generating logs and i > need to read and do some CEP on these logs. > > For CEP, we are planning to use Esper and for reading weblogs, we are > examining Kafka. I have few questions: > 1) What will be a producer in this case. Will it be an external > entity(standalone program) which will do file I/o and send weblogs to kafka > broker? > 2) Or will it be part of application itself, so that it can read logs in > parallel with the logging utility? > > Any pointers will be helpful... > > Thanks, > Navneet >
