Re: Nginx Logs to Kafka

2016-07-19 Thread Steve Brandon
You can use the ELK stack to push your logs to Kafka, and Kibana to visualize On Tue, Jul 19, 2016 at 11:04 AM, Mudit Kumar wrote: > Hi, > > I want to push all my nginx logs to kafka.Any tool/suggestions for same. > > Thanks, > Mudit > >

Re: Alternate persistence for Kafka

2016-01-26 Thread Steve Brandon
I would give this a look and see if it works, since you mention HDFS https://github.com/linkedin/gobblin On Tue, Jan 26, 2016 at 3:49 PM, Nikhil Joshi wrote: > Hi, > > I'm new to the Kafka community. Has there been any discussion around > plugging-in external filesystems

Re: Tools to monitor kafka

2015-11-20 Thread Steve Brandon
LinkedIn made a great tool! https://github.com/linkedin/Burrow On Fri, Nov 20, 2015 at 10:32 AM, Mohit Anchlia wrote: > Are there any command line or UI tools available to monitor kafka? >

Re: Kafka Best Practices in AWS

2015-10-26 Thread Steve Brandon
Depending on the consumer, I tend to work with c4 types and have found better success. Although we run about 200+ consumers per server on 16 core servers and see moderate load. YMMV On Oct 26, 2015 8:32 AM, "Jennifer Fountain" wrote: > We installed four nodes (r3.xlarge)

Re: How Netflix is using Kafka

2015-06-18 Thread Steve Brandon
Thanks Peter! Great information, especially challenges and strategies. We're rolling out Kafka now and it's interesting to see how others have done it. On Thu, Jun 18, 2015 at 10:17 AM, Peter Hausel peter.hau...@gmail.com wrote: Hello, Thought you might find these resources interesting: