Re: Best Practices for Java Consumers
+1 On this idea. On Tue, Jun 23, 2015 at 5:55 PM, Gwen Shapira gshap...@cloudera.com wrote: I don't know of any such resource, but I'll be happy to help contribute from my experience. I'm sure others would too. Do you want to start one? Gwen On Tue, Jun 23, 2015 at 2:03 PM, Tom McKenzie thomaswmcken...@gmail.com wrote: Hello Is there a good reference for best practices on running Java consumers? I'm thinking a FAQ format. - How should we run them? We are currently running them in Tomcat on Ubuntu, are there other approaches using services? Maybe the service wrapper http://wrapper.tanukisoftware.com/doc/english/download.jsp? - How should we monitor them? I going to try https://github.com/stealthly/metrics-kafka - How do we scale? I'm guessing we run more servers but we could also run more threads? What are the tradeoffs? - Links to code examples - How do we make consumers robust? i.e. Best practices for exceptions handling. We have noticed if our code has a NPE it's stops consuming. Also if this doesn't exist I would be willing to start this document. I would think it would be near this page https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example Thanks, Tom -- Jeff Holoman Systems Engineer
Best Practices for Java Consumers
Hello Is there a good reference for best practices on running Java consumers? I'm thinking a FAQ format. - How should we run them? We are currently running them in Tomcat on Ubuntu, are there other approaches using services? Maybe the service wrapper http://wrapper.tanukisoftware.com/doc/english/download.jsp? - How should we monitor them? I going to try https://github.com/stealthly/metrics-kafka - How do we scale? I'm guessing we run more servers but we could also run more threads? What are the tradeoffs? - Links to code examples - How do we make consumers robust? i.e. Best practices for exceptions handling. We have noticed if our code has a NPE it's stops consuming. Also if this doesn't exist I would be willing to start this document. I would think it would be near this page https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example Thanks, Tom
Re: Best Practices for Java Consumers
I don't know of any such resource, but I'll be happy to help contribute from my experience. I'm sure others would too. Do you want to start one? Gwen On Tue, Jun 23, 2015 at 2:03 PM, Tom McKenzie thomaswmcken...@gmail.com wrote: Hello Is there a good reference for best practices on running Java consumers? I'm thinking a FAQ format. - How should we run them? We are currently running them in Tomcat on Ubuntu, are there other approaches using services? Maybe the service wrapper http://wrapper.tanukisoftware.com/doc/english/download.jsp? - How should we monitor them? I going to try https://github.com/stealthly/metrics-kafka - How do we scale? I'm guessing we run more servers but we could also run more threads? What are the tradeoffs? - Links to code examples - How do we make consumers robust? i.e. Best practices for exceptions handling. We have noticed if our code has a NPE it's stops consuming. Also if this doesn't exist I would be willing to start this document. I would think it would be near this page https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example Thanks, Tom
