Re: automatically consume from all topics

2015-09-18 Thread Alexis Midon
gt; > > comes > > > > > to expectations, is donĀ¹t go with a cluster. Just have a > > > script/watcher > > > > > app that does the polling and then, when it detects new topics, for > > > each > > > > > new topic: start a new i

Re: automatically consume from all topics

2015-09-12 Thread tao xiao
cript/watcher > > > > app that does the polling and then, when it detects new topics, for > > each > > > > new topic: start a new instance of your app on a new box that listens > > to > > > > that single topic. It might take a few seconds to

Re: automatically consume from all topics

2015-09-11 Thread Alexis Midon
box that listens > to > > > that single topic. It might take a few seconds to startup, but its > easy > > > to code, easy to maintain, and easy to understand. Which makes for a > > more > > > resilient application. > > > -Erik > > > > &

automatically consume from all topics

2015-09-10 Thread Joris Peeters
Hello, Is there a simple way to set up a consumer that automatically picks up all the topics for all the partitions, dynamically extending its range as new topics get created? The underlying idea is that we want to have a few over-arching consumers (I'm aware that's not great for the

Re: automatically consume from all topics

2015-09-10 Thread Helleren, Erik
rg> Subject: automatically consume from all topics Hello, Is there a simple way to set up a consumer that automatically picks up all the topics for all the partitions, dynamically extending its range as new topics get created? The underlying idea is that we want to have a few over-arching

Re: automatically consume from all topics

2015-09-10 Thread Gerrit Jansen van Vuuren
s <j.peet...@wintoncapital.com> > Reply-To: "users@kafka.apache.org" <users@kafka.apache.org> > Date: Thursday, September 10, 2015 at 6:09 AM > To: "users@kafka.apache.org" <users@kafka.apache.org> > Subject: automatically consume from all topi

Re: automatically consume from all topics

2015-09-10 Thread tao xiao
rom: Joris Peeters <j.peet...@wintoncapital.com> > > Reply-To: "users@kafka.apache.org" <users@kafka.apache.org> > > Date: Thursday, September 10, 2015 at 6:09 AM > > To: "users@kafka.apache.org" <users@kafka.apache.org> > > Subject: