Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Jun Rao
It doesn't really matter, but bringing ZK up first is probably better. Thanks, Jun On Tue, Apr 23, 2013 at 12:14 PM, Karl Kirch wrote: > Thanks, > > I'll try to keep an eye on that and see if that fixes the problem. > Also, how will that affect things if I have a node completely go away > (i.

Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Karl Kirch
Thanks, I'll try to keep an eye on that and see if that fixes the problem. Also, how will that affect things if I have a node completely go away (i.e. zookeeper and kafka both go offline for a single node). Should I still bring up zookeeper on that node first or does it matter at that point?

Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Xavier Stevens
You should bring up your Zookeeper instances first and then the Kafka brokers. On Tue, Apr 23, 2013 at 11:56 AM, Karl Kirch wrote: > Now to make things even more interesting. I restarted 2 and now it sees > all 3 nodes. > I think I've got some sort of weirdness happening with how I'm bringing >

Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Karl Kirch
Now to make things even more interesting. I restarted 2 and now it sees all 3 nodes. I think I've got some sort of weirdness happening with how I'm bringing everything online. I've tried starting up all the zookeeper instances and then each of the brokers. I've tried starting up all of the ka

Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Karl Kirch
I've tried doing what was suggested (creating the topic folders and restarting) and I'm getting slightly different but still bad results. Now it'll write to node 1 and 3 but not to 2. Karl On Apr 23, 2013, at 1:27 PM, Neha Narkhede wrote: > Can you see if you are running to > https://issues.a

Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Neha Narkhede
Can you see if you are running to https://issues.apache.org/jira/browse/KAFKA-278 ? Thanks, Neha On Tue, Apr 23, 2013 at 11:24 AM, Karl Kirch wrote: > Zookeeper based. > > Karl > > On Apr 23, 2013, at 1:15 PM, Neha Narkhede > wrote: > >> What kind of producer do you use ? Zookeeper based or br

Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Karl Kirch
Zookeeper based. Karl On Apr 23, 2013, at 1:15 PM, Neha Narkhede wrote: > What kind of producer do you use ? Zookeeper based or broker list ? > > Thanks, > Neha > > On Tue, Apr 23, 2013 at 9:02 AM, Karl Kirch wrote: >> For some extra info, this was a restart of the just zookeeper and kafka

Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Neha Narkhede
What kind of producer do you use ? Zookeeper based or broker list ? Thanks, Neha On Tue, Apr 23, 2013 at 9:02 AM, Karl Kirch wrote: > For some extra info, this was a restart of the just zookeeper and kafka, our > clients were all still online. > > Karl > > On Apr 23, 2013, at 10:50 AM, Karl Kir

Re: Expected behavior for clustered kafka setup

2013-04-23 Thread Karl Kirch
For some extra info, this was a restart of the just zookeeper and kafka, our clients were all still online. Karl On Apr 23, 2013, at 10:50 AM, Karl Kirch wrote: > Our setup is a three node cluster, we have a Kafka 0.7.2 (with 10 partitions > per node) and Zookeeper 3.3.4 on each node. I'm se