Re: Reassigning Partition Failing

2014-10-09 Thread Lung, Paul
Hi Joe, I simply restarted the leader broker, and things seem to work again. Thank you. Best, Paul Lung On 10/2/14, 1:26 AM, "Joe Stein" wrote: >What version of zookeeper are you running? > >First check to see if there is a znode for the >"/admin/reassign_partitions" in >zookeeper. > >If so, y

Re: Reassigning Partition Failing

2014-10-09 Thread Lung, Paul
Actually, reassigning the replica does work, even if the broker the partition resides on is dead. My problem was that there were some unknown issue with the leader. When I restarted the leader broker, it worked. Paul On 10/6/14, 11:41 AM, "Joe Stein" wrote: >Agreed, I think it is also a replace

Re: Reassigning Partition Failing

2014-10-06 Thread Joe Stein
Agreed, I think it is also a replacement scenario since we may want to bring in a new broker for the dead broker. We should support explicit remove also. We could add to the ReassignPartitionsCommand for an explicit "make new broker just like the old broker". This is important very much in cloud

Re: Reassigning Partition Failing

2014-10-06 Thread Gwen Shapira
Do we have a jira to support removal of dead brokers without having to start a new broker with the same id? I think its something we'll want to allow. On Thu, Oct 2, 2014 at 7:45 AM, Jun Rao wrote: > The reassign partition process only completes after the new replicas are > fully caught up and t

Re: Reassigning Partition Failing

2014-10-02 Thread Jun Rao
The reassign partition process only completes after the new replicas are fully caught up and the old replicas are deleted. So, if the old replica is down, the process can never complete, which is what you observed. In your case, if you just want to replace a broker host with a new one, instead of u

Re: Reassigning Partition Failing

2014-10-02 Thread Joe Stein
What version of zookeeper are you running? First check to see if there is a znode for the "/admin/reassign_partitions" in zookeeper. If so, you could try a graceful shutdown of the controller broker. Once the new controller leader elects on another broker look at zk the znode "/admin/reassign_pa

Reassigning Partition Failing

2014-10-01 Thread Lung, Paul
Hi All, I had a 0.8.1.1 Kafka Broker go down, and I was trying to use the reassign partition script to move topics off that broker. When I describe the topics, I see the following: Topic: mini__022active_120__33__mini Partition: 0 Leader: 2131118 Replicas: 2131118,2166601,2163421 Isr: 2131