Re: Topic Reassignment Tool Improvements

2014-05-31 Thread Otis Gospodnetic
+1 for sticking this on the Wiki or in JIRA without your internal stuff and letting those who need it (like us) clean up for inclusion. We've got a need for this, too. :) Thanks, Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/

Re: Topic Reassignment Tool Improvements

2014-04-23 Thread Todd Palino
We¹ve got a script that rebalances the partitions in a cluster based on their size (to try and keep the data size across the brokers even), which works very well for moving partitions onto new cluster members. The only problem with it is that it¹s got a couple hooks into our internal configuration

Re: Topic Reassignment Tool Improvements

2014-04-23 Thread Jay Kreps
I don't think we are doing anything at the moment to improve this, but I think we agree it could be improved. We would welcome a contribution here. The best way to proceed would just be to write up a wiki or JIRA on how you think it should work and kick off a discussion. -Jay On Wed, Apr 23, 201

Topic Reassignment Tool Improvements

2014-04-23 Thread Drew Goya
Hey all, do you guys have any plans to enhance the topic reassignment tool? I've had to grow my cluster a couple times and getting an existing topics partition replicas balanced out to the new brokers really sucks. I have to describe the topic, awk the output to get it in the json format, then ma