we would be very happy to contribute. However a description of the current
plan and status regarding tooling would be helpful.
It would speed up the learning curve. You mentioned some jira tickets?
(maybe I should sign up to the developer mailing list and take the
conversation over there)
On
The idea is to bake the functionality of such a tool in Kafka itself. In an
ideal world, a Kafka cluster would automatically detect leader and data
imbalance and trigger a rebalance operation that leads to optimal
performance. I'm not sure if we have a JIRA for this though. So feel free
to create
Since these tools are so useful, I wonder what it requires (from both
Airbnb and Kafka) to merge this into Kafka project. I think there are
couple of Jira regarding improved tool usability that this resolved.
On Mon, Sep 15, 2014 at 11:45 AM, Alexis Midon
alexis.mi...@airbedandbreakfast.com
distribution will be even based on the number of partitions.
It is the same logic as AdminUtils.
see
https://github.com/airbnb/kafkat/blob/master/lib/kafkat/command/reassign.rb#L39
On Sun, Sep 14, 2014 at 6:05 PM, Neha Narkhede neha.narkh...@gmail.com
wrote:
This is great. Thanks for sharing!
This is great. Thanks for sharing! Does kafkat automatically figure out the
right reassignment strategy based on even data distribution?
On Wed, Sep 3, 2014 at 12:12 AM, Alexis Midon
alexis.mi...@airbedandbreakfast.com wrote:
Hi Marcin,
A few weeks ago, I did an upgrade to 0.8.1.1 and then
Hi Marcin,
A few weeks ago, I did an upgrade to 0.8.1.1 and then augmented the cluster
from 3 to 9 brokers. All went smoothly.
In a dev environment, we found out that the biggest pain point is to have
to deal with the json file and the error-prone command line interface.
So to make our life
I am running on 0.8.1.1 and I thought that the partition reassignment tools
can do this job. Just was not sure if this is the best way to do this.
I will try this out in stage env first and will perform the same in prod.
Thanks,
marcin
On Mon, Aug 25, 2014 at 7:23 PM, Joe Stein
Hi, I would like to migrate my Kafka setup from old servers to new servers.
Let say I have 8 really old servers that have the kafka topics/partitions
replicated 4 ways and want to migrate the data to 4 brand new servers and
want the replication factor be 3. I wonder if anyone has ever performed
If you are also planning on a version upgrade as part of this, it might be
safer to create the new cluster separately and use the mirror maker to
copy data over.
On Aug 26, 2014 6:29 AM, Marcin Michalski mmichal...@tagged.com wrote:
Hi, I would like to migrate my Kafka setup from old servers to
Marcin, that is a typical task now. What version of Kafka are you running?
Take a look at
https://kafka.apache.org/documentation.html#basic_ops_cluster_expansion and
https://kafka.apache.org/documentation.html#basic_ops_increase_replication_factor
Basically you can do a --generate to get
10 matches
Mail list logo
