all consumers pull from the same partition?
[EXTERNAL E-MAIL]
Partition is decided based on message record key. If it's same, it will hit the
same partition.
-Original Message-
From: Dylan Martin
Sent: Monday, February 10, 2020 12:35 PM
To: users@kafka.apache.org
Subject: Why would all
I have a cluster of 20'ish brokers. One topic has 60'ish consumers and 100
partitions, but the consumers all seem to be hitting the same broker, which
makes me think they're all hitting the same partition.
What would cause that? I assume I've configured something wrong.
Thanks!
-Dylan
The
out what that means.
Thanks!
-Dylan
From: Alex Woolford
Sent: Saturday, February 8, 2020 10:09 PM
To: users@kafka.apache.org
Cc: Dylan Martin
Subject: Re: Confusingly unbalanced broker
[EXTERNAL E-MAIL]
That's a very intriguing question, Dylan.
Hi all!
I have a cluster of about 20 brokers and one of them is transmitting about 4
times as much data as the others (80mB/sec vs 20mB/sec). It has the roughly
the same number of topics & partitions and it's the leader for the same number
as all the other brokers. The kafka-manager web tool
I have a situation where I should always have exactly one producer per topic,
but under certain rare circumstances I can have more than one, and that's
really bad when it happens, so I want to detect it.
Can I know how many producer a topic has? Can I identify them?
Thanks!
-Dylan
The
I have a cluster with 4 brokers and I want to reduce it to 2 brokers. I cannot
re-assign __consumer_offsets because it wants at least 3 brokers.
Is there a way to do this? Or am I going to have to trash my cluster and start
over?
-Dylan
(206) 855-9740 - Home
(206) 235-8809 - Cell
The
I have some boxes that I'm using to test kafka configurations (and zookeeper).
What's the recommended procedure to clean them out to a clean state so I can
re-install kafka and zookeeper without worrying about old data or configuration
getting in the way?
-Dylan
(206) 855-9740 - Home
Hi all.
I'm trying to cancel a failed partition reassignment. I've heard that this can
be done by deleting /admin/reassign_partitions in zookeeper. I've tried and
/admin/reassign_partitions won't go away.
Does anyone know a way to cancel a partition reassignment?
-Dylan
(206) 855-9740
Hi all.
I've got a cluster of 3 brokers with around 50 topics. Several topics are
under replicated. Everything I've seen says I need to restart the followers to
fix that. All my under replicated topics have the same broker as the leader.
That makes me think it's a leader problem and not a
