r_offsets partitions; I
> used reassignment to move the large partition onto a different set of
> machines (which forced the cleaner to run through them again) and after the
> new machines finished replicating, the partition was back down from 41GB to
> a nice trim 38MB.
>
> On Fri, O
Hi,
We have a 3-node cluster that is running 0.9.0.1, and recently saw that the
"__consumer_offsets" topic on one of the nodes seems really skewed with
disk usage that looks like:
73G ./__consumer_offsets-10
0 ./__consumer_offsets-7
0 ./__consumer_offsets-4
0
We are running with a JBOD configuration, and it is not recommended for the
following reasons:
- any volume failure causes an unclean shutdown and requires lengthy
recovery
- data is not distributed consistently across volumes, so you could have
skew within a broker
We are planning to switch to a
I highly recommend https://github.com/airbnb/kafkat, which will simplify
your partition management tasks. Use it with
https://github.com/airbnb/kafkat/pull/3 for partition specific reassignment.
Chi
On Mon, Apr 13, 2015 at 4:08 AM, Jan Filipiak jan.filip...@trivago.com
wrote:
Hey,
try to
Hi Stevo,
I won't speak for Joe, but what we do is documented in the link that Joe
provided:
Adding servers to a Kafka cluster is easy, just assign them a unique
broker id and start up Kafka on your new servers. However these new servers
will not automatically be assigned any data partitions, so
We are using Kafka 0.8.1.1 (2.9.2) rebuilt with Snappy 1.1.0.1, and don't
have problems with producers or consumers.
Chi
On Thu, Jun 5, 2014 at 9:29 PM, Vinay Gupta vingup2...@yahoo.com.invalid
wrote:
Hi,
I am using
kafka_2.9.2-0.8.1and
snappy-java-1.1.0.1.jar
I have been able to
We've used bytes written as in, and bytes read as out.
Chi
On Mon, Mar 31, 2014 at 11:12 AM, Arnaud Lawson arnaud.law...@velos.iowrote:
Ok thanks Guozhang . So What would the metrics for the in-traffic and
out-traffic message count be on this page (this page shows all existing jmx
metrics)?
