Re: lag for a specific partitions on newly added host

2016-12-13 Thread Jeremy Hansen
r demonstrate any lag. > >> On Fri, Dec 9, 2016 at 8:58 PM, Jeremy Hansen wrote: >> >> Here’s the topic description: >> >> Topic:blumfrub PartitionCount:15 ReplicationFactor:5 Configs: >>Topic: blumfrub Partition: 0Leader: 1001Replicas:

Re: lag for a specific partitions on newly added host

2016-12-09 Thread Jeremy Hansen
Topic: blumfrub Partition: 14 Leader: 1 Replicas: 1,4,1001,0,2 Isr: 0,1001,1,2,4 1001 is the new broker. -jeremy > On Dec 9, 2016, at 8:55 PM, Jeremy Hansen wrote: > > I added a new host to kafka. Partitions that fall on this new host have a > very high lag and I

lag for a specific partitions on newly added host

2016-12-09 Thread Jeremy Hansen
I added a new host to kafka. Partitions that fall on this new host have a very high lag and I’m trying to understand why this would be and how to fix it. iloveconsuming blumfrub 0 5434682 7416933 1982251 iloveconsuming_kf0001.h

Re: rebalancing partitions across a jbod

2016-10-20 Thread Jeremy Hansen
mar wrote: > > kafka-reassign-partitions.sh is for migrating data to new/other brokers. > How it is useful for migrating data within same broker? > you reassigned some partitions to other broker and moved back to original > broker? > > On Fri, Oct 21, 2016 at 10:46 AM, Jeremy H

Re: rebalancing partitions across a jbod

2016-10-20 Thread Jeremy Hansen
the old disk contents and add new disk to log.dirs, > kafka replicates the the > data from other brokers and places on available disks. This may take time > depending on data size. > > JIRA related to auto migration: https://issues.apache.org/ > jira/browse/KAFKA-1689 > &

rebalancing partitions across a jbod

2016-10-20 Thread Jeremy Hansen
I’ve read several posts on this but it seemed to be old versions of kafka. I wanted to get the latest proper way to do this. If I add a volume to my brokers running kafka 0.10.0 and I’ve adjusted log.dirs with the new volume mount point, what do I have to do to rebalance so kafka takes advan