Yes, the leaders are currently speed evenly across five brokers. I also see the
FetchRequestPurgatory.PurgatorySize to be peak as high as ~7.2M and the
suddenly dropping to a couple hundred thousands.
Thanks
Zakee
> On Mar 13, 2015, at 5:27 PM, Joel Koshy wrote:
>
> Can you ve
Can you verify that the leaders are evenly spread? and if necessary
run a preferred leader election?
On Fri, Mar 13, 2015 at 05:10:22PM -0700, Zakee wrote:
> I have 35 topics spread with total 398 partitions (2 of them are supposed to
> be very high volume and so allocated 28 partitions to them,
I have 35 topics spread with total 398 partitions (2 of them are supposed to be
very high volume and so allocated 28 partitions to them, others vary between 5
to 14).
Thanks
Zakee
> On Mar 13, 2015, at 3:25 PM, Joel Koshy wrote:
>
> I think what people have observed in the past is that incr
I think what people have observed in the past is that increasing
num-replica-fetcher-threads has diminishing returns fairly quickly.
You may want to instead increase the number of partitions in the topic
you are producing to. (How many do you have right now?)
On Fri, Mar 13, 2015 at 02:48:17PM -07
Hi Mayuresh,
I have currently set this property to 4 and I see from the logs that it starts
12 threads on each broker. I will try increasing it further.
Thanks
Zakee
> On Mar 13, 2015, at 11:53 AM, Mayuresh Gharat
> wrote:
>
> You might want to increase the number of Replica Fetcher thread
You might want to increase the number of Replica Fetcher threads by setting
this property : *num.replica.fetchers*.
Thanks,
Mayuresh
On Thu, Mar 12, 2015 at 10:39 PM, Zakee wrote:
> With the producer throughput as large as > 150MB/s to 5 brokers on a
> continuous basis, I see a consistently hi
With the producer throughput as large as > 150MB/s to 5 brokers on a continuous
basis, I see a consistently high value for Replica Max Lag (in millions). Is
this normal or there is a way to tune so as to reduce replica MaxLag?
As per documentation, replica max lag (in messages) between follower a
