Re: Unreasonably high CPU from Kafka (0.8.2.1)

2015-09-17 Thread Jaikiran Pai
Sending this to the dev list since the Kafka dev team might have more inputs on this one. Can someone please take a look at the issue noted below and whether the suggested change makes sense? -Jaikiran On Tuesday 15 September 2015 12:03 AM, Jaikiran Pai wrote: We have been using Kafka for a

Re: Unreasonably high CPU from Kafka (0.8.2.1)

2015-09-17 Thread Jun Rao
The selector is probably not the issue. If there is no incoming traffic, selector.select(300) won't return until after 300ms. Thanks, Jun On Thu, Sep 17, 2015 at 1:13 PM, Jaikiran Pai wrote: > Sending this to the dev list since the Kafka dev team might have more >

Unreasonably high CPU from Kafka (0.8.2.1)

2015-09-14 Thread Jaikiran Pai
We have been using Kafka for a while now in one of dev projects. Currently we have just 1 broker and 1 zookeeper instance. Almost every day, Kafka "stalls" and we end up cleaning up the data/log folder of Kafka and zookeeper and bring it up afresh. We haven't been able to narrow down the issue