Migrating both Zookeeper ensemble and Kafka cluster please confirm steps

Hi Everyone, I need to migrate my organization's Kafka cluster along with the underlying Zookeeper ensemble (cluster) from one set of racks to another within our data center. I am pretty sure I have the steps correct, but I need to confirm just to ensure I am not missing anything. Here's what I

Problem in Get Kafka Consumer

Hello all, I am trying to get consumer metadata from my Java program, using blocking channel as described in this link . The problem is, I always got SocketTimeoutException but when I try to use

Regarding The Kafka Offset Management Issue In Direct Stream Approach.

Hi All, We are working in Apache spark with Kafka integration, in this use case we are using DirectStream approach. we want to avoid the data loss in this approach for actually we take offsets and saving that offset into MongoDB. We want some clarification is Spark stores any offsets internally,

Fwd: New Consumer throws GroupCoordinatorNotAvailableException

Hi, I'm facing an issue with New Consumer. I'm getting GroupCoordinatorNotAvailableException during "poll" method: 12:32:50,942 ERROR ConsumerCoordinator:362 - Auto offset commit failed. org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException: The group coordinator is not

Re: Problems getting offsets

Yes. I know all of that. I guess my original message was not clear. The topic metadata indicates that there is a leader. Please see my comments interspersed below. Thanks David Corbin On 10/29/15, 17:53, "Mayuresh Gharat" wrote: >

Re: Problem in Get Kafka Consumer

After doing some debugging, I found out that consumer metadata request message has been sent to kafka broker but broker doesn't return any result until timeout I tried to restart kafka broker and finally it works. Is there any explanation for this? Thank you, On Mon, Nov 2, 2015 at 10:39 AM,

Authorization Engine For Kafka Related to KPI-11

HI All, Have any one used Apache Ranger as Authorization Engine for Kafka Topic creation, consumption (read) and write operation on a topic. I am looking at having audit log and regulating consumption/ write to particular topic (for example, having

Re: New Consumer throws GroupCoordinatorNotAvailableException

The new consumer only works with the broker in trunk now which will soon become 0.9 On Sun, 1 Nov 2015 at 20:54 Alexey Pirogov wrote: > Hi, I'm facing an issue with New Consumer. I'm getting > GroupCoordinatorNotAvailableException during "poll" method: > 12:32:50,942