Re: Zookeeper and Kafka cluster docker issue

[2018-07-16 17:01:34,699] WARN [Producer clientId=console-producer] Got > >> error produce response with correlation id 17 on topic-partition r3p3-0, > >> retrying (0 attempts left). Error: NOT_LEADER_FOR_PARTITION > >> (org.apache.kafka.clients.producer.internals.Sender)

Re: Zookeeper and Kafka cluster docker issue

I believe you need to use -e KAFKA_ADVERTISED_PORT=909.. On Mon, Jul 16, 2018 at 7:41 AM, Mich Talebzadeh wrote: > Hi, > > I have created a zookeeper and three brokers as dockers in a physical host > as shown below > > [image: image.png] > > The followings are used to create Zookeeper and Kafka

Brokers are failing to handle UpdateMetadata and LeaderAndIsRequest requests from controller

Hi, I have a Kafka 1.1 cluster that doesn't start up correctly: many partitions are not replicated correctly. In the controller.log I see messages indicating that brokers aren't succesfully handling LeaderAndIsRequest and UpdateMetadata requests. For example: [2018-07-04 13:31:18,788] WARN

Re: Event sourcing with Kafka and Kafka Streams. How to deal with atomicity

Hi, I like Kafka but I don't understand the claim that it can be used for Event Sourcing (here and here ) One part of the event sourcing is the ability to subscribe to events published

Re: Kafka cluster behavior: broker no longer belonging to ISR, offsets reset to middle of partition

Turns out that ntp was not correctly setup and so the clocks were incorrect. I'd imagine that this would explain why brokers left the ISRs. On Mon, Sep 19, 2016 at 2:50 PM, Chris Richardson <ch...@chrisrichardson.net > wrote: > Hi, > > One of my Kafka 0.9.0.1 clus

Kafka cluster behavior: broker no longer belonging to ISR, offsets reset to middle of partition

Hi, One of my Kafka 0.9.0.1 clusters (3 brokers, default.replication.factor=2) that has been working fine until yesterday. The message volume was pretty low. There were no obvious problems except The first symptom was *kafka-consumer-groups.sh* failing with an empty.head exception. When I

Re: Too Many Open Files

Gwen, Is there any particular reason why "inactive" (no consumers or producers for a topic) files need to be open? Chris -- Learn microservices - http://learnmicroservices.io Microservices application platform http://eventuate.io On Fri, Jul 29, 2016 at 6:33 PM, Gwen Shapira

Re: Kafka for event sourcing architecture

Oli, Kafka is only a partial solution. As I describe here ( http://www.slideshare.net/chris.e.richardson/hacksummit-2016-eventdriven-microservices-events-on-the-outside-on-the-inside-and-at-the-core/57) an event store is a hybrid of a database and a message broker. It is a database because it

ConsumerConnector.shutdown() behavior

Hi, I am using Kafka 0.8.1.1 I’ve noticed that the call to ConsumerConnector.shutdown.shutdown() takes approximately 30 seconds. Coincidentally, that’s the same as *socket.timeout.ms* http://socket.timeout.ms/ I also see this message in the logs right before the call completes: 13:21:52.708