Unexpected cluster rebalancing

2020-09-30 Thread omer bar lev
As part of our load tests on Kafka, we are trying to create a certain number of sink connectors, each one with a unique name and topic and therefore, each sink connector is in his own consumer group. For every new connector added, a rebalance is triggered for all the connectors (the more

Kafka consumer coming without partition assignment

2020-09-30 Thread Sanjay Tiwari
Hi All, I am using Kafka version 2.4.0. I have 8 Kafka broker. I am having a topic with 80 partition and 80 java based consumer. Sometime I find very stange behaviour on consumer restart i.e. consumer comes up with no partitions assigned to them.. in log messages appear like "adding newly

Re: Sign up email for apache kafka notifications

2020-09-30 Thread Guozhang Wang
Hello Josh, Please help yourself subscribing to the mailing list of Kafka: https://kafka.apache.org/contact On Wed, Sep 30, 2020 at 9:36 AM wrote: > Hello, > > This is an email to sign up for the notifications for apache kafka. > Please advise if there are any further actions that I will need

Re: Is this a valid use case for reading local store ?

2020-09-30 Thread Guozhang Wang
Hello Mohan, If I understand correctly, your async event trigger process runs out of the streams application, that reads the state stores of app2 through the interactive query interface, right? This is actually a pretty common use case pattern for IQ :) Guozhang On Wed, Sep 30, 2020 at 1:22 PM

Is this a valid use case for reading local store ?

2020-09-30 Thread Parthasarathy, Mohan
Hi, A traditional kafka streams application (App1) reading data from a kafka topic, doing aggregations resulting in some local state. The output of this application is consumed by a different application(App2) for doing a different task. Under some conditions, there is an external trigger

Subscription Confirmation

2020-09-30 Thread omer bar lev
I confirm

Sign up email for apache kafka notifications

2020-09-30 Thread barclays . middleware
Hello, This is an email to sign up for the notifications for apache kafka. Please advise if there are any further actions that I will need to take. Many thanks Josh Joshua Racey | Middleware Security & Control | Apprentice | Infrastructure Services Phone : 03301529774 Email: