Re: kafka streams partition assignor strategy for version 2.5.1 - does it use sticky assignment

2023-04-16 Thread Pushkar Deole
Thanks John... however I have few more questions: How does this configuration work along with static group membership protocol? Or does this work only with dynamic group membership and not work well when static membership is configured? Secondly, I gather that streams doesn't immediately trigger

Re: kafka streams partition assignor strategy for version 2.5.1 - does it use sticky assignment

2023-04-15 Thread John Roesler
Hi Pushkar, In 2.5, Kafka Streams used an assignor that tried to strike a compromise between stickiness and workload balance, so you would observe some stickiness, but not all the time. In 2.6, we introduced the "high availability task assignor" (see KIP-441

Re: kafka streams partition assignor strategy for version 2.5.1 - does it use sticky assignment

2023-04-14 Thread Pushkar Deole
Any inputs on below query? On Wed, Apr 12, 2023 at 2:22 PM Pushkar Deole wrote: > Hi All, > > We are using version 2.5.1 of kafka-streams with 3 application instances > deployed as 3 kubernetes pods. > It consumes from multiple topics, each with 6 partitions. > I would like to know if streams

kafka streams partition assignor strategy for version 2.5.1 - does it use sticky assignment

2023-04-12 Thread Pushkar Deole
Hi All, We are using version 2.5.1 of kafka-streams with 3 application instances deployed as 3 kubernetes pods. It consumes from multiple topics, each with 6 partitions. I would like to know if streams uses sticky partition assignor strategy internally since we can't set it externally on streams.