Re: Apache Kafka Questions

2022-03-16 Thread Tauzell, Dave
From: Jatin Chhabriya Date: Wednesday, March 16, 2022 at 9:20 AM To: users@kafka.apache.org Cc: Murali Krishna Subject: [EXTERNAL] Apache Kafka Questions Hello Team Upon careful perusal of documentation and tutorials, our team has a few open questions, and we would appreciate to have these

Apache Kafka Questions

2022-03-16 Thread Jatin Chhabriya
Hello Team Upon careful perusal of documentation and tutorials, our team has a few open questions, and we would appreciate to have these clarified by a hands-on practitioner. a. Can there by more than one Producer in a Publish-Subscribe model? b. More details on level of abstraction between

Transactions and `endOffsets` Java client consumer method

2022-03-16 Thread Chris Jansen
Hello all, I have the need to query end offsets for a particular topic using a consumer that has been configured with the "READ_COMMITTED" isolation level. The response I get via the Java client includes offsets at the end of the log that have not yet been committed and therefore can't be

Re: Setting up the CooperativeStickyAssignor in Java

2022-03-16 Thread Luke Chen
Hi Richard, Right, you are not missing any settings beyond the partition assignment strategy and the group instance id. You might need to know from the log that why the rebalance triggered to do troubleshooting. Thank you. Luke On Wed, Mar 16, 2022 at 3:02 PM Richard Ney wrote: > Hi Luke, > >

Re: Setting up the CooperativeStickyAssignor in Java

2022-03-16 Thread Richard Ney
Hi Luke, I did end up with a situation where I had two instances connecting to the same consumer group and they ended up in a rebalance trade-off. All partitions kept going back and forth between the two microservice instances. That was a test case where I'd removed the Group Instance Id setting

Re: Setting up the CooperativeStickyAssignor in Java

2022-03-16 Thread Luke Chen
Hi Richard, To use `CooperativeStickyAssignor`, no other special configuration is required. I'm not sure what does `make the rebalance happen cleanly` mean. Did you find any problem during group rebalance? Thank you. Luke On Wed, Mar 16, 2022 at 1:00 PM Richard Ney wrote: > Trying to find a