Offsets are maintained per consumer group. When an individual consumer crashes, the consumer group coordinator will detect that failure and trigger a rebalance. This redistributes the partitions being consumed across the available consumer processes, using the most recently committed offset for each as the starting point.
On Thu, Feb 8, 2018 at 6:58 AM, Xavier Noria <f...@hashref.com> wrote: > Let's suppose a topic has three partitions and two consumer groups > listening. > > The offset maintained by Kafka in each partition is associated with the > consumer group? Or with the individual consumer polling from that partition > in each consumer group respectively? > > I am trying to understand the system behavior when listeners crash, but in > order to formulate more questions I need to double-check that before. >
