Basically, each partition of a topic is only consumed by 1 consumer in a group. So there is no coordination needed for advancing the offset of a partition. By default, the offsets are checkpointed to ZK periodically.
Thanks, Jun On Thu, May 31, 2012 at 6:35 AM, S Ahmed <sahmed1...@gmail.com> wrote: > How do you actually setup a consumer group? i.e. a group of consumer > processes that will be pulling messages of a particular brokers topic? > > From what I understand the client has to keep track of the offset, if this > is done using zookeeper, does this mean for every message that is consumed, > it will make a call to zookeeper? That seems to chatty for me, but how > else will multiple consumers coordinate which messages have been processed. >
