As far as I know, consumers within the same group don't work in pub sub mode and here is the reason -
So if you have more than one consumer within a group then they will load balance on partitions of the same topic to achieve parallelism. Ordering isn't guaranteed in this mode. If you add a third consumer within the same group all existing consumers release their partitions first and balance existing partitions among the three. Since one partition gets assigned to only one consumer within a group duplication doesn't happen. Inder ------Original Message------ From: Mark To: kafka-users@incubator.apache.org ReplyTo: kafka-users@incubator.apache.org Subject: Consumer groups Sent: Nov 12, 2011 8:00 AM How do consumer groups work? Say I have 3 consumers each reading from topic1 how do you ensue each consumer is not consuming a message that has been consumed by another consumer? Sent from BlackBerry® on Airtel