Suppose I have 1 topic with 4 partitions, and I want to do 10
different things with every published element.
Can I have 10 processes that consume *every* message sent to the topic?
That is to say:
for consumerGroup_i in TenConsumerGroupsNames:
runConsumerConnectorThread(topic, consumerGroup_i)
// launches ConsumerConnector runs 4 consumers, one for each partition
OR (equivalently. I think)
for consumerGroup_i in TenConsumerGroupsNames:
for ( partition in 0..3 )
launchConsumerThread(topic, consumerGroup_i, partition)
For a given consumer group, #consumers == #partitions, but I have many groups.
Should I expect each *group* to receive every message published to the topic?
Thanks,
- Stu
