Chandra, Let me see if I understand what you want to do. There is one topic per user (which stores all tweets posted by this user). Each follower consumes the topics corresponding to the users he follows. Conceptually, this works. The question is the number of topics. Currently, Kafka is not suitable for millions of topics.
Jun On Fri, Sep 9, 2011 at 1:40 PM, Chandra R <mybaywo...@gmail.com> wrote: > Hello All, > > I am trying to understand the Kafka 1:N pattern. > I am trying to understand it in terms of a twitter like app. > > For every user there will be 1 Producer. Each follower will be in its own > consumer group and there will be a Broker which will connect Producer to > Consumer groups. > > Am I getting it right ? > > Thanks. Any advice would be appreciated. > > regards > > Chandra R >
