Thank you all, I get it now. I was trying thinking in terms of RabbitMQ's fanout exchange.
So from what I understand it will be difficult to implement if number of users are in millions (or in our case grows to millions), as we need a topic for each user. I wish there was an option thought :) reagrds, Chandra On Fri, Sep 9, 2011 at 4:04 PM, Jun Rao <jun...@gmail.com> wrote: > Chandra, > > Let me see if I understand what you want to do. There is one topic per user > (which stores all tweets posted by this user). Each follower consumes the > topics corresponding to the users he follows. Conceptually, this works. The > question is the number of topics. Currently, Kafka is not suitable for > millions of topics. > > Jun > > On Fri, Sep 9, 2011 at 1:40 PM, Chandra R <mybaywo...@gmail.com> wrote: > > > Hello All, > > > > I am trying to understand the Kafka 1:N pattern. > > I am trying to understand it in terms of a twitter like app. > > > > For every user there will be 1 Producer. Each follower will be in its own > > consumer group and there will be a Broker which will connect Producer to > > Consumer groups. > > > > Am I getting it right ? > > > > Thanks. Any advice would be appreciated. > > > > regards > > > > Chandra R > > >
