If there is no partitions (only one partition), then two consumers exist. Is it possible only one consumer to get data from kafka(two broker)? I can`t understand ...
-----Original Message----- From: Jun Rao [mailto:jun...@gmail.com] Sent: Tuesday, December 18, 2012 1:39 AM To: users@kafka.apache.org Subject: Re: partition and consumer stream number Currently, partition is the smallest unit that we distribute data among consumers (in the same consumer group). So, if the # of consumers is larger than the total number of partitions in a Kafka cluster (across all brokers), some consumers will never get any data. Thanks, Jun On Mon, Dec 17, 2012 at 6:03 AM, 永辉 赵 <zhaoyong...@gmail.com> wrote: > Hi all, > > In consumer we use a topic count map to set how many stream we want to > split the topic. > What's the relation between kafka partition number and consumer stream > number? > Seems stream number should be less or equal to partition number? > Because if we set stream number bigger than partition number then some > stream is empty or some partition is split. > > Thanks, > Yonghui > > > >
