Jason Rosenberg created KAFKA-1072:
--------------------------------------

             Summary: Allow mulitple topics selected with a TopicFilter to be 
balanced among consumers
                 Key: KAFKA-1072
                 URL: https://issues.apache.org/jira/browse/KAFKA-1072
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 0.8
            Reporter: Jason Rosenberg


Currently, there is no parallelism used when consuming a set of topics selected 
by a white list topic filter, if those topics all have a partition count of 1.  
Currently, all topics that match the filter get assigned to the same thread on 
the same consumer, even though there may be plenty of different topics (and 
therefore many partitions to be consumed from).

There are often good reasons to use a partition count of only 1 (e.g. to 
preserve message ordering).  For arbitrary scalability, over a large number of 
topics, this would be a great benefit to be able to consume topics balanced 
over a set of available consumers.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to