Amit Sela created BEAM-727:
------------------------------

             Summary: KafkaIO should support dynamic addition of Kafka 
partitions to assigned topics. 
                 Key: BEAM-727
                 URL: https://issues.apache.org/jira/browse/BEAM-727
             Project: Beam
          Issue Type: Improvement
          Components: sdk-java-extensions
            Reporter: Amit Sela
            Assignee: James Malone
            Priority: Minor


Kafka topics may add partitions dynamically (doesn't require Kafka to restart, 
or halt a topic), and the KafkaIO should probably support this.

*Note:* 
Consistently assigning partitions should be taken into account, specifically 
for the case of reading from multiple topics, where one (or more) of the topics 
added partitions while the pipeline is running.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to