Alexey Romanenko created BEAM-5786:
--------------------------------------

             Summary: KafkaIO should support topic patterns
                 Key: BEAM-5786
                 URL: https://issues.apache.org/jira/browse/BEAM-5786
             Project: Beam
          Issue Type: Improvement
          Components: io-java-kafka
            Reporter: Alexey Romanenko
            Assignee: Raghu Angadi


For the moment, it is possible to set topics for KafkaIO.Read in 2 ways - one 
single topic by using {{withTopic(String)}} or list of topics by using 
{{withTopics(List<String>)}}. 

It would make sense to provide another way for this using patterns, based on 
regular expressions, like {{withTopics(“org_[0-9]+_source”)}}. In this case, 
Kafka consumer could discover the topics based on user provided pattern.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to