[ 
https://issues.apache.org/jira/browse/BEAM-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17435538#comment-17435538
 ] 

Alexey Romanenko commented on BEAM-5786:
----------------------------------------

I think BEAM-11325 provides a way to discover new topics/partitions dynamically 
but not based on user patterns, as this Jira states. Though, for now I don't 
see any blockers to implement it.

> KafkaIO should support topic patterns
> -------------------------------------
>
>                 Key: BEAM-5786
>                 URL: https://issues.apache.org/jira/browse/BEAM-5786
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-kafka
>            Reporter: Alexey Romanenko
>            Priority: P3
>
> For the moment, it is possible to set topics for KafkaIO.Read in 2 ways - one 
> single topic by using {{withTopic(String)}} or list of topics by using 
> {{withTopics(List<String>)}}. 
> It would make sense to provide another way for this using patterns, based on 
> regular expressions, like {{withTopics(“org_[0-9]+_source”)}}. In this case, 
> Kafka consumer could discover the topics based on user provided pattern.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to