[
https://issues.apache.org/jira/browse/BEAM-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657014#comment-16657014
]
Alexey Romanenko edited comment on BEAM-5786 at 10/19/18 4:19 PM:
------------------------------------------------------------------
[~rangadi] What is a current behaviour if topic gets deleted? I'm not sure that
user can guarantee that topic won't be deleted, so we can't count on this.
Also, do you mean that moving to SDF will solve this problem automatically?
was (Author: aromanenko):
[~rangadi] What is a current behaviour if topic gets deleted? I'm not sure that
user can guarantee that topic won't be deleted.
Also, do you mean that moving to SDF will solve this problem automatically?
> KafkaIO should support topic patterns
> -------------------------------------
>
> Key: BEAM-5786
> URL: https://issues.apache.org/jira/browse/BEAM-5786
> Project: Beam
> Issue Type: Improvement
> Components: io-java-kafka
> Reporter: Alexey Romanenko
> Assignee: Alexey Romanenko
> Priority: Major
>
> For the moment, it is possible to set topics for KafkaIO.Read in 2 ways - one
> single topic by using {{withTopic(String)}} or list of topics by using
> {{withTopics(List<String>)}}.
> It would make sense to provide another way for this using patterns, based on
> regular expressions, like {{withTopics(“org_[0-9]+_source”)}}. In this case,
> Kafka consumer could discover the topics based on user provided pattern.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
