[
https://issues.apache.org/jira/browse/STORM-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14561843#comment-14561843
]
ASF GitHub Bot commented on STORM-817:
--------------------------------------
Github user sumitchawla commented on the pull request:
https://github.com/apache/storm/pull/561#issuecomment-106096242
How to use:
1. Add following to your config:
config.put("kafka.topic.wildcard.match",true);
2. Pass a wildcard topic to KafkaSpout
String topic = "my.clickstream.*.log";
This will match all topics matching the above pattern:
e.g.
my.clickstream.1.log
my.clickstream.2.log
my.clickstream.3.log
> Kafka Wildcard Topic Support
> ----------------------------
>
> Key: STORM-817
> URL: https://issues.apache.org/jira/browse/STORM-817
> Project: Apache Storm
> Issue Type: New Feature
> Components: storm-kafka
> Reporter: Sumit Chawla
> Assignee: Sumit Chawla
>
> Creating a feature request for supporting Wildcard Topic's for Kafka Spout.
> We want to be able to run a aggregation stream for data coming from all
> tenants. Tenants get added dynamically. So new kafka topics get created. All
> the topics will be matching a regex pattern.
> example:
> clickstream:tenant1:log
> clickstream:tenant2:log
> clickstream:tenant3:log
> Storm code should be able to perform auto-discovery, and should be able to to
> fetch from newly created topics in run time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
