[
https://issues.apache.org/jira/browse/METRON-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530392#comment-16530392
]
ASF GitHub Bot commented on METRON-1642:
----------------------------------------
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/1082#discussion_r199607708
--- Diff:
metron-platform/metron-writer/src/main/java/org/apache/metron/writer/kafka/KafkaWriter.java
---
@@ -197,6 +209,15 @@ public void init(Map stormConf, TopologyContext
topologyContext, WriterConfigura
return producerConfig;
}
+ public Optional<String> getKafkaTopic(JSONObject message) {
--- End diff --
What if we unset the value of the topic field after the redirect occurs?
This would force the user to set the field again, if they really want another
redirect.
It seems like on day 1 of a user attempting to use this functionality, they
are going to fall into this trap. To really use this functionality, you need
to set the value in one step and then unset or change it in the next step. If
you don't, its going to loop.
> KafkaWriter should be able choose the topic from a field in addition to
> topology construction time
> --------------------------------------------------------------------------------------------------
>
> Key: METRON-1642
> URL: https://issues.apache.org/jira/browse/METRON-1642
> Project: Metron
> Issue Type: Improvement
> Reporter: Casey Stella
> Priority: Major
>
> Currently, we choose the kafka topic via the kafka.topic field. It would be
> useful to allow people to specify the topic via a field. This would enable
> multi-stage (or chain) parsing, among other use-cases.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
