[
https://issues.apache.org/jira/browse/METRON-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528313#comment-16528313
]
ASF GitHub Bot commented on METRON-1642:
----------------------------------------
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/metron/pull/1082#discussion_r199291506
--- Diff:
metron-platform/metron-writer/src/main/java/org/apache/metron/writer/kafka/KafkaWriter.java
---
@@ -197,6 +209,15 @@ public void init(Map stormConf, TopologyContext
topologyContext, WriterConfigura
return producerConfig;
}
+ public Optional<String> getKafkaTopic(JSONObject message) {
+ if(kafkaTopicField != null) {
+ return Optional.ofNullable((String)message.get(kafkaTopicField));
+ }
+ else {
+ return Optional.ofNullable(kafkaTopic);
+ }
--- End diff --
It would make sense to add some debug statements showing which topic was
chosen and what the field value is. This would make debugging a routing issue
much simpler for the user.
> KafkaWriter should be able choose the topic from a field in addition to
> topology construction time
> --------------------------------------------------------------------------------------------------
>
> Key: METRON-1642
> URL: https://issues.apache.org/jira/browse/METRON-1642
> Project: Metron
> Issue Type: Improvement
> Reporter: Casey Stella
> Priority: Major
>
> Currently, we choose the kafka topic via the kafka.topic field. It would be
> useful to allow people to specify the topic via a field. This would enable
> multi-stage (or chain) parsing, among other use-cases.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
