[
https://issues.apache.org/jira/browse/METRON-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530146#comment-16530146
]
ASF GitHub Bot commented on METRON-1642:
----------------------------------------
Github user cestella commented on a diff in the pull request:
https://github.com/apache/metron/pull/1082#discussion_r199553063
--- Diff: metron-platform/metron-parsers/README.md ---
@@ -166,6 +166,15 @@ then it is assumed to be a regex and will match any
topic matching the pattern (
* `batchTimeout` : The timeout after which a batch will be flushed even
if batchSize has not been met. Optional.
If unspecified, or set to `0`, it defaults to a system-determined
duration which is a fraction of the Storm
parameter `topology.message.timeout.secs`. Ignored if batchSize is
`1`, since this disables batching.
+ * The kafka writer can be configured within the parser config as well.
(This is all configured a priori, but this is convenient for overriding the
settings) :
--- End diff --
That's a very good point, I can move this documentation into metron-writer
and link to it.
> KafkaWriter should be able choose the topic from a field in addition to
> topology construction time
> --------------------------------------------------------------------------------------------------
>
> Key: METRON-1642
> URL: https://issues.apache.org/jira/browse/METRON-1642
> Project: Metron
> Issue Type: Improvement
> Reporter: Casey Stella
> Priority: Major
>
> Currently, we choose the kafka topic via the kafka.topic field. It would be
> useful to allow people to specify the topic via a field. This would enable
> multi-stage (or chain) parsing, among other use-cases.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
