[
https://issues.apache.org/jira/browse/METRON-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15368173#comment-15368173
]
Nick Allen commented on METRON-279:
-----------------------------------
Based on git history...
I mistakenly added `metron_kafka` and `metron_hbase` roles as part of
METRON-211 (silly me)
Then as part of METRON-223, we added the 'parser_invalid' and 'parser_error'
topics to `metron_kafka`.
Unfortunately, the `metron_kafka` and `metron_hbase` roles were never being
used.
The 'parser_invalid' and 'parser_error' topics were not being created as part
of the deployment process.
Our testing could have passed METRON-223 because the topics were just
auto-created. If that's the case, then this is super-easy to fix and we can
wrap this up. The alternative is that I am totally wrong and confused and so I
don't want to fix anything until I am enlightened.
> Multiple metron_kafka roles available in metron deployment directory
> --------------------------------------------------------------------
>
> Key: METRON-279
> URL: https://issues.apache.org/jira/browse/METRON-279
> Project: Metron
> Issue Type: Bug
> Affects Versions: 0.2.1BETA
> Reporter: Neha Sinha
> Priority: Minor
> Fix For: 0.2.1BETA
>
>
> Hi,
> There are two roles available that try to accomplish the task of creating
> default kafka topics:-
> -metron-kafka
> -metron_kafka_topics
>
> We would need to purge one of them.
> The main.yml file for metron_kafka_topics has the following entries :-
> topics_to_create:
> - { topic: "pcap", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> - { topic: "bro", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> - { topic: "yaf", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> - { topic: "snort", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> - { topic: "enrichments", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> Whereas main.yml file for metron_kafka has the following entries :-
> topics_to_create:
> - { topic: "pcap", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> - { topic: "bro", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> - { topic: "yaf", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> - { topic: "parser_invalid", num_partitions: 1, replication_factor:
> 1, retention_gb: 10 }
> - { topic: "parser_error", num_partitions: 1, replication_factor:
> 1, retention_gb: 10 }
> - { topic: "snort", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> - { topic: "enrichments", num_partitions: 1, replication_factor: 1,
> retention_gb: 10 }
> So particularly i see the topics "parser_error" and "parser_invalid" missing
> in
> metron_kafka_topics/main.yml file.
> Regards,
> Neha
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
