[
https://issues.apache.org/jira/browse/METRON-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15987350#comment-15987350
]
Nick Allen commented on METRON-901:
-----------------------------------
I was able to work around the problem by doing this.
(1) To fix the parser topologies, I editted
`/var/lib/ambari-server/resources/common-services/METRON/0.4.0/package/scripts/params/params_linux.py`,
then restarted the Ambari server and agents.
{code}
[root@y113 ~]# cat
/var/lib/ambari-server/resources/common-services/METRON/0.4.0/package/scripts/params/params_linux.py
| grep PLAINTEXT
#kafka_security_protocol =
config['configurations']['kafka-broker'].get('security.inter.broker.protocol',
'PLAINTEXT')
kafka_security_protocol = 'SASL_PLAINTEXT'
{code}
(2) Alter the configuration value in Ambari by going to `Metron > Configs >
Advanced > Advanced Metron Environment > elasticsearch.properties template`.
{code}
kafka.security.protocol=SASL_PLAINTEXT
{code}
(3) Edit the Enrichment topology properties on the host where Metron is
installed at '/usr/metron/0.4.0/config/enrichment.properties'.
{code}
[root@y136 0.4.0]# cat /usr/metron/0.4.0/config/enrichment.properties | grep
PLAINTEXT
kafka.security.protocol=SASL_PLAINTEXT
{code}
> Topologies Hung When Deployed with MPack on Kerberos
> ----------------------------------------------------
>
> Key: METRON-901
> URL: https://issues.apache.org/jira/browse/METRON-901
> Project: Metron
> Issue Type: Bug
> Reporter: Nick Allen
>
> I deployed Metron on an 8 node cluster. First I installed HDP 2.5.3.0 using
> Ambari 2.4.2.0, then I installed Metron, Elasticsearch and Kibana. I then
> kerberized the environment using Ambari. All of the Metron topologies launch
> successfully and everything looks nice and green. But when I dig into the
> topologies I see exceptions like the following and no messages are consumed.
> This seems to impact the parsers, enrichment, and indexing.
> {code}
> java.lang.IllegalStateException: Unable to initialize message writer
> at
> org.apache.metron.parsers.bolt.WriterHandler.init(WriterHandler.java:70)
> ~[stormjar.jar:?]
> at
> org.apache.metron.parsers.bolt.WriterBolt.prepare(WriterBolt.java:58)
> ~[stormjar.jar:?]
> at
> org.apache.storm.daemon.executor$fn__6573$fn__6586.invoke(executor.clj:798)
> ~[storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37]
> at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:482)
> [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37]
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
> Caused by: org.apache.kafka.common.KafkaException: Failed to construct kafka
> producer
> at
> org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:335)
> ~[stormjar.jar:?]
> at
> org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:163)
> ~[stormjar.jar:?]
> at
> org.apache.metron.writer.kafka.KafkaWriter.init(KafkaWriter.java:173)
> ~[stormjar.jar:?]
> at
> org.apache.metron.writer.WriterToBulkWriter.init(WriterToBulkWriter.java:44)
> ~[stormjar.jar:?]
> at
> org.apache.metron.parsers.bolt.WriterHandler.init(WriterHandler.java:68)
> ~[stormjar.jar:?]
> ... 5 more
> Caused by: java.lang.IllegalArgumentException: No enum constant
> org.apache.kafka.common.protocol.SecurityProtocol.PLAINTEXTSASL
> at java.lang.Enum.valueOf(Enum.java:238) ~[?:1.8.0_77]
> at
> org.apache.kafka.common.protocol.SecurityProtocol.valueOf(SecurityProtocol.java:28)
> ~[stormjar.jar:?]
> at
> org.apache.kafka.common.protocol.SecurityProtocol.forName(SecurityProtocol.java:89)
> ~[stormjar.jar:?]
> at
> org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:79)
> ~[stormjar.jar:?]
> at
> org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:277)
> ~[stormjar.jar:?]
> at
> org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:163)
> ~[stormjar.jar:?]
> at
> org.apache.metron.writer.kafka.KafkaWriter.init(KafkaWriter.java:173)
> ~[stormjar.jar:?]
> at
> org.apache.metron.writer.WriterToBulkWriter.init(WriterToBulkWriter.java:44)
> ~[stormjar.jar:?]
> at
> org.apache.metron.parsers.bolt.WriterHandler.init(WriterHandler.java:68)
> ~[stormjar.jar:?]
> ... 5 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
