Nick Allen created METRON-901:
---------------------------------
Summary: Topologies Hung When Deployed with MPack on Kerberos
Key: METRON-901
URL: https://issues.apache.org/jira/browse/METRON-901
Project: Metron
Issue Type: Bug
Reporter: Nick Allen
I deployed Metron on an 8 node cluster. First I installed HDP 2.5.3.0 using
Ambari 2.4.2.0, then I installed Metron, Elasticsearch and Kibana. I then
kerberized the environment using Ambari. All of the Metron topologies launch
successfully and everything looks nice and green. But when I dig into the
topologies I see exceptions like the following and no messages are consumed.
This seems to impact the parsers, enrichment, and indexing.
{code}
java.lang.IllegalStateException: Unable to initialize message writer
at
org.apache.metron.parsers.bolt.WriterHandler.init(WriterHandler.java:70)
~[stormjar.jar:?]
at
org.apache.metron.parsers.bolt.WriterBolt.prepare(WriterBolt.java:58)
~[stormjar.jar:?]
at
org.apache.storm.daemon.executor$fn__6573$fn__6586.invoke(executor.clj:798)
~[storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37]
at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:482)
[storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77]
Caused by: org.apache.kafka.common.KafkaException: Failed to construct kafka
producer
at
org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:335)
~[stormjar.jar:?]
at
org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:163)
~[stormjar.jar:?]
at
org.apache.metron.writer.kafka.KafkaWriter.init(KafkaWriter.java:173)
~[stormjar.jar:?]
at
org.apache.metron.writer.WriterToBulkWriter.init(WriterToBulkWriter.java:44)
~[stormjar.jar:?]
at
org.apache.metron.parsers.bolt.WriterHandler.init(WriterHandler.java:68)
~[stormjar.jar:?]
... 5 more
Caused by: java.lang.IllegalArgumentException: No enum constant
org.apache.kafka.common.protocol.SecurityProtocol.PLAINTEXTSASL
at java.lang.Enum.valueOf(Enum.java:238) ~[?:1.8.0_77]
at
org.apache.kafka.common.protocol.SecurityProtocol.valueOf(SecurityProtocol.java:28)
~[stormjar.jar:?]
at
org.apache.kafka.common.protocol.SecurityProtocol.forName(SecurityProtocol.java:89)
~[stormjar.jar:?]
at
org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:79)
~[stormjar.jar:?]
at
org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:277)
~[stormjar.jar:?]
at
org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:163)
~[stormjar.jar:?]
at
org.apache.metron.writer.kafka.KafkaWriter.init(KafkaWriter.java:173)
~[stormjar.jar:?]
at
org.apache.metron.writer.WriterToBulkWriter.init(WriterToBulkWriter.java:44)
~[stormjar.jar:?]
at
org.apache.metron.parsers.bolt.WriterHandler.init(WriterHandler.java:68)
~[stormjar.jar:?]
... 5 more
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
