zhray created METRON-2338:
-----------------------------
Summary: The PCAP topology doesn't work
Key: METRON-2338
URL: https://issues.apache.org/jira/browse/METRON-2338
Project: Metron
Issue Type: Bug
Environment: centos 7.7 + ambari 2.6.2 + HDP 2.6.5 + metron
0.7.2（e57a795）+ librdkafka-0.11.5
Reporter: zhray
I can process data in bro format normally, but the pcap topology will always
report errors, even though the input source has not been set。
I followed this tutorial：[Metron 0.4.1 with HDP 2.5 bare-metal install on
Centos 7 with MariaDB for Metron
REST|https://cwiki.apache.org/confluence/display/METRON/Metron+0.4.1+with+HDP+2.5+bare-metal+install+on+Centos+7+with+MariaDB+for+Metron+REST]
{code:java}
2020-01-08 19:41:57.536 o.a.s.k.s.KafkaSpout Thread-6-kafkaSpout-executor[3 3]
[INFO] Initialization complete
2020-01-08 19:41:57.568 o.a.s.util Thread-6-kafkaSpout-executor[3 3] [ERROR]
Async loop died!
java.lang.IllegalArgumentException: Expected a key but none provided
at
org.apache.metron.spout.pcap.deserializer.FromKeyDeserializer.deserializeKeyValue(FromKeyDeserializer.java:44)
~[stormjar.jar:?]
at
org.apache.metron.spout.pcap.HDFSWriterCallback.apply(HDFSWriterCallback.java:104)
~[stormjar.jar:?]
at
org.apache.storm.kafka.CallbackCollector.emit(CallbackCollector.java:59)
~[stormjar.jar:?]
at
org.apache.storm.kafka.spout.KafkaSpout.emitOrRetryTuple(KafkaSpout.java:496)
~[stormjar.jar:?]
at
org.apache.storm.kafka.spout.KafkaSpout.emitIfWaitingNotEmitted(KafkaSpout.java:440)
~[stormjar.jar:?]
at
org.apache.storm.kafka.spout.KafkaSpout.nextTuple(KafkaSpout.java:308)
~[stormjar.jar:?]
at
org.apache.metron.spout.pcap.KafkaToHDFSSpout.nextTuple(KafkaToHDFSSpout.java:76)
~[stormjar.jar:?]
at
org.apache.storm.daemon.executor$fn__10125$fn__10140$fn__10173.invoke(executor.clj:652)
~[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at org.apache.storm.util$async_loop$fn__1221.invoke(util.clj:484)
[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
2020-01-08 19:41:57.574 o.a.s.d.executor Thread-6-kafkaSpout-executor[3 3]
[ERROR]
java.lang.IllegalArgumentException: Expected a key but none provided
at
org.apache.metron.spout.pcap.deserializer.FromKeyDeserializer.deserializeKeyValue(FromKeyDeserializer.java:44)
~[stormjar.jar:?]
at
org.apache.metron.spout.pcap.HDFSWriterCallback.apply(HDFSWriterCallback.java:104)
~[stormjar.jar:?]
at
org.apache.storm.kafka.CallbackCollector.emit(CallbackCollector.java:59)
~[stormjar.jar:?]
at
org.apache.storm.kafka.spout.KafkaSpout.emitOrRetryTuple(KafkaSpout.java:496)
~[stormjar.jar:?]
at
org.apache.storm.kafka.spout.KafkaSpout.emitIfWaitingNotEmitted(KafkaSpout.java:440)
~[stormjar.jar:?]
at
org.apache.storm.kafka.spout.KafkaSpout.nextTuple(KafkaSpout.java:308)
~[stormjar.jar:?]
at
org.apache.metron.spout.pcap.KafkaToHDFSSpout.nextTuple(KafkaToHDFSSpout.java:76)
~[stormjar.jar:?]
at
org.apache.storm.daemon.executor$fn__10125$fn__10140$fn__10173.invoke(executor.clj:652)
~[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at org.apache.storm.util$async_loop$fn__1221.invoke(util.clj:484)
[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
2020-01-08 19:41:57.604 o.a.s.util Thread-6-kafkaSpout-executor[3 3] [ERROR]
Halting process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341)
[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.7.0.jar:?]
at
org.apache.storm.daemon.worker$fn__10799$fn__10800.invoke(worker.clj:763)
[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at
org.apache.storm.daemon.executor$mk_executor_data$fn__10011$fn__10012.invoke(executor.clj:276)
[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at org.apache.storm.util$async_loop$fn__1221.invoke(util.clj:494)
[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
2020-01-08 19:41:57.607 o.a.s.d.worker Thread-13 [INFO] Shutting down worker
pcap-18-1577968006 7b03b065-884b-4961-a139-63f8f1ef531b 6701
2020-01-08 19:41:57.607 o.a.s.d.worker Thread-13 [INFO] Terminating messaging
context
2020-01-08 19:41:57.608 o.a.s.d.worker Thread-13 [INFO] Shutting down executors
2020-01-08 19:41:57.608 o.a.s.d.executor Thread-13 [INFO] Shutting down
executor
__metricsorg.apache.hadoop.metrics2.sink.storm.StormTimelineMetricsSink:[2 2]
2020-01-08 19:41:57.609 o.a.s.util Thread-3-disruptor-executor[2 2]-send-queue
[INFO] Async loop interrupted!
{code}
by the way，what are the passwords and users of Alerts UI and Management UI? The
admin/admin and user/password are wrong!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
