Did you mix and match versions of Metron? Looks like you are having a classpath issue here
11.09.2018, 12:01, "David McGinnis" <mcginn...@avalonconsult.com>:
Sorry for the delay. We are finding a new error in the worker.log.err file for the parser Storm topology. It appears that it is trying to log to Ganglia and failing. We don't have Ganglia installed on our cluster, and would rather not install it, so is there some way to turn off logging to Ganglia, or a minimal installation path we can do to get rid of this error? Are we correct in assuming this error would be preventing data from getting through the parser?FATAL ERROR in native method: processing of -javaagent failedException in thread "main" java.lang.NoClassDefFoundError: info/ganglia/gmetric4j/GMonitorat java.lang.ClassLoader.defineClass1(Native Method)at java.lang.ClassLoader.defineClass(ClassLoader.java:763)at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)at java.net.URLClassLoader.access$100(URLClassLoader.java:73)at java.net.URLClassLoader$1.run(URLClassLoader.java:368)at java.net.URLClassLoader$1.run(URLClassLoader.java:362)at java.security.AccessController.doPrivileged(Native Method)at java.net.URLClassLoader.findClass(URLClassLoader.java:361)at java.lang.ClassLoader.loadClass(ClassLoader.java:424)at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)at java.lang.ClassLoader.loadClass(ClassLoader.java:357)at sun.instrument.InstrumentationImpl.loadClassAndStartAgent(InstrumentationImpl.java:304)at sun.instrument.InstrumentationImpl.loadClassAndCallPremain(InstrumentationImpl.java:401)Caused by: java.lang.ClassNotFoundException: info.ganglia.gmetric4j.GMonitorat java.net.URLClassLoader.findClass(URLClassLoader.java:381)at java.lang.ClassLoader.loadClass(ClassLoader.java:424)at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)at java.lang.ClassLoader.loadClass(ClassLoader.java:357)... 14 moreOn Fri, Aug 17, 2018 at 10:21 AM David McGinnis <mcginn...@avalonconsult.com> wrote:Thank you all for the quick recommendations. We'll follow up on these recommendations and report back. In the meantime, I can say that we don't have an error index even created in Elastic, so there's nothing in there of value.On Fri, Aug 17, 2018 at 10:13 AM, Simon Elliston Ball <si...@simonellistonball.com> wrote:It might be worth looking in the error and invalid topics, if you have any validation, or your parser is not producing proper timestamps (that's what I usually forget to check!) you may be getting messages routed to the error index. Are you indexing topologies picking any of this up? Is there anything in the ES error index?The other thing worth doing is upgrading 0.4.3 is a very very old version and a lot of changes have come in since then.Simon--On 17 August 2018 at 16:07, David McGinnis <mcginn...@avalonconsult.com> wrote:All,We have a Metron 0.4.3 installation on an HDP cluster which has a sensor set up to read from a Kafka topic and write the data out to Elasticsearch. Data is being inserted into the Kafka topic, and we can read that through Kafka console consumer, but the system is not reporting any data coming through. The Storm spout says no data has been processed, and the index hasn't even been created in Elastic, despite running for nearly a month now.We've searched the worker logs for Storm, and the only error that comes up is a (we think) unrelated error about not being able to find the jmxmetrics JAR file. Metron reports that the topic is found, and does not tell us that the topic is not emitting, so we suspect it sees the data in there.Do you all have any ideas on where we can look to determine the cause of this issue, or things to try?Thanks!
--David McGinnis
Staff Hadoop Consultant | Avalon Consulting, LLC
M: (513) 439-0082
LinkedIn | Google+ | Twitter
-------------------------------------------------------------------------------------------------------------
This message (including any attachments) contains confidential information
intended for a specific individual and purpose, and is protected by law. If
you are not the intended recipient, you should delete this message. Any
disclosure, copying, or distribution of this message, or the taking of any
action based on it, is strictly prohibited.--simon elliston ball@sireb
--David McGinnis
Staff Hadoop Consultant | Avalon Consulting, LLC
M: (513) 439-0082
LinkedIn | Google+ | Twitter
-------------------------------------------------------------------------------------------------------------
This message (including any attachments) contains confidential information
intended for a specific individual and purpose, and is protected by law. If
you are not the intended recipient, you should delete this message. Any
disclosure, copying, or distribution of this message, or the taking of any
action based on it, is strictly prohibited.
--David McGinnis
Staff Hadoop Consultant | Avalon Consulting, LLC
M: (513) 439-0082
LinkedIn | Google+ | Twitter
-------------------------------------------------------------------------------------------------------------
This message (including any attachments) contains confidential information
intended for a specific individual and purpose, and is protected by law. If
you are not the intended recipient, you should delete this message. Any
disclosure, copying, or distribution of this message, or the taking of any
action based on it, is strictly prohibited.
-------------------
Thank you,
James Sirota
PMC- Apache Metron
jsirota AT apache DOT org
