Re: metrics-core version problem

2016-08-23 Thread Da Zhou 
Hi Luping,

I tested Apache Eagle 0.4.0 on CDH 5.5.2 last month, it was working fine.
But what I used was "Logstash"  but not log4j appender, as logstash is
easier to configure from my view.

If you want to try logstash, you can follow this link to set up Apache
Eagle env on CDH:
https://github.com/DadanielZ/eaglemonitoring.github.io/blob/199dc0f280d408cd4cb3ad76a861b6d05e228d69/cloudera-integration.md

Or if you have already set up  configurations including  kafka, storm, et,
 then all you need to do is:
- install logstash on you machine (Apache Eagle online documents provides
conf sample for version 1.5.x, and 2.x, so I suggest you to use logstash
2.x.)
- create a logstash conf file. Conf file sample is here:
https://github.com/apache/incubator-eagle/blob/branch-0.4/eagle-assembly/src/main/docs/logstash-kafka-conf.md
)
Then you should be all set.

Let me know if you have any other issues.

Thanks and regards,
Da

On Aug 23, 2016, at 3:47 AM, 邱路平  wrote:

Hi：

The CDH hadoop got the error，and the KafkaLog4jAppender do not work.



log4j:WARN Error during default initialization

java.lang.NoClassDefFoundError: com/yammer/metrics/Metrics

   at kafka.metrics.KafkaMetricsGroup$class.newMeter(KafkaMetricsGroup.
scala:79)

   at kafka.producer.ProducerStats.newMeter(ProducerStats.scala:23)

   at kafka.producer.ProducerStats.(ProducerStats.scala:25)

   at
kafka.producer.ProducerStatsRegistry$$anonfun$1.apply(ProducerStats.scala:34
)

   at
kafka.producer.ProducerStatsRegistry$$anonfun$1.apply(ProducerStats.scala:34
)

   at kafka.utils.Pool.getAndMaybePut(Pool.scala:61)

   at
kafka.producer.ProducerStatsRegistry$.getProducerStats(ProducerStats.scala:3
8)

   at
kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:48
)

   at kafka.producer.Producer.(Producer.scala:60)

   at
org.apache.eagle.log4j.kafka.KafkaLog4jAppender.activateOptions(KafkaLog4jAp
pender.scala:113)

   at
org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)

   at
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172
)

   at
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104
)

   at
org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.jav
a:842)

   at
org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.jav
a:768)

   at
org.apache.log4j.PropertyConfigurator.parseCatsAndRenderers(PropertyConfigur
ator.java:672)

   at
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:
516)

   at
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:
580)

   at
org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.
java:526)

   at org.apache.log4j.LogManager.(LogManager.java:127)

   at org.apache.log4j.Logger.getLogger(Logger.java:104)

   at
org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:262)

   at
org.apache.commons.logging.impl.Log4JLogger.(Log4JLogger.java:108)

   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)

   at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
sorImpl.java:57)

   at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
torAccessorImpl.java:45)

   at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

   at
org.apache.commons.logging.impl.LogFactoryImpl.createLogFromClass(LogFactory
Impl.java:1025)

   at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(Log
FactoryImpl.java:844)

   at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.ja
va:541)

   at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.ja
va:292)

   at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.ja
va:269)

   at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:657)

   at
org.apache.hadoop.conf.Configuration.(Configuration.java:178)

   at
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:175)

Caused by: java.lang.ClassNotFoundException: com.yammer.metrics.Metrics

   at java.net.URLClassLoader$1.run(URLClassLoader.java:366)

   at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

   at java.security.AccessController.doPrivileged(Native Method)

   at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

   at java.lang.ClassLoader.loadClass(ClassLoader.java:425)

   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)

   at java.lang.ClassLoader.loadClass(ClassLoader.java:358)



How Can I fix it?



rube

Re: metrics-core version problem

2016-08-23 Thread Huizhi Lu 
Hi,

It looks like a Kafka/java version problem: Kafka in Eagle and CHD are not
matched.

1) What version of Eagle are you using, 0.3.x, 0.4 or develop?

2) Eagle 0.3.x and 0.4 don't support Java 1.8.

Can you give more environment details?


On Tue, Aug 23, 2016 at 3:47 AM, 邱路平  wrote:

> Hi：
>
> The CDH hadoop got the error，and the KafkaLog4jAppender do not work.
>
>
>
> log4j:WARN Error during default initialization
>
> java.lang.NoClassDefFoundError: com/yammer/metrics/Metrics
>
> at kafka.metrics.KafkaMetricsGroup$class.newMeter(
> KafkaMetricsGroup.
> scala:79)
>
> at kafka.producer.ProducerStats.newMeter(ProducerStats.scala:23)
>
> at kafka.producer.ProducerStats.(ProducerStats.scala:25)
>
> at
> kafka.producer.ProducerStatsRegistry$$anonfun$1.apply(
> ProducerStats.scala:34
> )
>
> at
> kafka.producer.ProducerStatsRegistry$$anonfun$1.apply(
> ProducerStats.scala:34
> )
>
> at kafka.utils.Pool.getAndMaybePut(Pool.scala:61)
>
> at
> kafka.producer.ProducerStatsRegistry$.getProducerStats(Produ
> cerStats.scala:3
> 8)
>
> at
> kafka.producer.async.DefaultEventHandler.(DefaultEvent
> Handler.scala:48
> )
>
> at kafka.producer.Producer.(Producer.scala:60)
>
> at
> org.apache.eagle.log4j.kafka.KafkaLog4jAppender.activateOpti
> ons(KafkaLog4jAp
> pender.scala:113)
>
> at
> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
>
> at
> org.apache.log4j.config.PropertySetter.setProperties(Propert
> ySetter.java:172
> )
>
> at
> org.apache.log4j.config.PropertySetter.setProperties(Propert
> ySetter.java:104
> )
>
> at
> org.apache.log4j.PropertyConfigurator.parseAppender(Property
> Configurator.jav
> a:842)
>
> at
> org.apache.log4j.PropertyConfigurator.parseCategory(Property
> Configurator.jav
> a:768)
>
> at
> org.apache.log4j.PropertyConfigurator.parseCatsAndRenderers(
> PropertyConfigur
> ator.java:672)
>
> at
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyCo
> nfigurator.java:
> 516)
>
> at
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyCo
> nfigurator.java:
> 580)
>
> at
> org.apache.log4j.helpers.OptionConverter.selectAndConfigure(
> OptionConverter.
> java:526)
>
> at org.apache.log4j.LogManager.(LogManager.java:127)
>
> at org.apache.log4j.Logger.getLogger(Logger.java:104)
>
> at
> org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JL
> ogger.java:262)
>
> at
> org.apache.commons.logging.impl.Log4JLogger.(Log4JLogger.java:108)
>
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(Native
> ConstructorAcces
> sorImpl.java:57)
>
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(De
> legatingConstruc
> torAccessorImpl.java:45)
>
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>
> at
> org.apache.commons.logging.impl.LogFactoryImpl.createLogFrom
> Class(LogFactory
> Impl.java:1025)
>
> at
> org.apache.commons.logging.impl.LogFactoryImpl.discoverLogIm
> plementation(Log
> FactoryImpl.java:844)
>
> at
> org.apache.commons.logging.impl.LogFactoryImpl.newInstance(
> LogFactoryImpl.ja
> va:541)
>
> at
> org.apache.commons.logging.impl.LogFactoryImpl.getInstance(
> LogFactoryImpl.ja
> va:292)
>
> at
> org.apache.commons.logging.impl.LogFactoryImpl.getInstance(
> LogFactoryImpl.ja
> va:269)
>
> at org.apache.commons.logging.LogFactory.getLog(LogFactory.java
> :657)
>
> at
> org.apache.hadoop.conf.Configuration.(Configuration.java:178)
>
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(Nam
> eNode.java:175)
>
> Caused by: java.lang.ClassNotFoundException: com.yammer.metrics.Metrics
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
>
>
> How Can I fix it?
>
>
>
> rube
>
>

metrics-core version problem

2016-08-23 Thread 邱路平 
Hi：

The CDH hadoop got the error，and the KafkaLog4jAppender do not work.

 

log4j:WARN Error during default initialization

java.lang.NoClassDefFoundError: com/yammer/metrics/Metrics

at kafka.metrics.KafkaMetricsGroup$class.newMeter(KafkaMetricsGroup.
scala:79)

at kafka.producer.ProducerStats.newMeter(ProducerStats.scala:23)

at kafka.producer.ProducerStats.(ProducerStats.scala:25)

at
kafka.producer.ProducerStatsRegistry$$anonfun$1.apply(ProducerStats.scala:34
)

at
kafka.producer.ProducerStatsRegistry$$anonfun$1.apply(ProducerStats.scala:34
)

at kafka.utils.Pool.getAndMaybePut(Pool.scala:61)

at
kafka.producer.ProducerStatsRegistry$.getProducerStats(ProducerStats.scala:3
8)

at
kafka.producer.async.DefaultEventHandler.(DefaultEventHandler.scala:48
)

at kafka.producer.Producer.(Producer.scala:60)

at
org.apache.eagle.log4j.kafka.KafkaLog4jAppender.activateOptions(KafkaLog4jAp
pender.scala:113)

at
org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)

at
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172
)

at
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104
)

at
org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.jav
a:842)

at
org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.jav
a:768)

at
org.apache.log4j.PropertyConfigurator.parseCatsAndRenderers(PropertyConfigur
ator.java:672)

at
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:
516)

at
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:
580)

at
org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.
java:526)

at org.apache.log4j.LogManager.(LogManager.java:127)

at org.apache.log4j.Logger.getLogger(Logger.java:104)

at
org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:262)

at
org.apache.commons.logging.impl.Log4JLogger.(Log4JLogger.java:108)

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)

at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
sorImpl.java:57)

at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
torAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

at
org.apache.commons.logging.impl.LogFactoryImpl.createLogFromClass(LogFactory
Impl.java:1025)

at
org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(Log
FactoryImpl.java:844)

at
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.ja
va:541)

at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.ja
va:292)

at
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.ja
va:269)

at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:657)

at
org.apache.hadoop.conf.Configuration.(Configuration.java:178)

at
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:175)

Caused by: java.lang.ClassNotFoundException: com.yammer.metrics.Metrics

at java.net.URLClassLoader$1.run(URLClassLoader.java:366)

at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

at java.lang.ClassLoader.loadClass(ClassLoader.java:425)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)

at java.lang.ClassLoader.loadClass(ClassLoader.java:358)

 

How Can I fix it?

 

rube