i know where the problem is , i didn't put log4j and hadoop-metrics file into all nodes' hadoop conf dir. Now the problem disapears but for hadoop metrics, i only got dfs data in mysql, no mapreduce, jvm, rpc data, why? thank you~
At 2011-07-01 22:59:41，"Eric Yang" <[email protected]> wrote: >Looks like mapreduce can not find json.jar in its class path. Which >version of Hadoop are you using? > >regards, >Eric > >2011/7/1 孙长 <[email protected]>: >> hi,i have copied chukwa-hadoop-*-client.jar and json.jar to >> HADOOP_HOME/lib, and restarted hadoop, but the MR job lanched by demux runs >> error: >> task error is as follows: >> >> Error: java.lang.ClassNotFoundException: org.json.JSONException >> at java.net.URLClassLoader$1.run(URLClassLoader.java:200) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:188) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:307) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:252) >> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) >> at java.lang.Class.forName0(Native Method) >> at java.lang.Class.forName(Class.java:169) >> at >> org.apache.hadoop.chukwa.extraction.demux.processor.mapper.MapProcessorFactory.getProcessor(MapProcessorFactory.java:40) >> at >> org.apache.hadoop.chukwa.extraction.demux.Demux$MapClass.map(Demux.java:95) >> at >> org.apache.hadoop.chukwa.extraction.demux.Demux$MapClass.map(Demux.java:64) >> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) >> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358) >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) >> at org.apache.hadoop.mapred.Child.main(Child.java:170) >> >> At 2011-07-01 13:17:42，"Eric Yang" <[email protected]> wrote: >> >>>Did you copy chukwa-hadoop-*-client.jar and json.jar to >>>HADOOP_HOME/lib, and restart hadoop? >>> >>>regards, >>>Eric >>> >>>2011/6/30 孙长 <[email protected]>: >>>> Hi, I am using chukwa 0.4 , and i start a collector and a agent on two >>>> nodes, but i only got system metrics in mysql, no hadoop metrics like jvm, >>>> dfs, mapred >>>> dbAdmin.sh is running background, log4j.properties >>>> and hadoop-metrics.properties in hadoop conf dir are set according to user >>>> guide >>>> no dfs, mapred logs in chukwa/log/metrics dir. >>>> thank you ~ >>>> >>>> >> >> >>
