Sorry please ignore my question, it was a silly classpath issue that's since been resolved.
Thanks, Jiaqi On Mon, May 25, 2009 at 5:38 AM, Jiaqi Tan <[email protected]> wrote: > Hi, > > I'm trying to run a MapReduce program which links against Chukwa > classes e.g. ChukwaRecord, ChukwaRecordKey, ChukwaRecordPartitioner. > I've copied the chukwa-core-0.1.2.jar file into the lib/ directory of > the Hadoop installation that I'm running this program on. My code has > been successfully compiled (the build.xml for my program includes the > chukwa-core-0.1.2.jar file as one of the classpath entries), but when > I try to run the program, I'm getting error messages that look like: > > 2009-05-24 23:34:46,810 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: > Initializing JVM Metrics with processName=MAP, sessionId= > 2009-05-24 23:34:47,016 INFO org.apache.hadoop.mapred.MapTask: > numReduceTasks: 1 > 2009-05-24 23:34:47,043 WARN org.apache.hadoop.mapred.TaskTracker: > Error running child > java.lang.RuntimeException: java.lang.RuntimeException: > java.lang.ClassNotFoundException: > org.apache.hadoop.chukwa.extraction.demux.ChukwaRecordPartitioner > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:680) > at > org.apache.hadoop.mapred.JobConf.getPartitionerClass(JobConf.java:739) > at > org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:348) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193) > at > org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198) > Caused by: java.lang.RuntimeException: > java.lang.ClassNotFoundException: > org.apache.hadoop.chukwa.extraction.demux.ChukwaRecordPartitioner > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:648) > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:672) > ... 4 more > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.chukwa.extraction.demux.ChukwaRecordPartitioner > at java.net.URLClassLoader$1.run(URLClassLoader.java:200) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:188) > at java.lang.ClassLoader.loadClass(ClassLoader.java:307) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > at java.lang.ClassLoader.loadClass(ClassLoader.java:252) > at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:247) > at > org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:628) > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:646) > ... 5 more > > I did have a line in my code that imports > org.apache.hadoop.chukwa.extraction.demux.* so I'm not sure if this is > a linking issue. Also, the mapper does actually start, and the input > does seem to be getting read, only that the partitioner is failing. Is > there something I'm missing? > > Thanks, > Jiaqi >
