Hi, I have a mapreduce program embeded in a java application, and I am trying to load additional jar files as add-on for the execution of my map reduce job. My program works like this:
JobConf conf = new JobConf(new Configuration(), Demux.class); conf.setBoolean("mapred.used.genericoptionsparser",true); args[x]="-libjars" args[x+1]="/path/to/addon.jar"; int res = ToolRunner.run(conf, new Demux(), args); When the mapreduce job is running, the task failed because it is unable to find the additional classes inside addon.jar. If I extract /mapredsystem/hadoop/mapredsystem/job_200912171752_25474/job.jar, it looks like only the main jar file was in the job.jar. Does the addon.jar needs to be preloaded into all task tracker node? Could the addon.jar get uploaded via the client? If yes, how to do this properly? I am using Hadoop 0.20.0 rc7 from yahoo with capacity scheduler. Thanks in advance. Regards, Eric