Re: Jobs not running after MAPREDUCE-2880
Ravi, the mailing list gulps in any attachments. Can you create a ticket and attach your logs there? That helps for better tracking of the issue too. Thanks, +Vinod On Sat, Sep 24, 2011 at 1:09 AM, Ravi Prakash ravihad...@gmail.com wrote: Hi Arun, Unsecure single node. I'm attaching the classpath I grepped | sort | uniq from the two task.sh files I got (one from the working version and the other from the notworking version). Looks like the classpath which worked had some other jars not present in the new classpath. I'm guessing as part of the simplification for CLASSPATH maybe we missed something that was being included earlier? Thanks Ravi On Fri, Sep 23, 2011 at 12:18 PM, Arun Murthy a...@hortonworks.com wrote: This is secure mode or unsecured? Cluster or single node? Tx Sent from my iPhone On Sep 23, 2011, at 8:37 AM, Ravi Prakash ravihad...@gmail.com wrote: Hi Arun/Vinod, After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2 Date: Wed Sep 21 18:52:27 2011 + MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/ git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68 My mapreduce jobs are failing 2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocol 2011-09-23 10:27:08,634 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002 2011-09-23 10:27:09,653 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0% 2011-09-23 10:27:16,739 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed with state FAILED 2011-09-23 10:27:16,786 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1246)) - Counters: 0 Digging into the stderr logs: I see this single line Exception in thread main java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster What do I need to add to my environment / config so that the magic happens again? Thanks Ravi.
Jobs not running after MAPREDUCE-2880
Hi Arun/Vinod, After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2 Date: Wed Sep 21 18:52:27 2011 + MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/ git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68 My mapreduce jobs are failing 2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocol 2011-09-23 10:27:08,634 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002 2011-09-23 10:27:09,653 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0% 2011-09-23 10:27:16,739 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed with state FAILED 2011-09-23 10:27:16,786 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1246)) - Counters: 0 Digging into the stderr logs: I see this single line Exception in thread main java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster What do I need to add to my environment / config so that the magic happens again? Thanks Ravi.
Re: Jobs not running after MAPREDUCE-2880
This is secure mode or unsecured? Cluster or single node? Tx Sent from my iPhone On Sep 23, 2011, at 8:37 AM, Ravi Prakash ravihad...@gmail.com wrote: Hi Arun/Vinod, After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2 Date: Wed Sep 21 18:52:27 2011 + MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/ git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68 My mapreduce jobs are failing 2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocol 2011-09-23 10:27:08,634 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002 2011-09-23 10:27:09,653 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0% 2011-09-23 10:27:16,739 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed with state FAILED 2011-09-23 10:27:16,786 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1246)) - Counters: 0 Digging into the stderr logs: I see this single line Exception in thread main java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster What do I need to add to my environment / config so that the magic happens again? Thanks Ravi.
Re: Jobs not running after MAPREDUCE-2880
Hi Arun, Unsecure single node. I'm attaching the classpath I grepped | sort | uniq from the two task.sh files I got (one from the working version and the other from the notworking version). Looks like the classpath which worked had some other jars not present in the new classpath. I'm guessing as part of the simplification for CLASSPATH maybe we missed something that was being included earlier? Thanks Ravi On Fri, Sep 23, 2011 at 12:18 PM, Arun Murthy a...@hortonworks.com wrote: This is secure mode or unsecured? Cluster or single node? Tx Sent from my iPhone On Sep 23, 2011, at 8:37 AM, Ravi Prakash ravihad...@gmail.com wrote: Hi Arun/Vinod, After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2 Date: Wed Sep 21 18:52:27 2011 + MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/ git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68 My mapreduce jobs are failing 2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocol 2011-09-23 10:27:08,634 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002 2011-09-23 10:27:09,653 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0% 2011-09-23 10:27:16,739 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed with state FAILED 2011-09-23 10:27:16,786 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1246)) - Counters: 0 Digging into the stderr logs: I see this single line Exception in thread main java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster What do I need to add to my environment / config so that the magic happens again? Thanks Ravi.