RE: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Vinayakumar B
Hi, Please configure HADOOP_COMMON_HOME and HADOOP_HDFS_HOME environment variables. And then start the resource manager it will start. Reason: All the common classes will be loaded to classpath from the HADOOP_COMMON_HOME. So Configuration class is not found in the classpath. Regards,

[jira] [Created] (MAPREDUCE-2805) Update RAID for HDFS-2241

2011-08-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
Update RAID for HDFS-2241 - Key: MAPREDUCE-2805 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2805 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Tsz Wo (Nicholas), SZE {noformat}

Pre-commit Jenkins job disabled

2011-08-11 Thread Aaron T. Myers
https://builds.apache.org/view/G-L/view/Hadoop/job/PreCommit-MAPREDUCE-Build/ Is there a reason the M/R pre-commit build is disabled, while Common and HDFS are enabled? Is this a vestige of the build slaves being offline? -- Aaron T. Myers Software Engineer, Cloudera

[jira] [Created] (MAPREDUCE-2807) MR-279: AM restart does not work after RM refactor

2011-08-11 Thread Sharad Agarwal (JIRA)
MR-279: AM restart does not work after RM refactor -- Key: MAPREDUCE-2807 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2807 Project: Hadoop Map/Reduce Issue Type: Bug

Re: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Vinod KV
Report YARN_* and HADOOP_* variables that you've set before starting the daemons. Also run 'bin/yarn classpath' and post the output of that command too. If the output doesn't contain yarn-server-resourcemanager-1.0-SNAPSHOT.jar, you are missing something. +Vinod On Thursday 11 August

[jira] [Resolved] (MAPREDUCE-2787) MR-279: Performance improvement in running Uber MapTasks

2011-08-11 Thread Ahmed Radwan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Radwan resolved MAPREDUCE-2787. - Resolution: Won't Fix Thanks Arun and Vinod for the clarification. I am closing the

Commits to MR-279 branch

2011-08-11 Thread Vinod KV
Hey all, I am in the process of figuring out all the stuff that is need for successfully merging MR-279 to trunk. I am doing this off-line in parallel so that we are ready when other minor issues are being fixed. Right now I am practicing in a private branch that is updated with trunk code

[jira] [Created] (MAPREDUCE-2808) pull MAPREDUCE-2797 into mr279 branch

2011-08-11 Thread Thomas Graves (JIRA)
pull MAPREDUCE-2797 into mr279 branch - Key: MAPREDUCE-2808 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2808 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2

[jira] [Created] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-08-11 Thread Ramya Sunil (JIRA)
[MR-279] Missing fields in job summary logs Key: MAPREDUCE-2821 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2821 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2

[jira] [Created] (MAPREDUCE-2834) [MR-279] Enable dense update for file sink metrics

2011-08-11 Thread Ramya Sunil (JIRA)
[MR-279] Enable dense update for file sink metrics -- Key: MAPREDUCE-2834 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2834 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-2835) Make per-job counter limits configurable

2011-08-11 Thread Tom White (JIRA)
Make per-job counter limits configurable Key: MAPREDUCE-2835 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2835 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions:

Re: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Matei Zaharia
I get a similar error on Mac OS X. I've built YARN and extracted the tarball to a directory, but when I run bin/yarn-daemon.sh start nodemanager, it prints the following to its log (apologies for the long trace): log4j:WARN No appenders could be found for logger

[jira] [Created] (MAPREDUCE-2836) Provide option to fail jobs when submitted to non-existent pools.

2011-08-11 Thread Jeff Bean (JIRA)
Provide option to fail jobs when submitted to non-existent pools. - Key: MAPREDUCE-2836 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2836 Project: Hadoop Map/Reduce

Re: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Haoyuan Li
I downloaded the latest version: r1156719. and then redid from the scratch. Now, the nodemanager and run well. However, I got into the same state as Matei when I tried to run ResourceManager. Any help will be appreciated. Best, Haoyuan The followings are output. The output from

Re: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Mahadev Konar
Haoyuan, Thats an issue with having avro 1.3.2 jar in the classpath. Please see if you have that version of 1.3.2 jar in the classpath and remove it. We use 1.4 avro jar which isnt compatible with 1.3.2. hope that helps! mahadev On Thu, Aug 11, 2011 at 3:36 PM, Haoyuan Li haoyuan...@gmail.com

Re: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Matei Zaharia
It looks like the Avro 1.3.2 JAR was included in the tar ball built in the mapreduce project. It's present in lib in the unzipped tarball. However, even if I remove it, the error still happens. Matei On Aug 11, 2011, at 3:47 PM, Mahadev Konar wrote: Haoyuan, Thats an issue with having avro

Hadoop-Mapreduce-trunk-Commit - Build # 761 - Still Failing

2011-08-11 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/761/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2852 lines...] ivy-probe-antlib:

Hadoop-Mapreduce-22-branch - Build # 63 - Still Failing

2011-08-11 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/63/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2275 lines...] A

Hadoop-Mapreduce-trunk - Build # 752 - Still Failing

2011-08-11 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/752/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2380 lines...] A bin A

Re: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Haoyuan Li
Hi Mahadev, This works for me. Thank you. However, another issue came to me when I tried to run an example. Here http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL , it says: $HADOOP_COMMON_HOME/bin/hadoop jar

[jira] [Created] (MAPREDUCE-2837) MR-279: Bug fixes ported from y-merge

2011-08-11 Thread Arun C Murthy (JIRA)
MR-279: Bug fixes ported from y-merge - Key: MAPREDUCE-2837 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2837 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Arun C Murthy

[jira] [Created] (MAPREDUCE-2838) to fix mapreduce builds to use the new hadoop common test jars

2011-08-11 Thread Giridharan Kesavan (JIRA)
to fix mapreduce builds to use the new hadoop common test jars -- Key: MAPREDUCE-2838 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2838 Project: Hadoop Map/Reduce Issue

Re: Pre-commit Jenkins job disabled

2011-08-11 Thread Giridharan Kesavan
mr-2838 should be fixed before enabling pre-commit for mr. https://issues.apache.org/jira/browse/MAPREDUCE-2838 -Giri On Thu, Aug 11, 2011 at 12:41 AM, Aaron T. Myers a...@cloudera.com wrote: https://builds.apache.org/view/G-L/view/Hadoop/job/PreCommit-MAPREDUCE-Build/ Is there a reason

Re: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Praveen Sripati
Hoayuan, RunJar is in the hadoop-common-0.23.0-SNAPSHOT.jar. Do a 'hadoop classpath' and check if the jar file is there in the classpath location. Similarly, running 'yarn classpath' will provide the classpath for running the yarn daemons (RM, NM and HS). Thanks, Praveen On Fri, Aug 12, 2011

Hadoop-Mapreduce-trunk-Commit - Build # 762 - Still Failing

2011-08-11 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/762/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2653 lines...] [get] Not modified - so

[jira] [Created] (MAPREDUCE-2839) MR Jobs fail on a secure cluster with viewfs

2011-08-11 Thread Siddharth Seth (JIRA)
MR Jobs fail on a secure cluster with viewfs Key: MAPREDUCE-2839 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839 Project: Hadoop Map/Reduce Issue Type: Bug Reporter:

Re: Can't find main class when run ResourceManager or NodeManager

2011-08-11 Thread Haoyuan Li
Preveen, Thank you for your reply. The CLASSPATH generated by the '/trunk/hadoop-common/src/main/bin/hadoop' and 'hadoop-config.sh' in my machine is a mess. From my understanding, 'hadoop-config.sh' still generates the CLASSPATH based on the build structure from ant? While now we are using mvn.