Re: Not able to execute MRv2

2011-08-09 Thread Praveen Sripati
Hi, For some reason none of the .log files are getting generated, so I had to put some println and figure out the problems. I just see the .out files for the RM, NM and the HistoryServer. 1) I get the below error while starting the ResourceManager. In the hadoop-mapreduce-1.0-SNAPSHOT/lib

Re: Not able to execute MRv2

2011-08-09 Thread Mahadev Konar
Hi Praveen, This is an issue because of incompatible versions of avro. This occurs if you have avro 1.3.2 in your cp. We use avro 1.4. For the time being you can remove any occurence of avro 1.3.2. jar in your classpath and that should get you out of the error below. For fixing it in the

[jira] [Created] (MAPREDUCE-2789) [MR:279] Update the scheduling info on CLI

2011-08-09 Thread Ramya Sunil (JIRA)
[MR:279] Update the scheduling info on CLI -- Key: MAPREDUCE-2789 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2789 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2

[jira] [Created] (MAPREDUCE-2790) [MR-279] Add additional field for storing the AM/job history info on CLI

2011-08-09 Thread Ramya Sunil (JIRA)
[MR-279] Add additional field for storing the AM/job history info on CLI Key: MAPREDUCE-2790 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2790 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-2791) [MR-279] Missing/incorrect info on job -status CLI

2011-08-09 Thread Ramya Sunil (JIRA)
[MR-279] Missing/incorrect info on job -status CLI --- Key: MAPREDUCE-2791 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2791 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-2792) [MR-279] Replace IP addresses with hostnames

2011-08-09 Thread Ramya Sunil (JIRA)
[MR-279] Replace IP addresses with hostnames Key: MAPREDUCE-2792 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2792 Project: Hadoop Map/Reduce Issue Type: Improvement Components:

[jira] [Created] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2011-08-09 Thread Ramya Sunil (JIRA)
[MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs -- Key: MAPREDUCE-2793 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-2794) [MR-279] Incorrect metrics value for AvailableGB per queue per user

2011-08-09 Thread Ramya Sunil (JIRA)
[MR-279] Incorrect metrics value for AvailableGB per queue per user --- Key: MAPREDUCE-2794 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2794 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-2795) [MR-279] AppsKilled is never incremented

2011-08-09 Thread Ramya Sunil (JIRA)
[MR-279] AppsKilled is never incremented Key: MAPREDUCE-2795 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2795 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2

[jira] [Created] (MAPREDUCE-2796) [MR-279] Start time for all the apps is set to 0

2011-08-09 Thread Ramya Sunil (JIRA)
[MR-279] Start time for all the apps is set to 0 Key: MAPREDUCE-2796 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2796 Project: Hadoop Map/Reduce Issue Type: Bug Components:

Hadoop-Mapreduce-trunk-Commit - Build # 760 - Failure

2011-08-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/760/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2421 lines...] A

Hadoop-Mapreduce-trunk - Build # 751 - Still Failing

2011-08-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/751/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2396 lines...] A build-utils.xml A

Hadoop-Mapreduce-22-branch - Build # 62 - Still Failing

2011-08-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/62/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2281 lines...] A

Re: Problem with MRv2 Build

2011-08-09 Thread Haoyuan Li
Hi Tom, I also have trouble in building the current MR-279. How to compile common by using mvn? And do you mean that http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL doesn't work anymore? Thank you. Best, Haoyuan On Thu, Aug 4, 2011 at 8:19 AM, Thomas Graves

Re: Problem with MRv2 Build

2011-08-09 Thread Praveen Sripati
Haoyuan, The instructions at the mentioned URL are not updated. 1. Get the code from trunk. 2. Remove the mapreduce folder. 3. Get the mapreduce code from MR-279 branch. 4. Run the build scripts. echo Common build . mvn clean install package -Pbintar -DskipTests echo HDFS build . cd

Adaptive resource assignment is possible in MRv2?

2011-08-09 Thread Hyunsik Choi
Hi guys, MRv2 looks very promising for various applications. We have considered an application based on Yarn, but this app is required the adaptive resource assignment. In other words, this app may need additional resources while this app is running. Is it possible? After I look at some code,

Re: Problem with MRv2 Build

2011-08-09 Thread Arun C Murthy
Looks like you don't have autotool chain required to build the native code for launching containers. It isn't critical - you can run with the java based DefaultContainerExecutor. Just pass -P-cbuild to maven to skip building the native code. Arun On Aug 9, 2011, at 10:24 PM, Haoyuan Li wrote:

Re: Problem with MRv2 Build

2011-08-09 Thread Praveen Sripati
Haoyuan, I am using Ubuntu 11.04, which doesn't come with autoconf/autoreconf. So, I had to install autoconf (installed autoconf and autoreconf) to get rid of the above error. Thanks, Praveen On Wed, Aug 10, 2011 at 10:58 AM, Arun C Murthy a...@hortonworks.com wrote: Looks like you don't have