[jira] [Created] (MAPREDUCE-2878) Fix the INSTALL file

Fix the INSTALL file Key: MAPREDUCE-2878 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2878 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.23.0 Reporter: XieXianshan

Build failure in map reduce trunk

Hi everyone, I'm a new bie to this list. Hope this is not too much of a dumb question. I'm trying to build the map reduce trunk. (I already build from the root pom and everything built fine, but map reduce is not included in the root pom) The build fails at this point given below. Appreciate if

Re: Build failure in map reduce trunk

Tharindu, Looks like protoc is not available. --- Cannot run program protoc (in directory HOME/hadoop-trunk/hadoop- mapreduce/hadoop-yarn/hadoop-yarn-api): error=2, No such file or directory - [Help 1] --- Here are instructions to build protoc See

Hadoop-Mapreduce-trunk-Commit - Build # 786 - Failure

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/786/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 979 lines...] [ivy:resolve] fs: tried

Regarding number of map tasks

Hi, Just want to ask , how one can control the number of mappers for a given job. I have a 2 cpu with 2 cores machine i.e 4 cores having Red Hat 4.1.2-48. I have a sqoop export job, with Input size :320,139,321Bytes Block size : 4096Bytes It is creating 3 map tasks for this export job. When I

How to run yarn?

Hi, https://issues.apache.org/jira/browse/HADOOP-7563 (or whatever other jira was responsible) was so awesome that I was able to export HADOOP_COMMON_HOME, HADOOP_HDFS_HOME and run target/hadoop-common-0.23.0-SNAPSHOT/sbin/hadoop-daemon.sh start namenode|datanode|secondarynamenode without any

Re: DistCpV2 in 0.23

Contribs are hard to follow and maintain, if this is really a rewrite shouldn't it be in the core code? BTW nice to see that distcp is being reengineered, love the new features listed in that jira. Thx, J-D On Wed, Aug 24, 2011 at 9:51 PM, Amareshwari Sri Ramadasu amar...@yahoo-inc.com wrote:

Re: DistCpV2 in 0.23

Nice work! I definitely think this should go in 23 and 20x. Agree with JD that it should be in the core code, not contrib. If it's going to be maintained then we should put it in the core code. Thanks, Eli On Wed, Aug 24, 2011 at 9:51 PM, Amareshwari Sri Ramadasu amar...@yahoo-inc.com wrote:

Re: DistCpV2 in 0.23

On Thu, Aug 25, 2011 at 10:36 AM, Eli Collins e...@cloudera.com wrote: Nice work!   I definitely think this should go in 23 and 20x. Agree with JD that it should be in the core code, not contrib.  If it's going to be maintained then we should put it in the core code. Now that we're all

Re: DistCpV2 in 0.23

Agree, it should be a separate maven module. And it should be under hadoop-mapreduce-client, right? And now that we are in the topic, the same should go for streaming, no? Thanks. Alejandro On Thu, Aug 25, 2011 at 10:58 AM, Todd Lipcon t...@cloudera.com wrote: On Thu, Aug 25, 2011 at 10:36

[jira] [Created] (MAPREDUCE-2879) Change mrv2 version to be 0.23.0-SNAPSHOT

Change mrv2 version to be 0.23.0-SNAPSHOT - Key: MAPREDUCE-2879 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2879 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Arun C Murthy

Re: DistCpV2 in 0.23

+1 for a seperate module in hadoop-mapreduce-project. I think hadoop-mapreduce-client might not be right place for it. We might have to pick a new maven module under hadoop-mapreduce-project that could host streaming/distcp/hadoop archives. thanks mahadev On Thu, Aug 25, 2011 at 11:04 AM,

[jira] [Created] (MAPREDUCE-2880) Fix classpath construction for MRv2

Fix classpath construction for MRv2 --- Key: MAPREDUCE-2880 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2880 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Affects

Re: DistCpV2 in 0.23

Maybe a separate toplevel for hadoop-tools? Stuff like RAID could go in there as well - ie tools that are downstream of MR and/or HDFS. On Thu, Aug 25, 2011 at 12:09 PM, Mahadev Konar maha...@hortonworks.com wrote: +1 for a seperate module in hadoop-mapreduce-project. I think

Hadoop-Mapreduce-trunk-Commit - Build # 788 - Failure

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/788/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1446 lines...] [ivy:resolve] -- artifact

Hadoop-Mapreduce-trunk-Commit - Build # 789 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/789/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1040 lines...] [ivy:resolve]

Fwd: Hadoop-Mapreduce-trunk-Commit - Build # 789 - Still Failing

Looks like we might need to clean the ivy cache on the build machine? mahadev Begin forwarded message: From: Apache Jenkins Server jenk...@builds.apache.org Date: August 25, 2011 12:32:40 PM PDT To: mapreduce-dev@hadoop.apache.org Subject: Hadoop-Mapreduce-trunk-Commit - Build # 789 - Still

Hadoop-Mapreduce-trunk-Commit - Build # 790 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/790/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1034 lines...] [ivy:resolve] fs: tried

Hadoop-Mapreduce-trunk-Commit - Build # 791 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/791/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 81940 lines...] [ivy:resolve] :: problems

Hadoop-Mapreduce-trunk-Commit - Build # 792 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/792/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 949 lines...] [ivy:resolve] WARNINGS

[jira] [Resolved] (MAPREDUCE-1943) Implement limits on per-job JobConf, Counters, StatusReport, Split-Sizes

[ https://issues.apache.org/jira/browse/MAPREDUCE-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved MAPREDUCE-1943. -- Resolution: Fixed Implement limits on per-job JobConf, Counters, StatusReport,

Hadoop-Mapreduce-trunk-Commit - Build # 793 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/793/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 948 lines...] [ivy:resolve] :: problems

Hadoop-Mapreduce-trunk-Commit - Build # 795 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/795/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 28535 lines...] [ivy:configure] :: Ivy 2.1.0

[jira] [Created] (MAPREDUCE-2881) mapreduce ant compilation fails java.lang.IllegalStateException: impossible to get artifacts

mapreduce ant compilation fails java.lang.IllegalStateException: impossible to get artifacts -- Key: MAPREDUCE-2881 URL:

Hadoop-Mapreduce-trunk-Commit - Build # 797 - Failure

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/797/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1773 lines...] [jsp-compile] log4j:WARN No

Hadoop-Mapreduce-trunk-Commit - Build # 798 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/798/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1711 lines...] [jsp-compile] log4j:WARN See

[jira] [Created] (MAPREDUCE-2883) MR FI tests failing to build

MR FI tests failing to build Key: MAPREDUCE-2883 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2883 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Affects Versions: 0.23.0

Hadoop-Mapreduce-trunk-Commit - Build # 799 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/799/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1737 lines...] [jsp-compile] log4j:WARN No

Hadoop-Mapreduce-trunk-Commit - Build # 800 - Still Failing

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/800/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7867 lines...] init: [touch] Creating

[jira] [Created] (MAPREDUCE-2884) tmpjars not working when default filesystem mismatches between client and server

tmpjars not working when default filesystem mismatches between client and server Key: MAPREDUCE-2884 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2884 Project:

Re: Build failure in map reduce trunk

Thairindu, Try to get more information for debugging. [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. Thanks, Praveen On Fri, Aug 26, 2011 at 1:55 AM, Tharindu Mathew

Re: DistCpV2 in 0.23

Agree. It should be separate maven module (and patch puts it as separate maven module now). And top level for hadoop tools is nice to have, but it becomes hard to maintain until patch automation tests run the tests under tools. Currently we see many times the changes in HDFS effecting RAID

Re: Build failure in map reduce trunk

Hi Tharindu, I think it is trying to compile the native code. you can add -P-cbuild as argument to skip it, as mentioned earlier by Arun. Regards, Ravi Teja Thanks Praveen. I managed to proceed further. Now I'm stuck at this point. Appreciate if you can tell me what I'm doing wrong.