Hadoop-Mapreduce-trunk-Commit - Build # 881 - Still Failing

2011-09-12 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/881/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 7760 lines...]
[ivy:resolve] 
/home/jenkins/.m2/repository/com/sun/jersey/jersey-json/work...@asf001.sp2.ygridcore.net/jersey-json-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
com.sun.jersey#jersey-json;work...@asf001.sp2.ygridcore.net!jersey-json.jar:
[ivy:resolve] 
/home/jenkins/.m2/repository/com/sun/jersey/jersey-json/work...@asf001.sp2.ygridcore.net/jersey-json-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]    apache-snapshot: tried
[ivy:resolve] 
https://repository.apache.org/content/repositories/snapshots/com/sun/jersey/jersey-json/work...@asf001.sp2.ygridcore.net/jersey-json-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
com.sun.jersey#jersey-json;work...@asf001.sp2.ygridcore.net!jersey-json.jar:
[ivy:resolve] 
https://repository.apache.org/content/repositories/snapshots/com/sun/jersey/jersey-json/work...@asf001.sp2.ygridcore.net/jersey-json-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]    maven2: tried
[ivy:resolve] 
http://repo1.maven.org/maven2/com/sun/jersey/jersey-json/work...@asf001.sp2.ygridcore.net/jersey-json-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
com.sun.jersey#jersey-json;work...@asf001.sp2.ygridcore.net!jersey-json.jar:
[ivy:resolve] 
http://repo1.maven.org/maven2/com/sun/jersey/jersey-json/work...@asf001.sp2.ygridcore.net/jersey-json-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]   module not found: 
com.sun.jersey#jersey-server;work...@asf001.sp2.ygridcore.net
[ivy:resolve]    fs: tried
[ivy:resolve] 
/home/jenkins/.m2/repository/com/sun/jersey/jersey-server/work...@asf001.sp2.ygridcore.net/jersey-server-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
com.sun.jersey#jersey-server;work...@asf001.sp2.ygridcore.net!jersey-server.jar:
[ivy:resolve] 
/home/jenkins/.m2/repository/com/sun/jersey/jersey-server/work...@asf001.sp2.ygridcore.net/jersey-server-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]    apache-snapshot: tried
[ivy:resolve] 
https://repository.apache.org/content/repositories/snapshots/com/sun/jersey/jersey-server/work...@asf001.sp2.ygridcore.net/jersey-server-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
com.sun.jersey#jersey-server;work...@asf001.sp2.ygridcore.net!jersey-server.jar:
[ivy:resolve] 
https://repository.apache.org/content/repositories/snapshots/com/sun/jersey/jersey-server/work...@asf001.sp2.ygridcore.net/jersey-server-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]    maven2: tried
[ivy:resolve] 
http://repo1.maven.org/maven2/com/sun/jersey/jersey-server/work...@asf001.sp2.ygridcore.net/jersey-server-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
com.sun.jersey#jersey-server;work...@asf001.sp2.ygridcore.net!jersey-server.jar:
[ivy:resolve] 
http://repo1.maven.org/maven2/com/sun/jersey/jersey-server/work...@asf001.sp2.ygridcore.net/jersey-server-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]   module not found: 
org.apache.hadoop#hadoop-auth;work...@asf001.sp2.ygridcore.net
[ivy:resolve]    fs: tried
[ivy:resolve] 
/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/work...@asf001.sp2.ygridcore.net/hadoop-auth-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
org.apache.hadoop#hadoop-auth;work...@asf001.sp2.ygridcore.net!hadoop-auth.jar:
[ivy:resolve] 
/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-auth/work...@asf001.sp2.ygridcore.net/hadoop-auth-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]    apache-snapshot: tried
[ivy:resolve] 
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-auth/work...@asf001.sp2.ygridcore.net/hadoop-auth-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
org.apache.hadoop#hadoop-auth;work...@asf001.sp2.ygridcore.net!hadoop-auth.jar:
[ivy:resolve] 
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-auth/work...@asf001.sp2.ygridcore.net/hadoop-auth-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]    maven2: tried
[ivy:resolve] 
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-auth/work...@asf001.sp2.ygridcore.net/hadoop-auth-work...@asf001.sp2.ygridcore.net.pom
[ivy:resolve] -- artifact 
org.apache.hadoop#hadoop-auth;work...@asf001.sp2.ygridcore.net!hadoop-auth.jar:
[ivy:resolve] 
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-auth/work...@asf001.sp2.ygridcore.net/hadoop-auth-work...@asf001.sp2.ygridcore.net.jar
[ivy:resolve]   ::
[ivy:resolve]   ::  UNRESOLVED DEPENDENCIES ::
[ivy:resolve]   

Hadoop-Mapreduce-trunk-Commit - Build # 882 - Still Failing

2011-09-12 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/882/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9959 lines...]
 [exec] depbase=`echo impl/sort.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`;\
 [exec] g++ -DHAVE_CONFIG_H -I. 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes
 -I./impl-Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -MT impl/sort.o -MD -MP -MF $depbase.Tpo -c -o impl/sort.o 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes/impl/sort.cc
 \
 [exec] mv -f $depbase.Tpo $depbase.Po
 [exec] /bin/bash ./libtool --tag=CXX   --mode=link g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2   -o pipes-sort impl/sort.o 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread 
 [exec] libtool: link: g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -o pipes-sort impl/sort.o  
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread
 [exec] make[1]: Entering directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'
 [exec] test -z 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 || /bin/mkdir -p 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 [exec]   /bin/bash ./libtool   --mode=install /usr/bin/install -c 
wordcount-simple wordcount-part wordcount-nopipe pipes-sort 
'/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin'
 [exec] libtool: install: /usr/bin/install -c wordcount-simple 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-simple
 [exec] libtool: install: /usr/bin/install -c wordcount-part 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-part
 [exec] libtool: install: /usr/bin/install -c wordcount-nopipe 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-nopipe
 [exec] libtool: install: /usr/bin/install -c pipes-sort 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/pipes-sort
 [exec] make[1]: Nothing to be done for `install-data-am'.
 [exec] make[1]: Leaving directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'

compile-c++-examples:

compile-examples:
[javac] Compiling 43 source files to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/examples
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

ivy-resolve-test:

ivy-retrieve-test:

compile-mapred-test:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/classes
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testjar
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testshell

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-09-12 Thread Vinod Kumar Vavilapalli
Alright, I think we've discussed enough on this and everybody seems to agree
about a top level hadoop-tools module.

Time to get into the action. I've filed HADOOP-7624. Amareshwari we can
track the rest of the implementation related details and questions for your
specific answers there.

Thanks everyone for putting in your thoughts here.
+Vinod


On Fri, Sep 9, 2011 at 10:55 AM, Rottinghuis, Joep jrottingh...@ebay.comwrote:

 If hadoop-tools will be built as part of hadoop-common, then none of these
 tools should be allowed to have a dependency on hdfs or mapreduce.
 Conversely is also true, when tools do have any such dependency, they
 cannot be bult as part of hadoop-common.
 We cannot have circular dependencies like that.

 That is probably obvious, but I'm just saying...

 Joep
 
 From: Amareshwari Sri Ramadasu [amar...@yahoo-inc.com]
 Sent: Wednesday, September 07, 2011 9:33 PM
 To: mapreduce-dev@hadoop.apache.org
 Cc: common-...@hadoop.apache.org
 Subject: Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

 It is good to have hadoop-tools module separately. But as I asked before we
 need to answer some questions here. I'm trying to answer them myself.
 Comments are welcome.

   1.  Should the patches for tools be created against Hadoop Common?
 Here, I meant should Hadoop common mailing list be used Or should we have a
 separate mailing list for Tools? I agree with Vinod  here, that we can tie
 it Hadoop-common jira/mailing lists.

   2.  What will happen to the tools test automation? Will it run as part
 of Hadoop Common tests?
 Jenkins nightly/patch builds for Hadoop tools can run as part of Hadoop
 common if use Hadoop common mailing list for this.
 Also, I propose every patch build of HDFS and MAPREDUCE should also run
 tools tests to make sure nothing is broken. That would ease the maintenance
 of hadoop-tools module. I presume tools test should not take much time (some
 thing like not more than 30 minutes).

   3.  Will it introduce a dependency from MapReduce to Common? Or is this
  taken care in Mavenization?
 I'm not sure about this whether Mavenization can take care of it.

 Thanks
 Amareshwari

 On 9/8/11 9:13 AM, Rottinghuis, Joep jrottingh...@ebay.com wrote:

 Does a separate hadoop-tools module imply that there will be a separate
 Jenkins build as well?

 Thanks,

 Joep
 
 From: Alejandro Abdelnur [t...@cloudera.com]
 Sent: Wednesday, September 07, 2011 11:35 AM
 To: mapreduce-dev@hadoop.apache.org
 Subject: Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

 Makes sense

 On Wed, Sep 7, 2011 at 11:32 AM, milind.bhandar...@emc.com wrote:

  +1 for separate hadoop-tools module. However, if a tool is broken at
  release time, and no one comes forward to fix it, it should be removed.
  (i.e. Unlike contrib modules, where build and test failures were
  tolerated.)
 
  - milind
 
  On 9/7/11 11:27 AM, Mahadev Konar maha...@hortonworks.com wrote:
 
  I like the idea of having tools as a seperate module and I dont think
  that it will be a dumping ground unless we choose to make one of it.
  
  +1 for hadoop tools module under trunk.
  
  thanks
  mahadev
  
  On Wed, Sep 7, 2011 at 11:18 AM, Alejandro Abdelnur t...@cloudera.com
  wrote:
   Agreed, we should not have a dumping ground. IMO, what it would go
 into
   hadoop-tools (i.e. distcp, streaming and someone could argue for
  FsShell as
   well) are effectively hadoop CLI utilities. Having them in a separate
  module
   rather in than in the core module (common, hdfs, mapreduce) does not
  mean
   that they are secondary things, just modularization. Also it will help
  to
   get those tools to use public interfaces of the core module, and when
 we
   finally have a clean hadoop-client layer, those tools should only
  depend on
   that.
  
   Finally, the fact that tools would end up under trunk/hadoop-tools, it
  does
   not prevent that the packaging from HDFS and MAPREDUCE to bundle the
   same/different tools
  
   +1 for hadoop-tools/ (not binding)
  
   Thanks.
  
  
   On Wed, Sep 7, 2011 at 10:50 AM, Eric Yang eric...@gmail.com wrote:
  
   Mapreduce and HDFS are distinct function of Hadoop.  They are loosely
   coupled.  If we have tools aggregator module, it will not have as
   clear distinct function as other Hadoop modules.  Hence, it is
   possible for a tool to be depend on both HDFS and map reduce.  If
   something broke in tools module, it is unclear which subproject's
   responsibility to maintain tools function.  Therefore, it is safer to
   send tools to incubator or apache extra rather than deposit the
   utility tools in tools subcategory.  There are many short lived
   projects that attempts to associate themselves with Hadoop but not
   being maintained.  It would be better to spin off those utility
   projects than use Hadoop as a dumping ground.
  
   The previous discussion for removing contrib, most people were in
   favor of 

[jira] [Resolved] (MAPREDUCE-2629) Class loading quirk prevents inner class method compilation

2011-09-12 Thread Eric Caspole (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eric Caspole resolved MAPREDUCE-2629.
-

   Resolution: Invalid
Fix Version/s: 0.23.0

It seems MRv2 removed the classes where this problem was occurring. If I see 
this pattern arise again I'll file a new bug.

 Class loading quirk prevents inner class method compilation
 ---

 Key: MAPREDUCE-2629
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2629
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
  Components: task
Affects Versions: 0.21.0, 0.22.0
Reporter: Eric Caspole
Priority: Minor
 Fix For: 0.23.0

 Attachments: MAPREDUCE-2629.patch

   Original Estimate: 24h
  Remaining Estimate: 24h

 While profiling jobs like terasort and gridmix, I noticed that a
 method org.apache.hadoop.mapreduce.task.ReduceContextImpl.access
 $000 is near the top. It turns out that this is because the
 ReduceContextImpl class has a member backupStore which is accessed
 from an inner class ReduceContextImpl$ValueIterator. Due to the way
 synthetic accessor methods work, every access of backupStore results
 in a call to access$000 to the outer class. For some portion of the
 run, backupStore is null and the BackupStore class has never been
 loaded by the reducer.
 Due to the way the Hotspot JVM inliner works, by default it will not
 inline a short method where the class of of the return value object
 is unloaded - if you use a debug JVM with -XX:+PrintCompilation you
 will see a failure reason message like unloaded signature classes.
 This causes every call to ReduceContextImpl.access$000 to be executed
 in the interpreter for the handful of bytecodes to return the null
 backupStore.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hadoop-Mapreduce-trunk-Commit - Build # 883 - Still Failing

2011-09-12 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/883/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9961 lines...]
 [exec] depbase=`echo impl/sort.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`;\
 [exec] g++ -DHAVE_CONFIG_H -I. 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes
 -I./impl-Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -MT impl/sort.o -MD -MP -MF $depbase.Tpo -c -o impl/sort.o 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes/impl/sort.cc
 \
 [exec] mv -f $depbase.Tpo $depbase.Po
 [exec] /bin/bash ./libtool --tag=CXX   --mode=link g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2   -o pipes-sort impl/sort.o 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread 
 [exec] libtool: link: g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -o pipes-sort impl/sort.o  
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread
 [exec] make[1]: Entering directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'
 [exec] test -z 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 || /bin/mkdir -p 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 [exec]   /bin/bash ./libtool   --mode=install /usr/bin/install -c 
wordcount-simple wordcount-part wordcount-nopipe pipes-sort 
'/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin'
 [exec] libtool: install: /usr/bin/install -c wordcount-simple 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-simple
 [exec] libtool: install: /usr/bin/install -c wordcount-part 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-part
 [exec] libtool: install: /usr/bin/install -c wordcount-nopipe 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-nopipe
 [exec] libtool: install: /usr/bin/install -c pipes-sort 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/pipes-sort
 [exec] make[1]: Nothing to be done for `install-data-am'.
 [exec] make[1]: Leaving directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'

compile-c++-examples:

compile-examples:
[javac] Compiling 43 source files to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/examples
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

ivy-resolve-test:

ivy-retrieve-test:

compile-mapred-test:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/classes
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testjar
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testshell

[jira] [Created] (MAPREDUCE-2982) App/Tasks progress is showing as 0% in UI even if successfully completed

2011-09-12 Thread Devaraj K (JIRA)
App/Tasks progress is showing as 0% in UI even if successfully completed


 Key: MAPREDUCE-2982
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2982
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: jobhistoryserver, resourcemanager
Affects Versions: 0.24.0
Reporter: Devaraj K
Assignee: Devaraj K
 Attachments: App Progress.jpg, Tasks Progress.jpg

Application/Tasks progress is showing as 0% in UI even if successfully 
completed as shown in the attached screen shots.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (MAPREDUCE-2984) Throwing NullPointerException when we open the container page

2011-09-12 Thread Devaraj K (JIRA)
Throwing NullPointerException when we open the container page
-

 Key: MAPREDUCE-2984
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2984
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: nodemanager
Affects Versions: 0.24.0
Reporter: Devaraj K
Assignee: Devaraj K


{code:xml}
Caused by: java.lang.NullPointerException
at 
org.apache.hadoop.yarn.api.records.ContainerId.compareTo(ContainerId.java:97)
at 
org.apache.hadoop.yarn.api.records.ContainerId.compareTo(ContainerId.java:23)
at 
java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:819)
at 
java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1640)
at 
org.apache.hadoop.yarn.server.nodemanager.webapp.ContainerPage$ContainerBlock.render(ContainerPage.java:70)
at 
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:64)
at 
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:74)
at org.apache.hadoop.yarn.webapp.View.render(View.java:210)
{code}

{code:xml}
Caused by: java.lang.NullPointerException
at 
org.apache.hadoop.yarn.server.nodemanager.webapp.ContainerPage$ContainerBlock.render(ContainerPage.java:71)
at 
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:64)
at 
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:74)
at org.apache.hadoop.yarn.webapp.View.render(View.java:210)
at 
org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.java:47)
at 
org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.java:117)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$TD._(Hamlet.java:843)
at 
org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumnLayout.java:54)
at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:80)
at org.apache.hadoop.yarn.webapp.Controller.render(Controller.java:210)
at 
org.apache.hadoop.yarn.server.nodemanager.webapp.NMController.container(NMController.java:62)
... 30 more
{code}


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hadoop-Mapreduce-trunk-Commit - Build # 884 - Still Failing

2011-09-12 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/884/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9960 lines...]
 [exec] depbase=`echo impl/sort.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`;\
 [exec] g++ -DHAVE_CONFIG_H -I. 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes
 -I./impl-Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -MT impl/sort.o -MD -MP -MF $depbase.Tpo -c -o impl/sort.o 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes/impl/sort.cc
 \
 [exec] mv -f $depbase.Tpo $depbase.Po
 [exec] /bin/bash ./libtool --tag=CXX   --mode=link g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2   -o pipes-sort impl/sort.o 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread 
 [exec] libtool: link: g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -o pipes-sort impl/sort.o  
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread
 [exec] make[1]: Entering directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'
 [exec] test -z 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 || /bin/mkdir -p 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 [exec]   /bin/bash ./libtool   --mode=install /usr/bin/install -c 
wordcount-simple wordcount-part wordcount-nopipe pipes-sort 
'/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin'
 [exec] libtool: install: /usr/bin/install -c wordcount-simple 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-simple
 [exec] libtool: install: /usr/bin/install -c wordcount-part 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-part
 [exec] libtool: install: /usr/bin/install -c wordcount-nopipe 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-nopipe
 [exec] libtool: install: /usr/bin/install -c pipes-sort 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/pipes-sort
 [exec] make[1]: Nothing to be done for `install-data-am'.
 [exec] make[1]: Leaving directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'

compile-c++-examples:

compile-examples:
[javac] Compiling 43 source files to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/examples
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

ivy-resolve-test:

ivy-retrieve-test:

compile-mapred-test:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/classes
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testjar
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testshell

500 error in review board

2011-09-12 Thread Robert Evans
Whenever I try to post a new patch to review board I get a 500 error.

Something broke! (Error 500)
 

 It appears something broke when you tried to go to here. This is either a
bug in Review Board or a server configuration error. Please report this to
your administrator.


Who should I talk to/report this to?

Thanks,

Bobby Evans



[jira] [Created] (MAPREDUCE-2985) findbugs error in ResourceLocalizationService.handle(LocalizationEvent)

2011-09-12 Thread Thomas Graves (JIRA)
findbugs error in ResourceLocalizationService.handle(LocalizationEvent)
---

 Key: MAPREDUCE-2985
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2985
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.24.0
Reporter: Thomas Graves
 Fix For: 0.24.0


hudson mapreduce is reporting a findbugs error:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/707//artifact/trunk/hadoop-mapreduce-project/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html

WMI Method 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.handle(LocalizationEvent)
 makes inefficient use of keySet iterator instead of entrySet iterator


Bug type WMI_WRONG_MAP_ITERATOR (click for details)
In class 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
In method 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.handle(LocalizationEvent)
At ResourceLocalizationService.java:[line 295]
Another occurrence at ResourceLocalizationService.java:[line 318]



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Re: 500 error in review board

2011-09-12 Thread Todd Lipcon
You can file a JIRA in the INFRA project.

-Todd

On Mon, Sep 12, 2011 at 11:18 AM, Robert Evans ev...@yahoo-inc.com wrote:
 Whenever I try to post a new patch to review board I get a 500 error.

 Something broke! (Error 500)


  It appears something broke when you tried to go to here. This is either a
 bug in Review Board or a server configuration error. Please report this to
 your administrator.


 Who should I talk to/report this to?

 Thanks,

 Bobby Evans





-- 
Todd Lipcon
Software Engineer, Cloudera


[jira] [Created] (MAPREDUCE-2986) Multiple node managers support for the MiniYARNCluster

2011-09-12 Thread Anupam Seth (JIRA)
Multiple node managers support for the MiniYARNCluster
--

 Key: MAPREDUCE-2986
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2986
 Project: Hadoop Map/Reduce
  Issue Type: Task
Reporter: Anupam Seth
Assignee: Anupam Seth
Priority: Minor


The current MiniYARNCluster can only support 1 node manager, which is not 
enough for the full test purposes.

Would like to have a simulator that can support multiple node managers as the 
real scenario. This might be beneficial for hadoop users, testers and 
developers.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hadoop-Mapreduce-trunk-Commit - Build # 885 - Still Failing

2011-09-12 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/885/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9964 lines...]
 [exec] depbase=`echo impl/sort.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`;\
 [exec] g++ -DHAVE_CONFIG_H -I. 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes
 -I./impl-Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -MT impl/sort.o -MD -MP -MF $depbase.Tpo -c -o impl/sort.o 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes/impl/sort.cc
 \
 [exec] mv -f $depbase.Tpo $depbase.Po
 [exec] /bin/bash ./libtool --tag=CXX   --mode=link g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2   -o pipes-sort impl/sort.o 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread 
 [exec] libtool: link: g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -o pipes-sort impl/sort.o  
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread
 [exec] make[1]: Entering directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'
 [exec] test -z 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 || /bin/mkdir -p 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 [exec]   /bin/bash ./libtool   --mode=install /usr/bin/install -c 
wordcount-simple wordcount-part wordcount-nopipe pipes-sort 
'/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin'
 [exec] libtool: install: /usr/bin/install -c wordcount-simple 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-simple
 [exec] libtool: install: /usr/bin/install -c wordcount-part 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-part
 [exec] libtool: install: /usr/bin/install -c wordcount-nopipe 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-nopipe
 [exec] libtool: install: /usr/bin/install -c pipes-sort 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/pipes-sort
 [exec] make[1]: Nothing to be done for `install-data-am'.
 [exec] make[1]: Leaving directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'

compile-c++-examples:

compile-examples:
[javac] Compiling 46 source files to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/examples
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

ivy-resolve-test:

ivy-retrieve-test:

compile-mapred-test:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/classes
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testjar
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testshell

[jira] [Reopened] (MAPREDUCE-2936) Contrib Raid compilation broken after HDFS-1620

2011-09-12 Thread Robert Joseph Evans (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans reopened MAPREDUCE-2936:



It looks like HDFS-1620 was just merged to branch-0.23 and needs this fix in it 
now.

 Contrib Raid compilation broken after HDFS-1620
 ---

 Key: MAPREDUCE-2936
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2936
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Reporter: Vinod Kumar Vavilapalli
Assignee: Vinod Kumar Vavilapalli
 Fix For: 0.24.0

 Attachments: MAPREDUCE-2936-20110906.txt


 After working around MAPREDUCE-2935 by removing TestServiceLevelAuthorization 
 and runing the following:
 At the trunk level: mvn clean install package -Dtar -Pdist 
 -Dmaven.test.skip.exec=true
 In hadoop-mapreduce-project: ant compile-contrib -Dresolvers=internal
 yields 14 errors.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Resolved] (MAPREDUCE-2936) Contrib Raid compilation broken after HDFS-1620

2011-09-12 Thread Todd Lipcon (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Todd Lipcon resolved MAPREDUCE-2936.


   Resolution: Fixed
Fix Version/s: 0.23.0

 Contrib Raid compilation broken after HDFS-1620
 ---

 Key: MAPREDUCE-2936
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2936
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Reporter: Vinod Kumar Vavilapalli
Assignee: Vinod Kumar Vavilapalli
 Fix For: 0.23.0, 0.24.0

 Attachments: MAPREDUCE-2936-20110906.txt


 After working around MAPREDUCE-2935 by removing TestServiceLevelAuthorization 
 and runing the following:
 At the trunk level: mvn clean install package -Dtar -Pdist 
 -Dmaven.test.skip.exec=true
 In hadoop-mapreduce-project: ant compile-contrib -Dresolvers=internal
 yields 14 errors.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Resolved] (MAPREDUCE-1734) Un-deprecate the old MapReduce API in the 0.20 branch

2011-09-12 Thread Arun C Murthy (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arun C Murthy resolved MAPREDUCE-1734.
--

Resolution: Fixed

Thanks Harsh  Matt. I've committed this to 0.20.205.

 Un-deprecate the old MapReduce API in the 0.20 branch
 -

 Key: MAPREDUCE-1734
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1734
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
  Components: documentation
Reporter: Tom White
Assignee: Todd Lipcon
Priority: Blocker
 Attachments: mapreduce-1734.txt


 This issue is to un-deprecate the old MapReduce API (in o.a.h.mapred) in 
 the next 0.20 release, as discussed at 
 http://www.mail-archive.com/mapreduce-dev@hadoop.apache.org/msg01833.html

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hadoop-Mapreduce-trunk-Commit - Build # 887 - Still Failing

2011-09-12 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/887/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9964 lines...]
 [exec] depbase=`echo impl/sort.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`;\
 [exec] g++ -DHAVE_CONFIG_H -I. 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes
 -I./impl-Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -MT impl/sort.o -MD -MP -MF $depbase.Tpo -c -o impl/sort.o 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes/impl/sort.cc
 \
 [exec] mv -f $depbase.Tpo $depbase.Po
 [exec] /bin/bash ./libtool --tag=CXX   --mode=link g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2   -o pipes-sort impl/sort.o 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread 
 [exec] libtool: link: g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -o pipes-sort impl/sort.o  
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread
 [exec] make[1]: Entering directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'
 [exec] test -z 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 || /bin/mkdir -p 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 [exec]   /bin/bash ./libtool   --mode=install /usr/bin/install -c 
wordcount-simple wordcount-part wordcount-nopipe pipes-sort 
'/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin'
 [exec] libtool: install: /usr/bin/install -c wordcount-simple 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-simple
 [exec] libtool: install: /usr/bin/install -c wordcount-part 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-part
 [exec] libtool: install: /usr/bin/install -c wordcount-nopipe 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-nopipe
 [exec] libtool: install: /usr/bin/install -c pipes-sort 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/pipes-sort
 [exec] make[1]: Nothing to be done for `install-data-am'.
 [exec] make[1]: Leaving directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'

compile-c++-examples:

compile-examples:
[javac] Compiling 46 source files to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/examples
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

ivy-resolve-test:

ivy-retrieve-test:

compile-mapred-test:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/classes
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testjar
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testshell

[jira] [Created] (MAPREDUCE-2990) Health Report on Resource Manager UI is null if the NM's are all healthy.

2011-09-12 Thread Mahadev konar (JIRA)
Health Report on Resource Manager UI is null if the NM's are all healthy.
-

 Key: MAPREDUCE-2990
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2990
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Mahadev konar


The web UI on the RM for the link Nodes shows that Health-report as null when 
the NM is healthy. 

This is a simple fix where in we can check for null in NodesPage.java and put 
something meaningful instead of null.
NodesPage.java:
{code}

render(..)

th(health.getHealthReport()?REPORT HEALTHY: health.getHealthReport);

{code}
Or something like that.

 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hadoop-Mapreduce-trunk-Commit - Build # 889 - Still Failing

2011-09-12 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/889/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 9964 lines...]
 [exec] depbase=`echo impl/sort.o | sed 's|[^/]*$|.deps/|;s|\.o$||'`;\
 [exec] g++ -DHAVE_CONFIG_H -I. 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes
 -I./impl-Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -MT impl/sort.o -MD -MP -MF $depbase.Tpo -c -o impl/sort.o 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/examples/pipes/impl/sort.cc
 \
 [exec] mv -f $depbase.Tpo $depbase.Po
 [exec] /bin/bash ./libtool --tag=CXX   --mode=link g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2   -o pipes-sort impl/sort.o 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread 
 [exec] libtool: link: g++ -Wall 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 
-I/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/include
 -g -O2 -o pipes-sort impl/sort.o  
-L/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++/Linux-i386-32/lib
 -lhadooppipes -lhadooputils -lnsl -lcrypto -lpthread
 [exec] make[1]: Entering directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'
 [exec] test -z 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 || /bin/mkdir -p 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin
 [exec]   /bin/bash ./libtool   --mode=install /usr/bin/install -c 
wordcount-simple wordcount-part wordcount-nopipe pipes-sort 
'/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin'
 [exec] libtool: install: /usr/bin/install -c wordcount-simple 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-simple
 [exec] libtool: install: /usr/bin/install -c wordcount-part 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-part
 [exec] libtool: install: /usr/bin/install -c wordcount-nopipe 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/wordcount-nopipe
 [exec] libtool: install: /usr/bin/install -c pipes-sort 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-examples/Linux-i386-32/bin/pipes-sort
 [exec] make[1]: Nothing to be done for `install-data-am'.
 [exec] make[1]: Leaving directory 
`/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/c++-build/Linux-i386-32/examples/pipes'

compile-c++-examples:

compile-examples:
[javac] Compiling 46 source files to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/examples
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

ivy-resolve-test:

ivy-retrieve-test:

compile-mapred-test:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/classes
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testjar
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/testshell

[jira] [Created] (MAPREDUCE-2992) TestLinuxTaskController is broken

2011-09-12 Thread Ahmed Radwan (JIRA)
TestLinuxTaskController is broken
-

 Key: MAPREDUCE-2992
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2992
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: task-controller, test
Reporter: Ahmed Radwan
Priority: Minor


The TestLinuxTaskController is broken in branch-0.20-security:

Exception message does not contain exit code22
junit.framework.AssertionFailedError: Exception message does not contain exit 
code22
  at 
org.apache.hadoop.mapred.TestLinuxTaskController.validateTaskControllerSetup(TestLinuxTaskController.java:63)
  at 
org.apache.hadoop.mapred.TestLinuxTaskController.testTaskControllerGroup(TestLinuxTaskController.java:90)

The test is not correctly picking the location of the task-cotroller 
executable. Also other changes are required (example: Check argc should be 
after checks for perms in task-controller/impl/main.ca, etc).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Resolved] (MAPREDUCE-2964) mapreduce trunk build fails with compile-mapred-test ant target

2011-09-12 Thread Mahadev konar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mahadev konar resolved MAPREDUCE-2964.
--

Resolution: Fixed

Just fixed this. No longer an issue on trunk builds.

 mapreduce trunk build fails with compile-mapred-test ant target
 ---

 Key: MAPREDUCE-2964
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2964
 Project: Hadoop Map/Reduce
  Issue Type: Bug
 Environment: apache jenkins build env:
 https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/869/console
Reporter: Giridharan Kesavan

 {noformat}
 compile-mapred-test:
 [mkdir] Created dir: 
 /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/classes
 
   [javac] found   : org.apache.hadoop.mapred.IFile.Writer
 [javac] required: 
 org.apache.hadoop.mapred.IFile.Writerjava.lang.String,java.lang.Integer
 [javac] WriterString, Integer mockWriter = mock(Writer.class);
 [javac]  ^
 [javac] 
 /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestCombineOutputCollector.java:128:
  warning: [unchecked] unchecked conversion
 [javac] found   : org.apache.hadoop.mapred.IFile.Writer
 [javac] required: 
 org.apache.hadoop.mapred.IFile.Writerjava.lang.String,java.lang.Integer
 [javac] WriterString, Integer mockWriter = mock(Writer.class);
 [javac]  ^
 [javac] 
 /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJvmManager.java:63:
  unreported exception java.io.IOException; must be caught or declared to be 
 thrown
 [javac] FileUtil.fullyDelete(TEST_DIR);
 [javac] ^
 [javac] Note: Some input files use or override a deprecated API.
 [javac] Note: Recompile with -Xlint:deprecation for details.
 [javac] 1 error
 [javac] 2 warnings
 BUILD FAILED
 /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:538:
  The following error occurred while executing this line:
 /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:615:
  Compile failed; see the compiler error output for details.
 {noformat}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira