[jira] [Created] (MAPREDUCE-3964) ResourceManager does not have JVM metrics
ResourceManager does not have JVM metrics - Key: MAPREDUCE-3964 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3964 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2, resourcemanager Affects Versions: 0.24.0, 0.23.2 Reporter: Jason Lowe Priority: Critical ResourceManager is not creating a JvmMetrics instance on startup. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3963) NodeManagers die on startup if they can't connect to the RM
NodeManagers die on startup if they can't connect to the RM --- Key: MAPREDUCE-3963 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3963 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2, nodemanager Affects Versions: 0.23.1 Reporter: Ravi Prakash Priority: Critical Steps to reproduce. Start the NM when the RM is down. The NM tries 10 times, then exits. It should keep trying forever. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3962) InverseMapper causes IntWritable type to collected as Text
InverseMapper causes IntWritable type to collected as Text
--
Key: MAPREDUCE-3962
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3962
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 1.0.0
Reporter: Saad Patel
When using the org.apache.hadoop.mapred.lib.InverseMapper, key,values are
inversed as expected. For example (Text,IntWritable) will get inversed.
However, output key,value only works if you use (Text, Text). Below is an
example, where I was chaining 2 jobs:
Job 1:
public static class Reduce extends MapReduceBase implements Reducer{...}
Job 2:
conf.setMapperClass(InverseMapper.class);
public static class Reduce extends MapReduceBase implements
Reducer {...} //I would expect this to
work. When I do this, I get
java.lang.ClassCastException: org.apache.hadoop.io.Text cannot be cast to
org.apache.hadoop.io.IntWritable
To re-inverse my key,values, I had to do this:
public static class Reduce extends MapReduceBase implements Reducer
Notice that in order for the reducer to properly accept key,values, I had to
indicate the key as Text.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3961) Map/ReduceSlotMillis computation incorrect
Map/ReduceSlotMillis computation incorrect -- Key: MAPREDUCE-3961 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3961 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Reporter: Siddharth Seth Assignee: Siddharth Seth Map/ReduceSlot millis are currently computed based on a fixed container size. They should instead be based on the minimum container size offered by the cluster. There's another jira to rename these Counters - based on the resource type. This jira isn't to do that - just to fix the values. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3960) web proxy doesn't forward request to AM with configured hostname/IP
web proxy doesn't forward request to AM with configured hostname/IP --- Key: MAPREDUCE-3960 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3960 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical If the host the web proxy is running on has an ip alias or similar and the config file is pointing to the hostname that is the aliased ip of the box, the web proxy will send the request from the base ip rather then the aliased ip and the AM will redirect that request to the proxy again instead of accepting it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Mapreduce-0.23-Build - Build # 213 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/213/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 26231 lines...]
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ]
org.mortbay.jetty#servlet-api-2.5;6.1.14!servlet-api-2.5.jar (18ms)
[ivy:resolve] downloading
/home/jenkins/.m2/repository/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.jar
...
[ivy:resolve] (130kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ]
org.mortbay.jetty#servlet-api;2.5-20081211!servlet-api.jar (338ms)
[ivy:resolve] :: resolution report :: resolve 3820ms :: artifacts dl 515ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] org.codehaus.jackson#jackson-core-asl;1.7.1 by
[org.codehaus.jackson#jackson-core-asl;1.8.8] in [common]
[ivy:resolve] log4j#log4j;1.2.15 by [log4j#log4j;1.2.16] in [common]
[ivy:resolve] junit#junit;4.8.1 by [junit#junit;4.8.2] in [common]
[ivy:resolve] commons-codec#commons-codec;${commons-codec.version} by
[commons-codec#commons-codec;1.4] in [common]
[ivy:resolve] org.mortbay.jetty#jetty;6.1.14 by
[org.mortbay.jetty#jetty;6.1.26] in [common]
[ivy:resolve] org.mortbay.jetty#jetty-util;6.1.14 by
[org.mortbay.jetty#jetty-util;6.1.26] in [common]
[ivy:resolve] org.apache.avro#avro;1.5.2 by [org.apache.avro#avro;1.5.3] in
[common]
[ivy:resolve] com.thoughtworks.paranamer#paranamer;2.2 by
[com.thoughtworks.paranamer#paranamer;2.3] in [common]
-
| |modules|| artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
-
| common | 83 | 4 | 4 | 8 || 75 | 4 |
-
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#gridmix [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 75 artifacts copied, 0 already retrieved (40223kB/145ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use
'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file =
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/ivy/ivysettings.xml
compile:
[echo] contrib: gridmix
[javac] Compiling 44 source files to
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/build/contrib/gridmix/classes
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
jar:
[echo] contrib: gridmix
[jar] Building jar:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/build/contrib/gridmix/hadoop-0.23.2-SNAPSHOT-gridmix.jar
BUILD SUCCESSFUL
Total time: 35 seconds
+ RESULT=0
+ [[ 0 -ne 0 ]]
+ gunzip
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/target/hadoop-mapreduce-0.23.2-SNAPSHOT.tar.gz
gzip:
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/target/hadoop-mapreduce-0.23.2-SNAPSHOT.tar.gz:
No such file or directory
+ RESULT=1
+ [[ 1 -ne 0 ]]
+ echo 'gunzip failed'
gunzip failed
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Updating HDFS-3021
Updating HDFS-3038
Email was triggered for: Failure
Sending email for trigger: Failure
###
## FAILED TESTS (if any)
##
No tests ran.
Hadoop-Mapreduce-0.23-PB-Build - Build # 9 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-PB-Build/9/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9721 lines...] [INFO] Apache Hadoop HttpFS .. FAILURE [7.185s] [INFO] Apache Hadoop HDFS Project SKIPPED [INFO] hadoop-yarn ... SKIPPED [INFO] hadoop-yarn-api ... SKIPPED [INFO] hadoop-yarn-common SKIPPED [INFO] hadoop-yarn-server SKIPPED [INFO] hadoop-yarn-server-common . SKIPPED [INFO] hadoop-yarn-server-nodemanager SKIPPED [INFO] hadoop-yarn-server-web-proxy .. SKIPPED [INFO] hadoop-yarn-server-resourcemanager SKIPPED [INFO] hadoop-yarn-server-tests .. SKIPPED [INFO] hadoop-mapreduce-client ... SKIPPED [INFO] hadoop-mapreduce-client-core .. SKIPPED [INFO] hadoop-yarn-applications .. SKIPPED [INFO] hadoop-yarn-applications-distributedshell . SKIPPED [INFO] hadoop-yarn-site .. SKIPPED [INFO] hadoop-mapreduce-client-common SKIPPED [INFO] hadoop-mapreduce-client-shuffle ... SKIPPED [INFO] hadoop-mapreduce-client-app ... SKIPPED [INFO] hadoop-mapreduce-client-hs SKIPPED [INFO] hadoop-mapreduce-client-jobclient . SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] hadoop-mapreduce .. SKIPPED [INFO] Apache Hadoop MapReduce Streaming . SKIPPED [INFO] Apache Hadoop Distributed Copy SKIPPED [INFO] Apache Hadoop Archives SKIPPED [INFO] Apache Hadoop Rumen ... SKIPPED [INFO] Apache Hadoop Extras .. SKIPPED [INFO] Apache Hadoop Tools Dist .. SKIPPED [INFO] Apache Hadoop Tools ... SKIPPED [INFO] Apache Hadoop Distribution SKIPPED [INFO] Apache Hadoop Client .. SKIPPED [INFO] Apache Hadoop Mini-Cluster SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 4:30.706s [INFO] Finished at: Fri Mar 02 13:29:03 UTC 2012 [INFO] Final Memory: 105M/789M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (dist) on project hadoop-hdfs-httpfs: An Ant BuildException has occured: exec returned: 2 -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-hdfs-httpfs + RESULT=1 + [[ 1 -ne 0 ]] + echo 'mvn clean install package -Pdist,native -Dtar failed' mvn clean install package -Pdist,native -Dtar failed + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
