Hadoop-Mapreduce-trunk - Build # 1309 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1309/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 28664 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.9 sec Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.103 sec Results : Failed tests: testUberDecision(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Tests run: 204, Failures: 1, Errors: 0, Skipped: 0 [INFO] [INFO] Reactor Summary: [INFO] [INFO] hadoop-mapreduce-client ... SUCCESS [1.662s] [INFO] hadoop-mapreduce-client-core .. SUCCESS [20.311s] [INFO] hadoop-mapreduce-client-common SUCCESS [23.996s] [INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [1.631s] [INFO] hadoop-mapreduce-client-app ... FAILURE [4:51.456s] [INFO] hadoop-mapreduce-client-hs SKIPPED [INFO] hadoop-mapreduce-client-jobclient . SKIPPED [INFO] hadoop-mapreduce-client-hs-plugins SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] hadoop-mapreduce .. SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 5:39.634s [INFO] Finished at: Thu Jan 10 13:20:53 UTC 2013 [INFO] Final Memory: 21M/211M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.3:test (default-test) on project hadoop-mapreduce-client-app: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports for the individual test results. [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :hadoop-mapreduce-client-app Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Updating HADOOP-9183 Updating MAPREDUCE-1700 Updating HDFS-4306 Updating YARN-325 Updating YARN-320 Updating HADOOP-9155 Updating HDFS-4363 Updating HDFS-4032 Updating MAPREDUCE-4848 Updating MAPREDUCE-4907 Updating HDFS-4261 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Created] (MAPREDUCE-4930) Backport MAPREDUCE-4678 to branch-2, branch-0.23 and branch-1
Karthik Kambatla created MAPREDUCE-4930: --- Summary: Backport MAPREDUCE-4678 to branch-2, branch-0.23 and branch-1 Key: MAPREDUCE-4930 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4930 Project: Hadoop Map/Reduce Issue Type: Bug Components: examples Affects Versions: 0.23.5, 2.0.2-alpha, 1.1.1 Reporter: Karthik Kambatla Assignee: Karthik Kambatla MAPREDUCE-4678 adds convenient arguments to Pentomino, which would be nice to have in other branches as well. However, MR-4678 introduces a bug - MR-4925 addresses this bug for all branches. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-4931) Add user-APIs for classpath precedence control
Harsh J created MAPREDUCE-4931:
--
Summary: Add user-APIs for classpath precedence control
Key: MAPREDUCE-4931
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4931
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: client
Affects Versions: 1.0.0
Reporter: Harsh J
Priority: Minor
The feature config from MAPREDUCE-1938 of allowing tasks to start with
user-classes-first is fairly popular and can use its own API hooks in
Job/JobConf classes, making it easier to discover and use it rather than
continuing to keep it as an advanced param.
I propose to add two APIs to Job/JobConf:
{code}
void setUserClassesTakesPrecedence(boolean)
boolean userClassesTakesPrecedence()
{code}
Both of which, depending on their branch of commit, set the property
{{mapreduce.user.classpath.first}} (1.x) or
{{mapreduce.job.user.classpath.first}} (trunk, 2.x and if needed, in 0.23.x).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-4932) mapreduce.job#getTaskCompletionEvents incompatible with MR1
Robert Kanter created MAPREDUCE-4932:
Summary: mapreduce.job#getTaskCompletionEvents incompatible with
MR1
Key: MAPREDUCE-4932
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4932
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 2.0.2-alpha
Reporter: Robert Kanter
Assignee: Robert Kanter
In MR1, {{org.apache.hadoop.mapreduce.Job#getTaskCompletionEvents}} takes one
argument: {{int startFrom}}. In MR2, it now takes an additional argument: {{
int numEvents}} (which is the max number of events to get). This makes them
incompatible.
I propose we add a second {{getTaskCompletionEvents}} method that simply calls
the other one with {{numEvents}} set to {{Integer.MAX_VALUE}} to replicate the
behavior of the MR1 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (MAPREDUCE-4678) Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException
[
https://issues.apache.org/jira/browse/MAPREDUCE-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla reopened MAPREDUCE-4678:
-
Reopening the patch for it to be committed to branch-2 and branch-0.23.
Running the Pentomino example with defaults throws
java.lang.NegativeArraySizeException
---
Key: MAPREDUCE-4678
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4678
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 2.0.0-alpha
Reporter: Chris McConnell
Assignee: Chris McConnell
Priority: Minor
Fix For: 3.0.0
Attachments: MAPREDUCE-4678.patch, MAPREDUCE-4678.patch.txt
HADOOP_HOME/hadoop-examples.jar pentomino output_dir will fail with the
following error message:
{code}
INFO util.NativeCodeLoader: Loaded the native-hadoop library
INFO mapred.FileInputFormat: Total input paths to process : 1
INFO mapred.JobClient: Running job: job_x
INFO mapred.JobClient: map 0% reduce 0%
INFO mapred.JobClient: Task Id : attempt_, Status : FAILED
java.lang.NegativeArraySizeException
at org.apache.hadoop.examples.dancing.DistributedPentomino$PentMap.map(Di
stributedPentomino.java:95)
at org.apache.hadoop.examples.dancing.DistributedPentomino$PentMap.map(Di
stributedPentomino.java:51)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformat
ion.java:1177)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-4933) MR1 merger asks for length of file it just wrote before flushing it
Sandy Ryza created MAPREDUCE-4933:
-
Summary: MR1 merger asks for length of file it just wrote before
flushing it
Key: MAPREDUCE-4933
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4933
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv1, task
Affects Versions: 1.1.1
Reporter: Sandy Ryza
Assignee: Sandy Ryza
createKVIterator in ReduceTask contains the following code:
{code}
try {
Merger.writeFile(rIter, writer, reporter, job);
addToMapOutputFilesOnDisk(fs.getFileStatus(outputPath));
} catch (Exception e) {
if (null != outputPath) {
fs.delete(outputPath, true);
}
throw new IOException(Final merge failed, e);
} finally {
if (null != writer) {
writer.close();
}
}
{code}
Merger#writeFile() does not close the file after writing it, so when
fs.getFileStatus() is called on it, it may not return the correct length. This
causes bad accounting further down the line, which can lead to map output data
being lost.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-4934) Maven RAT plugin is not checking all source files
Thomas Graves created MAPREDUCE-4934: Summary: Maven RAT plugin is not checking all source files Key: MAPREDUCE-4934 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4934 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.23.5, 2.0.2-alpha Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical mapreduce side of HADOOP-9097 Running 'mvn apache-rat:check' passes, but running RAT by hand (by downloading the JAR) produces some warnings for Java files, amongst others. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
