[jira] [Resolved] (MAPREDUCE-3168) [Gridmix] TestCompressionEmulationUtils fails after MR-3158
[ https://issues.apache.org/jira/browse/MAPREDUCE-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat resolved MAPREDUCE-3168. --- Resolution: Fixed Resolved as part of MAPREDUCE-3462. > [Gridmix] TestCompressionEmulationUtils fails after MR-3158 > --- > > Key: MAPREDUCE-3168 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3168 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/gridmix >Affects Versions: 0.24.0 >Reporter: Amar Kamat >Assignee: Amar Kamat > Labels: compression-emulation, gridmix, local-job-runner > Fix For: 0.24.0 > > > TestCompressionEmulationUtils fails after MAPREDUCE-3158 as it uses local > job-runner to run jobs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3842) Add a toggle button to all web pages to stop automatic refreshs
Add a toggle button to all web pages to stop automatic refreshs --- Key: MAPREDUCE-3842 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3842 Project: Hadoop Map/Reduce Issue Type: Improvement Components: webapps Affects Versions: 0.23.1 Reporter: Alejandro Abdelnur Priority: Critical The automatic refresh makes quiet hard to look at something specific as it makes the page jump and sometime resets its position. This is specially painful when looking at jobs with large number of tasks. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Mapreduce-trunk-Commit - Build # 1710 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1710/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14953 lines...] [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat run-commit-test: [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/data [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/logs [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [junit] Running org.apache.hadoop.mapred.TestJobHistoryParsing [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.769 sec [junit] Running org.apache.hadoop.mapred.TestJobInProgress [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.26 sec [junit] Running org.apache.hadoop.mapred.TestJobQueueTaskScheduler [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.273 sec [junit] Running org.apache.hadoop.mapred.TestKillCompletedJob [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.493 sec [junit] Running org.apache.hadoop.mapred.TestLostTracker [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.263 sec [junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.663 sec [junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.938 sec [junit] Running org.apache.hadoop.mapred.TestSeveral [junit] Tests run: 0, Failures: 0, Errors: 0, Time elapsed: 0.036 sec [junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.292 sec [junit] Running org.apache.hadoop.mapred.TestTaskLimits [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.976 sec [junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.946 sec [junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 117.318 sec [junit] Test org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs FAILED [junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 102.515 sec [junit] Test org.apache.hadoop.mapreduce.TestMapReduceLocal FAILED checkfailure: [touch] Creating /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed BUILD FAILED /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:744: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:707: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:768: Tests failed! Total time: 5
Hadoop-Mapreduce-trunk-Commit - Build # 1709 - Failure
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1709/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14416 lines...] [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat run-commit-test: [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/data [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/logs [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [junit] Running org.apache.hadoop.mapred.TestJobHistoryParsing [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.702 sec [junit] Running org.apache.hadoop.mapred.TestJobInProgress [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.247 sec [junit] Running org.apache.hadoop.mapred.TestJobQueueTaskScheduler [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.204 sec [junit] Running org.apache.hadoop.mapred.TestKillCompletedJob [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.453 sec [junit] Running org.apache.hadoop.mapred.TestLostTracker [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.395 sec [junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.655 sec [junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.886 sec [junit] Running org.apache.hadoop.mapred.TestSeveral [junit] Tests run: 0, Failures: 0, Errors: 0, Time elapsed: 0.034 sec [junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.442 sec [junit] Running org.apache.hadoop.mapred.TestTaskLimits [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.972 sec [junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.951 sec [junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 117.372 sec [junit] Test org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs FAILED [junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 98.237 sec [junit] Test org.apache.hadoop.mapreduce.TestMapReduceLocal FAILED checkfailure: [touch] Creating /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed BUILD FAILED /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:744: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:707: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:768: Tests failed! Total time: 5
[jira] [Created] (MAPREDUCE-3841) Broken Server metrics and Local logs link under the tools menu
Broken Server metrics and Local logs link under the tools menu -- Key: MAPREDUCE-3841 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3841 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.1 Reporter: Ramya Sunil Local logs link redirects to the cluster page and Server metrics opens an empty page on the RM/JHS homepage. So does the links from nodemanager UI. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: some weird problem with hadoop, "Task process exit with nonzero status of 134"
Hi James, It means that the jvm's crashed. 134-128=6, which is SIGABRT. This is not the cause, but what the jvm is sending to itself to exit after handling the crash condition (e.g. seg fault). To find the real cause, you need to examine the crash dump. You can specify the dump location with "-XX:ErrorFile=". Kihwal On 2/8/12 3:07 AM, "James" wrote: Hello everybody, I've met a weird problem when running a hadoop job, the error msg is as follows: 发 送 2012-02-08 16:55:20,686 WARN org.apache.hadoop.mapred.TaskRunner: attempt_201202081654_0001_m_03_0 : Child Error java.io.IOException: Task process exit with nonzero status of 134. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) I've been troubled by this for quite a long time, wish someone can help me, thanks! Best Regards, James
[jira] [Created] (MAPREDUCE-3840) JobEndNotifier doesn't use the proxyToUse during connecting
JobEndNotifier doesn't use the proxyToUse during connecting --- Key: MAPREDUCE-3840 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3840 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.23.0, 0.24.0 Reporter: Ravi Prakash Assignee: Ravi Prakash Priority: Blocker I stupidly removed the proxyToUse from openConnection() in MAPREDUCE-3649. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[PROPOSAL] Hadoop OSGi compliant and Apache Karaf features
Hi folks, I'm working right now to turn Hadoop as an OSGi compliant set of modules. I've more or less achieved the first step: - turn all Hadoop modules (common, annotations, hdfs, mapreduce, etc) as OSGi bundle - provide a Karaf features descriptor to easily deploy it into Apache Karaf OSGi container I will upload the patches on the different Jira related to that. The second step that I propose is to introduce blueprint descriptor in order to expose some Hadoop features as OSGi services. It won't affect the "non-OSGi" users but give lot of fun and interest for OSGi users ;) WDYT ? Regards JB PS: the Jira issues are HADOOP-6484, HADOOP-7977, MAPREDUCE-243. It would be great if someone can assign it to me (easier to track it). -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
[jira] [Created] (MAPREDUCE-3839) Improve the single node setup docs for MR
Improve the single node setup docs for MR - Key: MAPREDUCE-3839 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3839 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 0.23.1 Reporter: Harsh J Priority: Trivial I'm gonna be recording all nits I can about the page at http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/SingleCluster.html here: * The section at http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/SingleCluster.html#Mapreduce_Tarball is suitable to developers, not users. We should instead just point to releases page for tarball. * On http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/SingleCluster.html#Setting_up_the_environment since the tarball structure is definite, we could do better to either point to a link to configure HDFS and Common or provide instructions ourselves. Same applies to path the MR envs ought to be set to -- none of these are mentioned. * Under http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/SingleCluster.html#Setting_up_Configuration. one of the "Add the following configs" text is defined as a heading, while other isn't. * The "Create Symlinks" and "Running daemons" sections do not appear in the index on top. * Remove the "Good luck." at the end -- Users shouldn't need luck to setup good stuff :) OT comment: The "Create Symlinks" part is curious. That we need symlinks to run MR looks very wrong to me. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Mapreduce-0.23-Build - Build # 185 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/185/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 26086 lines...] [ivy:resolve] com.thoughtworks.paranamer#paranamer;2.2 by [com.thoughtworks.paranamer#paranamer;2.3] in [common] - | |modules|| artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| - | common | 85 | 4 | 4 | 8 || 77 | 4 | - ivy-retrieve-common: [ivy:retrieve] :: retrieving :: org.apache.hadoop#gridmix [sync] [ivy:retrieve] confs: [common] [ivy:retrieve] 77 artifacts copied, 0 already retrieved (38798kB/134ms) [ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead [ivy:cachepath] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/ivy/ivysettings.xml compile: [echo] contrib: gridmix [javac] Compiling 44 source files to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/build/contrib/gridmix/classes [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. jar: [echo] contrib: gridmix [jar] Building jar: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/build/contrib/gridmix/hadoop-0.23.2-SNAPSHOT-gridmix.jar BUILD SUCCESSFUL Total time: 30 seconds + RESULT=0 + [[ 0 -ne 0 ]] + gunzip /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/target/hadoop-mapreduce-0.23.1-SNAPSHOT.tar.gz gzip: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/target/hadoop-mapreduce-0.23.1-SNAPSHOT.tar.gz: No such file or directory + RESULT=1 + [[ 1 -ne 0 ]] + echo 'gunzip failed' gunzip failed + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Updating MAPREDUCE-3415 Updating MAPREDUCE-3770 Updating HDFS-2572 Updating MAPREDUCE-3823 Updating MAPREDUCE-3822 Updating MAPREDUCE-3834 Updating MAPREDUCE-3815 Updating MAPREDUCE-3833 Updating MAPREDUCE-3828 Updating MAPREDUCE-3827 Updating MAPREDUCE-3826 Updating HDFS-2786 Updating HADOOP-8013 Updating MAPREDUCE-3436 Updating HADOOP-7813 Updating HADOOP-7841 Updating HADOOP-7851 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Resolved] (MAPREDUCE-3770) [Rumen] Zombie.getJobConf() results into NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amar Kamat resolved MAPREDUCE-3770.
---
Resolution: Fixed
Hadoop Flags: Reviewed
I just committed this to trunk and branch-0.23.
> [Rumen] Zombie.getJobConf() results into NPE
>
>
> Key: MAPREDUCE-3770
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3770
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tools/rumen
>Affects Versions: 0.23.0, 0.24.0
>Reporter: Amar Kamat
>Assignee: Amar Kamat
>Priority: Critical
> Labels: job-name, rumen
> Fix For: 0.23.1
>
> Attachments: GridmixJobNameBug-v1.0.patch
>
>
> The error trace is as follows
> {code}
> java.lang.NullPointerException
> at java.util.Hashtable.put(Hashtable.java:394)
> at java.util.Properties.setProperty(Properties.java:143)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:623)
> at org.apache.hadoop.mapred.JobConf.setJobName(JobConf.java:1322)
> at
> org.apache.hadoop.tools.rumen.ZombieJob.getJobConf(ZombieJob.java:139)
> at
> org.apache.hadoop.mapred.gridmix.DistributedCacheEmulator.updateHDFSDistCacheFilesList(DistributedCacheEmulator.java:315)
> at
> org.apache.hadoop.mapred.gridmix.DistributedCacheEmulator.buildDistCacheFilesList(DistributedCacheEmulator.java:280)
> at
> org.apache.hadoop.mapred.gridmix.DistributedCacheEmulator.setupGenerateDistCacheData(DistributedCacheEmulator.java:253)
> at
> org.apache.hadoop.mapred.gridmix.Gridmix.setupDistCacheEmulation(Gridmix.java:528)
> at
> org.apache.hadoop.mapred.gridmix.Gridmix.setupEmulation(Gridmix.java:501)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:433)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at
> org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.mapred.gridmix.Gridmix.main(Gridmix.java:606)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:200)
> {code}
> The bug seems to be in {{ZombieJob#getName()}} where a not-null check for
> jobName.getValue() is missing.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
some weird problem with hadoop, "Task process exit with nonzero status of 134"
Hello everybody, I've met a weird problem when running a hadoop job, the error msg is as follows: 发 送 2012-02-08 16:55:20,686 WARN org.apache.hadoop.mapred.TaskRunner: attempt_201202081654_0001_m_03_0 : Child Error java.io.IOException: Task process exit with nonzero status of 134. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) I've been troubled by this for quite a long time, wish someone can help me, thanks! Best Regards, James
Hadoop-Mapreduce-trunk-Commit - Build # 1706 - Failure
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1706/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14416 lines...] [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat run-commit-test: [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/data [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/logs [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [junit] Running org.apache.hadoop.mapred.TestJobHistoryParsing [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.714 sec [junit] Running org.apache.hadoop.mapred.TestJobInProgress [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.36 sec [junit] Running org.apache.hadoop.mapred.TestJobQueueTaskScheduler [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.295 sec [junit] Running org.apache.hadoop.mapred.TestKillCompletedJob [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.596 sec [junit] Running org.apache.hadoop.mapred.TestLostTracker [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.318 sec [junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.664 sec [junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.794 sec [junit] Running org.apache.hadoop.mapred.TestSeveral [junit] Tests run: 0, Failures: 0, Errors: 0, Time elapsed: 0.034 sec [junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.542 sec [junit] Running org.apache.hadoop.mapred.TestTaskLimits [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.951 sec [junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 2.029 sec [junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 117.349 sec [junit] Test org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs FAILED [junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 97.21 sec [junit] Test org.apache.hadoop.mapreduce.TestMapReduceLocal FAILED checkfailure: [touch] Creating /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed BUILD FAILED /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:744: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:707: The following error occurred while executing this line:
