[jira] [Created] (YARN-3398) It would be good if usage command are in consistent
Brahma Reddy Battula created YARN-3398: -- Summary: It would be good if usage command are in consistent Key: YARN-3398 URL: https://issues.apache.org/jira/browse/YARN-3398 Project: Hadoop YARN Issue Type: Improvement Reporter: Brahma Reddy Battula Assignee: Brahma Reddy Battula As [~rohithsharma] raised point in MAPRED-6291 It would be good if usage command are in consistent like below. Usage: Yarn command sub-command args hdfs@host131:/hadoop/bin ./yarn logs Retrieve logs for completed YARN applications. *usage: yarn logs -applicationId application ID [OPTIONS]* general options are: -appOwner Application Owner AppOwner (assumed to be current user if not specified) -containerId Container ID ContainerId (must be specified if node address is specified) -nodeAddress Node Address NodeAddress in the format nodename:port (must be specified if container id is specified) *Here Different Format* hdfs@host131:/opt/hadoop/bin ./yarn queue 15/03/26 00:13:06 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Invalid Command Usage : *usage: queue* -help Displays help for all commands. -status Queue Name List queue information about given queue. Same for {{mapred}} alsoPlease correct me If I am wrong -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Success: YARN-3397 PreCommit Build #7100
Jira: https://issues.apache.org/jira/browse/YARN-3397 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7100/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3232 lines...] {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707195/YARN-3397.1.patch against trunk revision e556198. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7100//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7100//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. 024146ec6daccaf20f9053828ae0a9ca207258bb logged out == == Finished build. == == Archiving artifacts Sending artifact delta relative to PreCommit-YARN-Build #7097 Archived 15 artifacts Archive block size is 32768 Received 45 blocks and 7349806 bytes Compression is 16.7% Took 4 sec Description set: YARN-3397 Recording test results Email was triggered for: Success Sending email for trigger: Success ### ## FAILED TESTS (if any) ## All tests passed
Failed: YARN-2618 PreCommit Build #7101
Jira: https://issues.apache.org/jira/browse/YARN-2618 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7101/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 23 lines...] == == Testing patch for YARN-2618. == == HEAD is now at c906a1d YARN-3397. yarn rmadmin should skip -failover. (J.Andreina via kasha) Previous HEAD position was c906a1d... YARN-3397. yarn rmadmin should skip -failover. (J.Andreina via kasha) Switched to branch 'trunk' Your branch is behind 'origin/trunk' by 24 commits, and can be fast-forwarded. (use git pull to update your local branch) First, rewinding head to replay your work on top of it... Fast-forwarded trunk to c906a1de7280dabd9d9d8b6aeaa060898e6d17b6. YARN-2618 patch is being downloaded at Wed Mar 25 15:20:41 UTC 2015 from http://issues.apache.org/jira/secure/attachment/12686243/YARN-2618-5.patch cp: cannot stat ‘/home/jenkins/buildSupport/lib/*’: No such file or directory The patch does not appear to apply with p0 to p2 PATCH APPLICATION FAILED {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12686243/YARN-2618-5.patch against trunk revision c906a1d. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7101//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. 625dd2f93ad5275382c7a3d6948bc76b2636a9de logged out == == Finished build. == == Build step 'Execute shell' marked build as failure Archiving artifacts [description-setter] Could not determine description. Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
Success: YARN-3294 PreCommit Build #7102
Jira: https://issues.apache.org/jira/browse/YARN-3294 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7102/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3643 lines...] {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707223/apache-yarn-3294.4.patch against trunk revision c906a1d. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7102//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7102//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. 82d1b0f4873bb18b18098ae0dc4eecc261ced70f logged out == == Finished build. == == Archiving artifacts Sending artifact delta relative to PreCommit-YARN-Build #7100 Archived 20 artifacts Archive block size is 32768 Received 56 blocks and 7542408 bytes Compression is 19.6% Took 1.7 sec Description set: YARN-3294 Recording test results Email was triggered for: Success Sending email for trigger: Success ### ## FAILED TESTS (if any) ## All tests passed
Failed: YARN-3323 PreCommit Build #7106
Jira: https://issues.apache.org/jira/browse/YARN-3323 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7106/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 20 lines...] [PreCommit-YARN-Build] $ /bin/bash /tmp/hudson2921104677848028632.sh Running in Jenkins mode == == Testing patch for YARN-3323. == == HEAD is now at c906a1d YARN-3397. yarn rmadmin should skip -failover. (J.Andreina via kasha) Switched to branch 'trunk' Your branch is up-to-date with 'origin/trunk'. Current branch trunk is up to date. YARN-3323 patch is being downloaded at Wed Mar 25 16:30:53 UTC 2015 from http://issues.apache.org/jira/secure/attachment/12707235/YARN-3323-002.patch cp: cannot stat '/home/jenkins/buildSupport/lib/*': No such file or directory The patch does not appear to apply with p0 to p2 PATCH APPLICATION FAILED {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707235/YARN-3323-002.patch against trunk revision c906a1d. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7106//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. d854a189e66fca06443fe020b6592adfc1138dac logged out == == Finished build. == == Build step 'Execute shell' marked build as failure Archiving artifacts [description-setter] Could not determine description. Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
Failed: YARN-3047 PreCommit Build #7105
Jira: https://issues.apache.org/jira/browse/YARN-3047 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7105/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 42 lines...] patch: Only garbage was found in the patch input. patch: Only garbage was found in the patch input. The patch does not appear to apply with p0 to p2 PATCH APPLICATION FAILED {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707233/Timeline_Reader%28draft%29.pdf against trunk revision c906a1d. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7105//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. 1f106d5197ad36251f7ea64cdf9d79dba51c4550 logged out == == Finished build. == == Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to PreCommit-YARN-Build #7100 ERROR: Failed to archive {patchprocess/patchJavacWarnings.txt=patchprocess/patchJavacWarnings.txt, patchprocess/trunkJavacWarnings.txt=patchprocess/trunkJavacWarnings.txt, patchprocess/trunkJavadocWarnings.txt=patchprocess/trunkJavadocWarnings.txt} due to internal error; falling back to full archiving java.lang.IllegalStateException: checksum mismatch after transfer (6577874794637500426 vs. 4168773997); /x1/jenkins/jenkins-home/jobs/PreCommit-YARN-Build/builds/2015-03-25_16-20-34/archive/patchprocess/patchJavacWarnings.txt may be corrupted at jsync.protocol.FileSequenceReader.read(FileSequenceReader.java:45) at com.cloudbees.jenkins.plugins.jsync.archiver.JSyncArtifactManager.remoteSync(JSyncArtifactManager.java:145) at com.cloudbees.jenkins.plugins.jsync.archiver.JSyncArtifactManager.archive(JSyncArtifactManager.java:68) at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:140) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:756) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720) at hudson.model.Build$BuildExecution.post2(Build.java:182) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:669) at hudson.model.Run.execute(Run.java:1731) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:232) [description-setter] Could not determine description. Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
Re: 2.7 status
Progress has been really slow, but now we are down to four blockers across the board. I plan to roll an RC this weekend. Thanks, +Vinod On Mar 8, 2015, at 8:40 PM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: 2.7 branch created and branch-2 updated to point to 2.8-SNAPSHOT. Committers, please exercise caution on the content going into branch-2.7. I'd take help everyone's help in pushing through the remaining set of blockers targeted for 2.7. Thanks, +Vinod On Mar 8, 2015, at 8:21 PM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Branching 2.7 now. Request holding off commits to branch-2 to avoid commit race. Will send an all-clear in the next 30 mins once I am done. Thanks +Vinod On Mar 5, 2015, at 1:56 PM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: The 2.7 blocker JIRA went down and going back up again, we will need to converge. Unless I see objections, I plan to cut a branch this weekend and selectively filter stuff in after that in the interest of convergence. Thoughts welcome! Thanks, +Vinod On Mar 1, 2015, at 11:58 AM, Arun Murthy a...@hortonworks.com wrote: Sounds good, thanks for the help Vinod! Arun From: Vinod Kumar Vavilapalli Sent: Sunday, March 01, 2015 11:43 AM To: Hadoop Common; Jason Lowe; Arun Murthy Subject: Re: 2.7 status Agreed. How about we roll an RC end of this week? As a Java 7+ release with features, patches that already got in? Here's a filter tracking blocker tickets - https://issues.apache.org/jira/issues/?filter=12330598. Nine open now. +Arun Arun, I'd like to help get 2.7 out without further delay. Do you mind me taking over release duties? Thanks, +Vinod From: Jason Lowe jl...@yahoo-inc.com.INVALID Sent: Friday, February 13, 2015 8:11 AM To: common-...@hadoop.apache.org Subject: Re: 2.7 status I'd like to see a 2.7 release sooner than later. It has been almost 3 months since Hadoop 2.6 was released, and there have already been 634 JIRAs committed to 2.7. That's a lot of changes waiting for an official release. https://issues.apache.org/jira/issues/?jql=project%20in%20%28hadoop%2Chdfs%2Cyarn%2Cmapreduce%29%20AND%20fixversion%3D2.7.0%20AND%20resolution%3DFixed Jason From: Sangjin Lee sj...@apache.org To: common-...@hadoop.apache.org common-...@hadoop.apache.org Sent: Tuesday, February 10, 2015 1:30 PM Subject: 2.7 status Folks, What is the current status of the 2.7 release? I know initially it started out as a java-7 only release, but looking at the JIRAs that is very much not the case. Do we have a certain timeframe for 2.7 or is it time to discuss it? Thanks, Sangjin
Failed: YARN-3204 PreCommit Build #7104
Jira: https://issues.apache.org/jira/browse/YARN-3204 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7104/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3437 lines...] {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12702024/YARN-3204-003.patch against trunk revision c906a1d. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:red}-1 findbugs{color}. The patch appears to introduce 1 new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7104//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-YARN-Build/7104//artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7104//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. a2551e92dc5c0d854ceb5ecc2d1647aa8b0beb3f logged out == == Finished build. == == Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to PreCommit-YARN-Build #7102 Archived 15 artifacts Archive block size is 32768 Received 60 blocks and 7108368 bytes Compression is 21.7% Took 1.7 sec [description-setter] Could not determine description. Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## All tests passed
Failed: YARN-1621 PreCommit Build #7107
Jira: https://issues.apache.org/jira/browse/YARN-1621 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7107/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 53 lines...] Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java... == == Pre-build trunk to verify trunk stability and javac warnings == == Compiling /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build /home/jenkins/tools/maven/latest/bin/mvn clean test -DskipTests -DHadoopPatchProcess -Ptest-patch /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess/trunkJavacWarnings.txt 21 Trunk compilation is broken? {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707271/YARN-1621.6.patch against trunk revision 97e2aa2. {color:red}-1 patch{color}. Trunk compilation may be broken. Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7107//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. 89e2d184116064fc6859dcfff0b451a7894f576b logged out == == Finished build. == == Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to PreCommit-YARN-Build #7102 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20149 bytes Compression is 0.0% Took 0.84 sec [description-setter] Could not determine description. Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
Re: 2.7 status
Progress is good! What are the four blockers? Could you please mark them as such in the Jira. Thanks, --Konst On Wed, Mar 25, 2015 at 9:53 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Progress has been really slow, but now we are down to four blockers across the board. I plan to roll an RC this weekend. Thanks, +Vinod On Mar 8, 2015, at 8:40 PM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: 2.7 branch created and branch-2 updated to point to 2.8-SNAPSHOT. Committers, please exercise caution on the content going into branch-2.7. I'd take help everyone's help in pushing through the remaining set of blockers targeted for 2.7. Thanks, +Vinod On Mar 8, 2015, at 8:21 PM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Branching 2.7 now. Request holding off commits to branch-2 to avoid commit race. Will send an all-clear in the next 30 mins once I am done. Thanks +Vinod On Mar 5, 2015, at 1:56 PM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: The 2.7 blocker JIRA went down and going back up again, we will need to converge. Unless I see objections, I plan to cut a branch this weekend and selectively filter stuff in after that in the interest of convergence. Thoughts welcome! Thanks, +Vinod On Mar 1, 2015, at 11:58 AM, Arun Murthy a...@hortonworks.com wrote: Sounds good, thanks for the help Vinod! Arun From: Vinod Kumar Vavilapalli Sent: Sunday, March 01, 2015 11:43 AM To: Hadoop Common; Jason Lowe; Arun Murthy Subject: Re: 2.7 status Agreed. How about we roll an RC end of this week? As a Java 7+ release with features, patches that already got in? Here's a filter tracking blocker tickets - https://issues.apache.org/jira/issues/?filter=12330598. Nine open now. +Arun Arun, I'd like to help get 2.7 out without further delay. Do you mind me taking over release duties? Thanks, +Vinod From: Jason Lowe jl...@yahoo-inc.com.INVALID Sent: Friday, February 13, 2015 8:11 AM To: common-...@hadoop.apache.org Subject: Re: 2.7 status I'd like to see a 2.7 release sooner than later. It has been almost 3 months since Hadoop 2.6 was released, and there have already been 634 JIRAs committed to 2.7. That's a lot of changes waiting for an official release. https://issues.apache.org/jira/issues/?jql=project%20in%20%28hadoop%2Chdfs%2Cyarn%2Cmapreduce%29%20AND%20fixversion%3D2.7.0%20AND%20resolution%3DFixed Jason From: Sangjin Lee sj...@apache.org To: common-...@hadoop.apache.org common-...@hadoop.apache.org Sent: Tuesday, February 10, 2015 1:30 PM Subject: 2.7 status Folks, What is the current status of the 2.7 release? I know initially it started out as a java-7 only release, but looking at the JIRAs that is very much not the case. Do we have a certain timeframe for 2.7 or is it time to discuss it? Thanks, Sangjin
[jira] [Created] (YARN-3399) Default cluster ID for RM HA
Zhijie Shen created YARN-3399: - Summary: Default cluster ID for RM HA Key: YARN-3399 URL: https://issues.apache.org/jira/browse/YARN-3399 Project: Hadoop YARN Issue Type: Bug Components: resourcemanager Reporter: Zhijie Shen In YARN-3040, timeline service will set the default cluster ID if users don't provide one. RM HA's current behavior is a bit different when users don't provide cluster ID. IllegalArgumentException will throw instead. Let's continue the discussion if RM HA needs the default cluster ID or not here, and what's the proper default cluster ID. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Failed: YARN-3044 PreCommit Build #7108
Jira: https://issues.apache.org/jira/browse/YARN-3044 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7108/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 49 lines...] Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ContainerCreatedEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ContainerFinishedEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsEventType.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java... Hunk #1 succeeded at 413 (offset -17 lines). Hunk #2 succeeded at 1176 (offset -49 lines). Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/AppAttemptFinishedEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/AppAttemptRegisteredEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/ApplicationACLsUpdatedEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/ApplicationCreatedEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/ApplicationFinishedEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/RMTimelineCollector.java... error: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/RMTimelineCollector.java: No such file or directory Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/SystemMetricsEvent.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/timelineservice/SystemMetricsEventType.java... Checking patch hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFSLeafQueue.java... PATCH APPLICATION FAILED {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707292/YARN-3044.20150325-1.patch against trunk revision fc1031a. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7108//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. df0b305c3a45c743dbcdb35727f4f4ae993bed66 logged out == == Finished build. ==
Failed: YARN-3365 PreCommit Build #7110
Jira: https://issues.apache.org/jira/browse/YARN-3365 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7110/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3118 lines...] /bin/grep: /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess/patch: No such file or directory cat: /tmp/tmp.modules.21845: No such file or directory rm: cannot remove '/tmp/tmp.modules.21845': No such file or directory {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707355/YARN-3365.003.patch against trunk revision 44809b8. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:red}-1 eclipse:eclipse{color}. The patch failed to build with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7110//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7110//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. 73026d790d741a6db178256e6d442b3440eb964b logged out == == Finished build. == == Build step 'Execute shell' marked build as failure Archiving artifacts [description-setter] Could not determine description. Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
Failed: YARN-3400 PreCommit Build #7111
Jira: https://issues.apache.org/jira/browse/YARN-3400 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7111/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3323 lines...] {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707392/YARN-3400.patch against trunk revision 44809b8. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7111//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7111//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. e8db1025d71dcc5fe46689329fcb7ca507af6b07 logged out == == Finished build. == == Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to PreCommit-YARN-Build #7102 Archived 15 artifacts Archive block size is 32768 Received 221 blocks and 1819223 bytes Compression is 79.9% Took 1.1 sec [description-setter] Could not determine description. Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## All tests passed
Hadoop-Yarn-trunk-Java8 - Build # 143 - Still Failing
See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/143/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4983 lines...] [INFO] hadoop-yarn-common SUCCESS [02:10 min] [INFO] hadoop-yarn-server SUCCESS [ 0.062 s] [INFO] hadoop-yarn-server-common . SUCCESS [ 34.625 s] [INFO] hadoop-yarn-server-nodemanager SUCCESS [05:48 min] [INFO] hadoop-yarn-server-web-proxy .. SUCCESS [ 14.228 s] [INFO] hadoop-yarn-server-applicationhistoryservice .. SUCCESS [02:53 min] [INFO] hadoop-yarn-server-resourcemanager FAILURE [47:59 min] [INFO] hadoop-yarn-server-tests .. SKIPPED [INFO] hadoop-yarn-client SKIPPED [INFO] hadoop-yarn-server-sharedcachemanager . SKIPPED [INFO] hadoop-yarn-applications .. SKIPPED [INFO] hadoop-yarn-applications-distributedshell . SKIPPED [INFO] hadoop-yarn-applications-unmanaged-am-launcher SKIPPED [INFO] hadoop-yarn-site .. SKIPPED [INFO] hadoop-yarn-registry .. SKIPPED [INFO] hadoop-yarn-project ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 01:00 h [INFO] Finished at: 2015-03-25T11:32:51+00:00 [INFO] Final Memory: 72M/845M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-yarn-server-resourcemanager: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Yarn-trunk-Java8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/surefire-reports for the individual test results. [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :hadoop-yarn-server-resourcemanager Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results Updating HDFS-7875 Updating HDFS-7985 Updating HDFS-7961 Updating HDFS-7977 Updating HDFS-7976 Updating MAPREDUCE-6285 Updating YARN-3383 Updating HADOOP-11738 Updating MAPREDUCE-6292 Updating HDFS-7713 Updating MAPREDUCE-579 Updating HADOOP-11741 Updating HADOOP-11609 Updating HDFS-6826 Updating HADOOP-11014 Updating HDFS-7854 Updating HADOOP-11602 Sending e-mails to: yarn-dev@hadoop.apache.org Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 3 tests failed. FAILED: org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService.testGetLabelsToNodes Error Message: null Stack Trace: java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService.testGetLabelsToNodes(TestClientRMService.java:1497) FAILED: org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService.testGetClusterNodes Error Message: java.net.BindException: Problem binding to [0.0.0.0:8032] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException Stack Trace: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0.0.0:8032] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:414) at sun.nio.ch.Net.bind(Net.java:406) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.apache.hadoop.ipc.Server.bind(Server.java:413) at org.apache.hadoop.ipc.Server$Listener.init(Server.java:579) at org.apache.hadoop.ipc.Server.init(Server.java:2308) at
Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #143
See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/143/changes Changes: [ozawa] HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena. [ozawa] Fix CHANGES.txt for HADOOP-11602. [ozawa] MAPREDUCE-6285. ClientServiceDelegate should not retry upon AuthenticationException. Contributed by Jonathan Eagles. [wang] HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu. [brandonli] HDFS-7976. Update NFS user guide for mount option 'sync' to minimize or avoid reordered writes. Contributed by Brandon Li [harsh] HDFS-7875. Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated. Contributed by Nijel. [wangda] YARN-3383. AdminService should use warn instead of info to log exception when operation fails. (Li Lu via wangda) [brandonli] HDFS-7977. NFS couldn't take percentile intervals. Contributed by Brandon Li [jing9] HDFS-7854. Separate class DataStreamer out of DFSOutputStream. Contributed by Li Bo. [wheat9] HDFS-7713. Implement mkdirs in the HDFS Web UI. Contributed by Ravi Prakash. [jitendra] HDFS-6826. Plugin interface to enable delegation of HDFS authorization assertions. Contributed by Arun Suresh. [wheat9] HDFS-7985. WebHDFS should be always enabled. Contributed by Li Lu. [ozawa] HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). Contributed by Walter Su. [ozawa] HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa) [ozawa] HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. (ozawa) [harsh] MAPREDUCE-579. Streaming slowmatch documentation. [aajisaka] MAPREDUCE-6292. Use org.junit package instead of junit.framework in TestCombineFileInputFormat. (aajisaka) -- [...truncated 4790 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.116 sec - in org.apache.hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.yarn.server.resourcemanager.TestRMAuditLogger Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.992 sec - in org.apache.hadoop.yarn.server.resourcemanager.TestRMAuditLogger Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.yarn.server.resourcemanager.TestRMNodeTransitions Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.354 sec - in org.apache.hadoop.yarn.server.resourcemanager.TestRMNodeTransitions Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.yarn.server.resourcemanager.TestAppManager Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.906 sec - in org.apache.hadoop.yarn.server.resourcemanager.TestAppManager Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService Tests run: 24, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 9.827 sec FAILURE! - in org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService testGetLabelsToNodes(org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService) Time elapsed: 0.146 sec FAILURE! java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService.testGetLabelsToNodes(TestClientRMService.java:1497) testGetClusterNodes(org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService) Time elapsed: 0.206 sec ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0.0.0:8032] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:414) at sun.nio.ch.Net.bind(Net.java:406) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.apache.hadoop.ipc.Server.bind(Server.java:413) at org.apache.hadoop.ipc.Server$Listener.init(Server.java:579) at org.apache.hadoop.ipc.Server.init(Server.java:2308) at org.apache.hadoop.ipc.RPC$Server.init(RPC.java:945) at
[jira] [Created] (YARN-3397) Failover should be filtered out from HAAdmin to be in sync with doc.
J.Andreina created YARN-3397: Summary: Failover should be filtered out from HAAdmin to be in sync with doc. Key: YARN-3397 URL: https://issues.apache.org/jira/browse/YARN-3397 Project: Hadoop YARN Issue Type: Bug Reporter: J.Andreina Failover should be filtered out from HAAdmin to be in sync with doc. Since -failover is not supported operation in doc it is not been mentioned, cli usage is misguiding (can be in sync with doc) . -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Jenkins build is back to normal : Hadoop-Yarn-trunk #877
See https://builds.apache.org/job/Hadoop-Yarn-trunk/877/changes
Failed: YARN-3304 PreCommit Build #7112
Jira: https://issues.apache.org/jira/browse/YARN-3304 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7112/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3691 lines...] {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 2 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: org.apache.hadoop.yarn.server.resourcemanager.TestRMHA org.apache.hadoop.yarn.server.resourcemanager.TestRMAdminService org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebappAuthentication org.apache.hadoop.yarn.server.resourcemanager.TestMoveApplication org.apache.hadoop.yarn.server.resourcemanager.recovery.TestZKRMStateStore Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7112//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7112//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. 513f6b6f1ff3d826fd556ab6d969873e8a309283 logged out == == Finished build. == == Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to PreCommit-YARN-Build #7102 Archived 20 artifacts Archive block size is 32768 Received 54 blocks and 7684326 bytes Compression is 18.7% Took 1.7 sec [description-setter] Could not determine description. Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 16 tests failed. FAILED: org.apache.hadoop.yarn.server.resourcemanager.TestMoveApplication.testMoveTooLate Error Message: Error starting http server Stack Trace: org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:785) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:274) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:974) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1074) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.server.resourcemanager.TestMoveApplication.setUp(TestMoveApplication.java:59) FAILED: org.apache.hadoop.yarn.server.resourcemanager.TestMoveApplication.testMoveRejectedByPermissions Error Message: Error starting http server Stack Trace: org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:444) at sun.nio.ch.Net.bind(Net.java:436) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216) at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:830) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:772) at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:274) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:974) at
Success: YARN-3304 PreCommit Build #7113
Jira: https://issues.apache.org/jira/browse/YARN-3304 Build: https://builds.apache.org/job/PreCommit-YARN-Build/7113/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3652 lines...] {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707398/YARN-3304-v3.patch against trunk revision 44809b8. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 3 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7113//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7113//console This message is automatically generated. == == Adding comment to Jira. == == Comment added. 310141dac8bc18a1026371787598b8e901f38cff logged out == == Finished build. == == Archiving artifacts Sending artifact delta relative to PreCommit-YARN-Build #7102 Archived 20 artifacts Archive block size is 32768 Received 52 blocks and 7588019 bytes Compression is 18.3% Took 4 sec Description set: YARN-3304 Recording test results Publish JUnit test result report is waiting for a checkpoint on PreCommit-YARN-Build #7112 Email was triggered for: Success Sending email for trigger: Success ### ## FAILED TESTS (if any) ## All tests passed