See <https://builds.apache.org/job/Hadoop-Yarn-trunk/644/changes>
Changes: [kasha] YARN-1370. Fair scheduler to re-populate container allocation state. (Anubhav Dhoot via kasha) [arp] HADOOP-10281. Create a scheduler, which assigns schedulables a priority level. (Contributed by Chris Li) [cmccabe] HADOOP-10962. Flags for posix_fadvise are not valid in some architectures (David Villegas via Colin Patrick McCabe) [kasha] YARN-2399. Delete old versions of files. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha) [arp] HADOOP-10851. NetgroupCache does not remove group memberships. (Contributed by Benoy Antony) [arp] HDFS-6836. HDFS INFO logging is verbose & uses file appenders. (Contributed by Xiaoyu Yao) [kasha] YARN-2399. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha) [arp] HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal) [zjshen] YARN-2317. Updated the document about how to write YARN applications. Contributed by Li Lu. [jianhe] YARN-2373. Changed WebAppUtils to use Configuration#getPassword for accessing SSL passwords. Contributed by Larry McCay [wang] HADOOP-10820. Throw an exception in GenericOptionsParser when passed an empty Path. Contributed by Alex Holmes and Zhihai Xu. ------------------------------------------ [...truncated 16595 lines...] ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.hadoop.yarn.server.TestMiniYARNClusterForHA Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.112 sec - in org.apache.hadoop.yarn.server.TestMiniYARNClusterForHA Running org.apache.hadoop.yarn.server.TestRMNMSecretKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.176 sec - in org.apache.hadoop.yarn.server.TestRMNMSecretKeys Running org.apache.hadoop.yarn.server.TestDiskFailures Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.664 sec - in org.apache.hadoop.yarn.server.TestDiskFailures Running org.apache.hadoop.yarn.server.TestContainerManagerSecurity Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.616 sec - in org.apache.hadoop.yarn.server.TestContainerManagerSecurity Results : Tests run: 7, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-yarn-server-tests --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/hadoop-yarn-server-tests-3.0.0-SNAPSHOT.jar> [INFO] [INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-yarn-server-tests --- [INFO] No sources in project. Archive not created. [INFO] [INFO] --- maven-source-plugin:2.1.2:test-jar-no-fork (hadoop-java-sources) @ hadoop-yarn-server-tests --- [INFO] Building jar: <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/hadoop-yarn-server-tests-3.0.0-SNAPSHOT-test-sources.jar> [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-yarn-server-tests --- [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hadoop-yarn-server-tests --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-yarn-server-tests --- [INFO] Building jar: <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/hadoop-yarn-server-tests-3.0.0-SNAPSHOT-javadoc.jar> [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-yarn-server-tests --- [INFO] [INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-yarn-server-tests --- [INFO] [INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-yarn-server-tests --- [INFO] ****** FindBugsMojo execute ******* [INFO] canGenerate is false [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building hadoop-yarn-client 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [WARNING] The POM for org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 is missing, no dependency information available [WARNING] Failed to retrieve plugin descriptor for org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not be resolved: Failure to find org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 in http://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-yarn-client --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-yarn-client --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-resources-plugin:2.2:resources (default-resources) @ hadoop-yarn-client --- [INFO] Using default encoding to copy filtered resources. [INFO] [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ hadoop-yarn-client --- [INFO] Compiling 26 source files to <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/target/classes> [INFO] [INFO] --- maven-resources-plugin:2.2:testResources (default-testResources) @ hadoop-yarn-client --- [INFO] Using default encoding to copy filtered resources. [INFO] [INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ hadoop-yarn-client --- [INFO] Compiling 20 source files to <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/target/test-classes> [INFO] [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hadoop-yarn-client --- [INFO] Surefire report directory: <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/target/surefire-reports> ------------------------------------------------------- T E S T S ------------------------------------------------------- ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.hadoop.yarn.client.TestApplicationClientProtocolOnHA Running org.apache.hadoop.yarn.client.TestRMFailover Tests run: 5, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 10.093 sec <<< FAILURE! - in org.apache.hadoop.yarn.client.TestRMFailover testExplicitFailover(org.apache.hadoop.yarn.client.TestRMFailover) Time elapsed: 3.116 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:323) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:95) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:448) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.client.TestRMFailover.testExplicitFailover(TestRMFailover.java:164) testEmbeddedWebAppProxy(org.apache.hadoop.yarn.client.TestRMFailover) Time elapsed: 1.758 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:323) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:95) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:448) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.client.TestRMFailover.testEmbeddedWebAppProxy(TestRMFailover.java:257) testWebAppProxyInStandAloneMode(org.apache.hadoop.yarn.client.TestRMFailover) Time elapsed: 1.658 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:323) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:95) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:448) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.client.TestRMFailover.testWebAppProxyInStandAloneMode(TestRMFailover.java:223) testRMWebAppRedirect(org.apache.hadoop.yarn.client.TestRMFailover) Time elapsed: 1.623 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:323) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:95) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:448) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.client.TestRMFailover.testRMWebAppRedirect(TestRMFailover.java:290) testAutomaticFailover(org.apache.hadoop.yarn.client.TestRMFailover) Time elapsed: 1.759 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:323) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:95) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:448) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.client.TestRMFailover.testAutomaticFailover(TestRMFailover.java:185) Running org.apache.hadoop.yarn.client.TestYarnApiClasses Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.314 sec - in org.apache.hadoop.yarn.client.TestYarnApiClasses Running org.apache.hadoop.yarn.client.cli.TestYarnCLI Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.723 sec - in org.apache.hadoop.yarn.client.cli.TestYarnCLI Running org.apache.hadoop.yarn.client.cli.TestLogsCLI Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.919 sec - in org.apache.hadoop.yarn.client.cli.TestLogsCLI Running org.apache.hadoop.yarn.client.TestResourceManagerAdministrationProtocolPBClientImpl Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.765 sec - in org.apache.hadoop.yarn.client.TestResourceManagerAdministrationProtocolPBClientImpl Running org.apache.hadoop.yarn.client.api.impl.TestNMClient Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 71.939 sec - in org.apache.hadoop.yarn.client.api.impl.TestNMClient Running org.apache.hadoop.yarn.client.api.impl.TestAHSClient Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.086 sec - in org.apache.hadoop.yarn.client.api.impl.TestAHSClient Running org.apache.hadoop.yarn.client.api.impl.TestAMRMClientOnRMRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.967 sec - in org.apache.hadoop.yarn.client.api.impl.TestAMRMClientOnRMRestart Running org.apache.hadoop.yarn.client.api.impl.TestYarnClient Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.046 sec - in org.apache.hadoop.yarn.client.api.impl.TestYarnClient Running org.apache.hadoop.yarn.client.api.impl.TestAMRMClient Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.779 sec - in org.apache.hadoop.yarn.client.api.impl.TestAMRMClient Running org.apache.hadoop.yarn.client.api.impl.TestAMRMClientContainerRequest Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.205 sec - in org.apache.hadoop.yarn.client.api.impl.TestAMRMClientContainerRequest Running org.apache.hadoop.yarn.client.api.async.impl.TestAMRMClientAsync Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.846 sec - in org.apache.hadoop.yarn.client.api.async.impl.TestAMRMClientAsync Running org.apache.hadoop.yarn.client.api.async.impl.TestNMClientAsync Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.865 sec - in org.apache.hadoop.yarn.client.api.async.impl.TestNMClientAsync Running org.apache.hadoop.yarn.client.TestRMAdminCLI Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.243 sec - in org.apache.hadoop.yarn.client.TestRMAdminCLI Running org.apache.hadoop.yarn.client.TestApplicationMasterServiceOnHA Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.122 sec <<< FAILURE! - in org.apache.hadoop.yarn.client.TestApplicationMasterServiceOnHA testAllocateOnHA(org.apache.hadoop.yarn.client.TestApplicationMasterServiceOnHA) Time elapsed: 2.944 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:323) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:95) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:448) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.client.ProtocolHATestBase.startHACluster(ProtocolHATestBase.java:278) at org.apache.hadoop.yarn.client.TestApplicationMasterServiceOnHA.initiate(TestApplicationMasterServiceOnHA.java:52) Running org.apache.hadoop.yarn.client.TestGetGroups Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.866 sec - in org.apache.hadoop.yarn.client.TestGetGroups Running org.apache.hadoop.yarn.client.TestResourceTrackerOnHA Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.138 sec <<< FAILURE! - in org.apache.hadoop.yarn.client.TestResourceTrackerOnHA testResourceTrackerOnHA(org.apache.hadoop.yarn.client.TestResourceTrackerOnHA) Time elapsed: 2.956 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:323) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:95) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:448) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.client.ProtocolHATestBase.startHACluster(ProtocolHATestBase.java:278) at org.apache.hadoop.yarn.client.TestResourceTrackerOnHA.initiate(TestResourceTrackerOnHA.java:44) Results : Tests in error: TestRMFailover.testExplicitFailover:164 ? YarnRuntime java.io.IOException: Res... TestRMFailover.testEmbeddedWebAppProxy:257 ? YarnRuntime java.io.IOException: ... TestRMFailover.testWebAppProxyInStandAloneMode:223 ? YarnRuntime java.io.IOExc... TestRMFailover.testRMWebAppRedirect:290 ? YarnRuntime java.io.IOException: Res... TestRMFailover.testAutomaticFailover:185 ? YarnRuntime java.io.IOException: Re... TestApplicationMasterServiceOnHA.initiate:52->ProtocolHATestBase.startHACluster:278 ? YarnRuntime TestResourceTrackerOnHA.initiate:44->ProtocolHATestBase.startHACluster:278 ? YarnRuntime Tests run: 109, Failures: 0, Errors: 7, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] hadoop-yarn ....................................... SUCCESS [ 3.055 s] [INFO] hadoop-yarn-api ................................... SUCCESS [02:11 min] [INFO] hadoop-yarn-common ................................ SUCCESS [02:09 min] [INFO] hadoop-yarn-server ................................ SUCCESS [ 0.084 s] [INFO] hadoop-yarn-server-common ......................... SUCCESS [ 33.785 s] [INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [04:51 min] [INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [ 17.906 s] [INFO] hadoop-yarn-server-applicationhistoryservice ...... SUCCESS [01:14 min] [INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [28:31 min] [INFO] hadoop-yarn-server-tests .......................... SUCCESS [01:18 min] [INFO] hadoop-yarn-client ................................ FAILURE [18:39 min] [INFO] hadoop-yarn-applications .......................... SKIPPED [INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED [INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SKIPPED [INFO] hadoop-yarn-site .................................. SKIPPED [INFO] hadoop-yarn-project ............................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 59:51 min [INFO] Finished at: 2014-08-13T11:33:11+00:00 [INFO] Final Memory: 89M/837M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-yarn-client: There was a timeout or other error in the fork -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-yarn-client Build step 'Execute shell' marked build as failure Archiving artifacts Updating HADOOP-10851 Updating HADOOP-10281 Updating YARN-2373 Updating YARN-2399 Updating HDFS-6830 Updating YARN-2317 Updating YARN-1370 Updating HADOOP-10962 Updating HADOOP-10820 Updating HDFS-6836
