See <https://builds.apache.org/job/Hadoop-Yarn-trunk/1371/changes>
Changes: [arp] HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the [yzhang] HDFS-9236. Missing sanity check for block size during block recovery. [kihwal] HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu ------------------------------------------ [...truncated 11073 lines...] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-yarn-applications --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop YARN DistributedShell 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-yarn-applications-distributedshell --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-yarn-applications-distributedshell --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-yarn-applications-distributedshell --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/resources> [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-yarn-applications-distributedshell --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 4 source files to <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/classes> [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-yarn-applications-distributedshell --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-yarn-applications-distributedshell --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/test-classes> [INFO] [INFO] --- maven-jar-plugin:2.5:jar (default) @ hadoop-yarn-applications-distributedshell --- [INFO] Building jar: <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/hadoop-yarn-applications-distributedshell-3.0.0-SNAPSHOT.jar> [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-yarn-applications-distributedshell --- [INFO] Surefire report directory: <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/surefire-reports> ------------------------------------------------------- T E S T S ------------------------------------------------------- ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell Tests run: 11, Failures: 0, Errors: 11, Skipped: 0, Time elapsed: 20.496 sec <<< FAILURE! - in org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell testDSShellWithInvalidArgs(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 3.663 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDSShellWithoutDomain(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.697 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDSAttemptFailuresValidityIntervalFailed(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.707 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDSShellWithMultipleArgs(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.638 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDSAttemptFailuresValidityIntervalSucess(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.644 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDSShellWithDomain(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.642 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDebugFlag(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.629 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDSShellWithShellScript(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.662 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDSRestartWithPreviousRunningContainers(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.628 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testDSShellWithCustomLogPropertyFile(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.628 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) testContainerLaunchFailureHandling(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell) Time elapsed: 1.631 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setup(TestDistributedShell.java:72) Running org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShellWithNodeLabels Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.961 sec <<< FAILURE! - in org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShellWithNodeLabels testDSShellWithNodeLabelExpression(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShellWithNodeLabels) Time elapsed: 3.73 sec <<< ERROR! org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ResourceManager failed to start. Final state is STOPPED at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:331) at org.apache.hadoop.yarn.server.MiniYARNCluster.access$500(MiniYARNCluster.java:99) at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:457) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.setupInternal(TestDistributedShell.java:94) at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShellWithNodeLabels.setup(TestDistributedShellWithNodeLabels.java:47) Running org.apache.hadoop.yarn.applications.distributedshell.TestDSAppMaster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.705 sec - in org.apache.hadoop.yarn.applications.distributedshell.TestDSAppMaster Results : Tests in error: TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShell.setup:72->setupInternal:94 » YarnRuntime java.io.IOExcept... TestDistributedShellWithNodeLabels.setup:47 » YarnRuntime java.io.IOException:... Tests run: 14, Failures: 0, Errors: 12, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop YARN ................................ SUCCESS [ 3.957 s] [INFO] Apache Hadoop YARN API ............................ SUCCESS [04:32 min] [INFO] Apache Hadoop YARN Common ......................... SUCCESS [03:14 min] [INFO] Apache Hadoop YARN Server ......................... SUCCESS [ 0.102 s] [INFO] Apache Hadoop YARN Server Common .................. SUCCESS [ 51.312 s] [INFO] Apache Hadoop YARN NodeManager .................... SUCCESS [09:44 min] [INFO] Apache Hadoop YARN Web Proxy ...................... SUCCESS [ 27.388 s] [INFO] Apache Hadoop YARN ApplicationHistoryService ...... SUCCESS [03:37 min] [INFO] Apache Hadoop YARN ResourceManager ................ SUCCESS [ 01:02 h] [INFO] Apache Hadoop YARN Server Tests ................... SUCCESS [01:55 min] [INFO] Apache Hadoop YARN Client ......................... SUCCESS [07:23 min] [INFO] Apache Hadoop YARN SharedCacheManager ............. SUCCESS [ 31.450 s] [INFO] Apache Hadoop YARN Applications ................... SUCCESS [ 0.049 s] [INFO] Apache Hadoop YARN DistributedShell ............... FAILURE [ 29.515 s] [INFO] Apache Hadoop YARN Unmanaged Am Launcher .......... SKIPPED [INFO] Apache Hadoop YARN Site ........................... SKIPPED [INFO] Apache Hadoop YARN Registry ....................... SKIPPED [INFO] Apache Hadoop YARN Project ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:35 h [INFO] Finished at: 2015-11-06T22:34:49+00:00 [INFO] Final Memory: 82M/807M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-yarn-applications-distributedshell: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-yarn-applications-distributedshell Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results Updating HDFS-9236 Updating HDFS-6481 Updating HDFS-9318
