See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/1391/changes>
Changes: [cdouglas] YARN-45. Add protocol for schedulers to request containers back from ApplicationMasters. Contributed by Carlo Curino and Chris Douglas. [vinodkv] YARN-632. Changed ContainerManager api to throw IOException and YarnRemoteException. Contributed by Xuan Gong. [vinodkv] YARN-633. Changed RMAdminProtocol api to throw IOException and YarnRemoteException. Contributed by Xuan Gong. [vinodkv] YARN-629. Make YarnRemoteException not be rooted at IOException. Contributed by Xuan Gong. MAPREDUCE-5204. Handling YarnRemoteException separately from IOException in MR app after YARN-629. Contributed by Xuan Gong. [sradia] HADOOP-9425 Add error codes to rpc-response (sanjay Radia) [vinodkv] YARN-645. Moved RMDelegationTokenSecretManager from yarn-server-common to yarn-server-resourcemanager where it really belongs. Contributed by Jian He. [vinodkv] MAPREDUCE-5205. Fixed MR App to load tokens correctly. Contributed by Vinod Kumar Vavilapalli. [vinodkv] HADOOP-9511. Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils so as to help YARN-578. Contributed by Omkar Vinit Joshi. [suresh] HADOOP-9523. Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs. Contributed by Tian Hong Wang. [suresh] HADOOP-9483. Adding a file missed in previous commit r1478592 [vinodkv] YARN-625. Move the utility method unwrapAndThrowException from YarnRemoteExceptionPBImpl to RPCUtil. Contributed by Siddharth Seth. [suresh] HADOOP-9483. winutils support for readlink command. Contributed by Arpit Agarwal. [suresh] HADOOP-9043. Adding Arpit Agarwal as an additional contributor [suresh] HADOOP-9043. Disallow in winutils creating symlinks with forwards slashes. Contributed by Chris Nauroth. [suresh] HDFS-4785 and HDFS-4784 are moved to 2.0.5 release section [tomwhite] MAPREDUCE-5036. Default shuffle handler port should not be 8080. Contributed by Sandy Ryza. ------------------------------------------ [...truncated 14646 lines...] at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.apache.hadoop.test.TestHdfsHelper$HdfsStatement.evaluate(TestHdfsHelper.java:74) at org.apache.hadoop.test.TestDirHelper$1.evaluate(TestDirHelper.java:106) at org.apache.hadoop.test.TestDirHelper$1.evaluate(TestDirHelper.java:106) at org.apache.hadoop.test.TestJettyHelper$1.evaluate(TestJettyHelper.java:53) at org.apache.hadoop.test.TestExceptionHelper$1.evaluate(TestExceptionHelper.java:42) at org.junit.runners.BlockJUnit4ClassRunner.runNotIgnored(BlockJUnit4ClassRunner.java:79) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:71) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:49) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184) at org.junit.runners.ParentRunner.run(ParentRunner.java:236) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:24) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184) at org.junit.runners.ParentRunner.run(ParentRunner.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165) at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75) testOperationDoAs[4](org.apache.hadoop.fs.http.client.TestHttpFSWithHttpFSFileSystem) Time elapsed: 398 sec <<< ERROR! org.apache.hadoop.ipc.RemoteException(java.io.IOException): Specified block size is less than configured minimum value (dfs.namenode.fs-limits.min-block-size): 1024 < 1048576 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:1829) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:1798) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:438) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:273) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:41892) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:527) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1033) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1842) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1838) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1489) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1836) at org.apache.hadoop.ipc.Client.call(Client.java:1303) at org.apache.hadoop.ipc.Client.call(Client.java:1255) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:204) at $Proxy19.create(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:163) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:82) at $Proxy19.create(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.create(ClientNamenodeProtocolTranslatorPB.java:217) at org.apache.hadoop.hdfs.DFSOutputStream.newStreamForCreate(DFSOutputStream.java:1344) at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1284) at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1209) at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:295) at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:263) at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:80) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:888) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:869) at org.apache.hadoop.hdfs.DFSTestUtil.createFile(DFSTestUtil.java:233) at org.apache.hadoop.hdfs.DFSTestUtil.createFile(DFSTestUtil.java:219) at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith.testConcat(BaseTestHttpFSWith.java:220) at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith.operation(BaseTestHttpFSWith.java:498) at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith.access$100(BaseTestHttpFSWith.java:62) at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith$1.run(BaseTestHttpFSWith.java:572) at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith$1.run(BaseTestHttpFSWith.java:569) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1489) at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith.testOperationDoAs(BaseTestHttpFSWith.java:569) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.apache.hadoop.test.TestHdfsHelper$HdfsStatement.evaluate(TestHdfsHelper.java:74) at org.apache.hadoop.test.TestDirHelper$1.evaluate(TestDirHelper.java:106) at org.apache.hadoop.test.TestDirHelper$1.evaluate(TestDirHelper.java:106) at org.apache.hadoop.test.TestJettyHelper$1.evaluate(TestJettyHelper.java:53) at org.apache.hadoop.test.TestExceptionHelper$1.evaluate(TestExceptionHelper.java:42) at org.junit.runners.BlockJUnit4ClassRunner.runNotIgnored(BlockJUnit4ClassRunner.java:79) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:71) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:49) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184) at org.junit.runners.ParentRunner.run(ParentRunner.java:236) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:24) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184) at org.junit.runners.ParentRunner.run(ParentRunner.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165) at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75) Running org.apache.hadoop.fs.http.server.TestCheckUploadContentTypeFilter Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.269 sec Running org.apache.hadoop.fs.http.server.TestHttpFSCustomUserName Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.835 sec Running org.apache.hadoop.fs.http.server.TestHttpFSKerberosAuthenticationHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.042 sec Running org.apache.hadoop.fs.http.server.TestHttpFSServer Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.776 sec Running org.apache.hadoop.lib.servlet.TestServerWebApp Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.216 sec Running org.apache.hadoop.lib.servlet.TestMDCFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.287 sec Running org.apache.hadoop.lib.servlet.TestHostnameFilter Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.258 sec Running org.apache.hadoop.lib.wsrs.TestJSONProvider Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.051 sec Running org.apache.hadoop.lib.wsrs.TestParam Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec Running org.apache.hadoop.lib.wsrs.TestJSONMapProvider Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.051 sec Running org.apache.hadoop.lib.wsrs.TestUserProvider Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.266 sec Running org.apache.hadoop.lib.wsrs.TestInputStreamEntity Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.087 sec Running org.apache.hadoop.lib.service.instrumentation.TestInstrumentationService Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.646 sec Running org.apache.hadoop.lib.service.hadoop.TestFileSystemAccessService Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.909 sec Running org.apache.hadoop.lib.service.security.TestProxyUserService Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.833 sec Running org.apache.hadoop.lib.service.security.TestDelegationTokenManagerService Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.753 sec Running org.apache.hadoop.lib.service.security.TestGroupsService Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.21 sec Running org.apache.hadoop.lib.service.scheduler.TestSchedulerService Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.205 sec Running org.apache.hadoop.lib.util.TestConfigurationUtils Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.127 sec Running org.apache.hadoop.lib.util.TestCheck Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.085 sec Running org.apache.hadoop.lib.server.TestBaseService Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.263 sec Running org.apache.hadoop.lib.server.TestServer Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.411 sec Running org.apache.hadoop.lib.server.TestServerConstructor Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.108 sec Running org.apache.hadoop.lib.lang.TestXException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.057 sec Running org.apache.hadoop.lib.lang.TestRunnableCallable Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.058 sec Running org.apache.hadoop.test.TestHdfsHelper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.test.TestHFSTestCase Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.033 sec Running org.apache.hadoop.test.TestHTestCase Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.191 sec Running org.apache.hadoop.test.TestJettyHelper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.052 sec Running org.apache.hadoop.test.TestExceptionHelper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 sec Running org.apache.hadoop.test.TestDirHelper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.048 sec Results : Tests in error: testOperation[4](org.apache.hadoop.fs.http.client.TestHttpFSFWithWebhdfsFileSystem): Specified block size is less than configured minimum value (dfs.namenode.fs-limits.min-block-size): 1024 < 1048576(..) testOperationDoAs[4](org.apache.hadoop.fs.http.client.TestHttpFSFWithWebhdfsFileSystem): Specified block size is less than configured minimum value (dfs.namenode.fs-limits.min-block-size): 1024 < 1048576(..) testOperation[4](org.apache.hadoop.fs.http.client.TestHttpFSWithHttpFSFileSystem): Specified block size is less than configured minimum value (dfs.namenode.fs-limits.min-block-size): 1024 < 1048576(..) testOperationDoAs[4](org.apache.hadoop.fs.http.client.TestHttpFSWithHttpFSFileSystem): Specified block size is less than configured minimum value (dfs.namenode.fs-limits.min-block-size): 1024 < 1048576(..) Tests run: 286, Failures: 0, Errors: 4, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ SUCCESS [1:29:32.382s] [INFO] Apache Hadoop HttpFS .............................. FAILURE [1:44.316s] [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:31:17.895s [INFO] Finished at: Tue May 07 13:04:35 UTC 2013 [INFO] Final Memory: 49M/507M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.3:test (default-test) on project hadoop-hdfs-httpfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs-httpfs Build step 'Execute shell' marked build as failure Archiving artifacts Updating MAPREDUCE-5036 Updating HADOOP-9483 Updating HADOOP-9511 Updating MAPREDUCE-5205 Updating MAPREDUCE-5204 Updating HDFS-4784 Updating HDFS-4785 Updating HADOOP-9043 Updating YARN-625 Updating YARN-632 Updating YARN-645 Updating YARN-633 Updating YARN-629 Updating YARN-578 Updating YARN-45 Updating HADOOP-9425 Updating HADOOP-9523