See <https://builds.apache.org/job/HBase-1.4/jdk=JDK_1_8,label=yahoo-not-h2/428/changes>
Changes: [tedyu] HBASE-16423 Add re-compare option to VerifyReplication to avoid ------------------------------------------ [...truncated 47893 lines...] at org.apache.hadoop.hdfs.server.namenode.FSImage.saveFSImageInAllDirs(FSImage.java:1075) at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:150) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:926) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:287) at org.apache.hadoop.hdfs.DFSTestUtil.formatNameNode(DFSTestUtil.java:143) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:860) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:704) at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:642) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:625) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1022) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:903) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:885) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:854) at org.apache.hadoop.hbase.client.TestTableSnapshotScanner.setupCluster(TestTableSnapshotScanner.java:59) at org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testScanner(TestTableSnapshotScanner.java:129) at org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithOfflineHBaseMultiRegion(TestTableSnapshotScanner.java:124) Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 274.017 sec <<< FAILURE! - in org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient testCloneLinksAfterDelete(org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient) Time elapsed: 45.599 sec <<< ERROR! java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: Unable to close file because the last block does not have enough number of replicas. at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) at org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45) at org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4728) at org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4686) at org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4619) at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:681) at org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1482) at org.apache.hadoop.hbase.snapshot.SnapshotTestingUtils.createTable(SnapshotTestingUtils.java:750) at org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient.setup(TestCloneSnapshotFromClient.java:98) Caused by: org.apache.hadoop.ipc.RemoteException: java.util.concurrent.ExecutionException: java.io.IOException: Unable to close file because the last block does not have enough number of replicas. at org.apache.hadoop.hbase.util.ModifyRegionUtils.createRegions(ModifyRegionUtils.java:186) at org.apache.hadoop.hbase.util.ModifyRegionUtils.createRegions(ModifyRegionUtils.java:141) at org.apache.hadoop.hbase.util.ModifyRegionUtils.createRegions(ModifyRegionUtils.java:118) at org.apache.hadoop.hbase.master.procedure.CreateTableProcedure$3.createHdfsRegions(CreateTableProcedure.java:368) at org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.createFsLayout(CreateTableProcedure.java:387) at org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.createFsLayout(CreateTableProcedure.java:361) at org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:119) at org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59) at org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139) at org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1067) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:855) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:808) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:74) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:476) Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 367.613 sec - in org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient Results : Tests in error: TestFromClientSideNoCodec.setUpBeforeClass:50 » OutOfMemory unable to create n... TestHTableMultiplexerFlushCache.setUpBeforeClass:63 » OutOfMemory unable to cr... TestSizeFailures.setUpBeforeClass:95 » Runtime java.lang.OutOfMemoryError: una... org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithMultiRegion(org.apache.hadoop.hbase.client.TestTableSnapshotScanner) Run 1: TestTableSnapshotScanner.testWithMultiRegion » Remote java.lang.OutOfMemoryErr... Run 2: TestTableSnapshotScanner.testWithMultiRegion:119->testScanner:129->setupCluster:59 » OutOfMemory Run 3: TestTableSnapshotScanner.testWithMultiRegion:119->testScanner:129->setupCluster:59 » OutOfMemory org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithOfflineHBaseMultiRegion(org.apache.hadoop.hbase.client.TestTableSnapshotScanner) Run 1: TestTableSnapshotScanner.testWithOfflineHBaseMultiRegion:124->testScanner:129->setupCluster:59 » OutOfMemory Run 2: TestTableSnapshotScanner.testWithOfflineHBaseMultiRegion:124->testScanner:129->setupCluster:59 » OutOfMemory Run 3: TestTableSnapshotScanner.testWithOfflineHBaseMultiRegion:124->testScanner:129->setupCluster:59 » OutOfMemory org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithSingleRegion(org.apache.hadoop.hbase.client.TestTableSnapshotScanner) Run 1: TestTableSnapshotScanner.testWithSingleRegion:114->testScanner:129->setupCluster:59 » OutOfMemory Run 2: TestTableSnapshotScanner.testWithSingleRegion:114->testScanner:129->setupCluster:59 » OutOfMemory Run 3: TestTableSnapshotScanner.testWithSingleRegion:114->testScanner:129->setupCluster:59 » OutOfMemory Flaked tests: org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient.testCloneLinksAfterDelete(org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient) Run 1: TestCloneSnapshotFromClient.setup:98 » IO java.util.concurrent.ExecutionExcept... Run 2: PASS org.apache.hadoop.hbase.client.TestMetaWithReplicas.testMetaLookupThreadPoolCreated(org.apache.hadoop.hbase.client.TestMetaWithReplicas) Run 1: TestMetaWithReplicas.setup:106 NullPointer Run 2: PASS org.apache.hadoop.hbase.regionserver.TestFailedAppendAndSync.testLockupAroundBadAssignSync(org.apache.hadoop.hbase.regionserver.TestFailedAppendAndSync) Run 1: TestFailedAppendAndSync.testLockupAroundBadAssignSync:258 The regionserver should have thrown an exception Run 2: PASS org.apache.hadoop.hbase.regionserver.TestRegionServerHostname.testInvalidRegionServerHostnameAbortsServer(org.apache.hadoop.hbase.regionserver.TestRegionServerHostname) Run 1: TestRegionServerHostname.testInvalidRegionServerHostnameAbortsServer:53 » TestTimedOut Run 2: TestRegionServerHostname.testInvalidRegionServerHostnameAbortsServer:53 » IllegalState Run 3: PASS org.apache.hadoop.hbase.regionserver.TestRegionServerHostname.testRegionServerHostname(org.apache.hadoop.hbase.regionserver.TestRegionServerHostname) Run 1: TestRegionServerHostname.testRegionServerHostname:86 » IllegalState A mini-clu... Run 2: PASS org.apache.hadoop.hbase.regionserver.throttle.TestCompactionWithThroughputController.testCompaction(org.apache.hadoop.hbase.regionserver.throttle.TestCompactionWithThroughputController) Run 1: TestCompactionWithThroughputController.testCompaction:168->testCompactionWithThroughputLimit:136 null Run 2: PASS org.apache.hadoop.hbase.regionserver.throttle.TestFlushWithThroughputController.testFlushControl(org.apache.hadoop.hbase.regionserver.throttle.TestFlushWithThroughputController) Run 1: TestFlushWithThroughputController.testFlushControl:144->testFlushWithThroughputLimit:117 null Run 2: PASS org.apache.hadoop.hbase.regionserver.throttle.TestFlushWithThroughputController.testFlushControlForStripedStore(org.apache.hadoop.hbase.regionserver.throttle.TestFlushWithThroughputController) Run 1: TestFlushWithThroughputController.testFlushControlForStripedStore:218->testFlushControl:144->testFlushWithThroughputLimit:117 null Run 2: TestFlushWithThroughputController.testFlushControlForStripedStore:218->testFlushControl:144->testFlushWithThroughputLimit:117 null Run 3: PASS Tests run: 1908, Failures: 0, Errors: 6, Skipped: 25, Flakes: 8 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache HBase ...................................... SUCCESS [1:46.547s] [INFO] Apache HBase - Checkstyle ......................... SUCCESS [9.656s] [INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.331s] [INFO] Apache HBase - Annotations ........................ SUCCESS [2.238s] [INFO] Apache HBase - Protocol ........................... SUCCESS [30.147s] [INFO] Apache HBase - Common ............................. SUCCESS [3:49.059s] [INFO] Apache HBase - Procedure .......................... SUCCESS [4:44.571s] [INFO] Apache HBase - Client ............................. SUCCESS [2:06.982s] [INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [12.810s] [INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [18.837s] [INFO] Apache HBase - Prefix Tree ........................ SUCCESS [16.650s] [INFO] Apache HBase - Server ............................. FAILURE [2:29:22.642s] [INFO] Apache HBase - Testing Util ....................... SKIPPED [INFO] Apache HBase - Thrift ............................. SKIPPED [INFO] Apache HBase - Rest ............................... SKIPPED [INFO] Apache HBase - Shell .............................. SKIPPED [INFO] Apache HBase - Integration Tests .................. SKIPPED [INFO] Apache HBase - Examples ........................... SKIPPED [INFO] Apache HBase - External Block Cache ............... SKIPPED [INFO] Apache HBase - Assembly ........................... SKIPPED [INFO] Apache HBase - Shaded ............................. SKIPPED [INFO] Apache HBase - Shaded - Client .................... SKIPPED [INFO] Apache HBase - Shaded - Server .................... SKIPPED [INFO] Apache HBase - Archetypes ......................... SKIPPED [INFO] Apache HBase - Exemplar for hbase-client archetype SKIPPED [INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED [INFO] Apache HBase - Archetype builder .................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2:43:54.764s [INFO] Finished at: Fri Sep 23 19:12:14 UTC 2016 [INFO] Final Memory: 405M/1547M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (secondPartTestsExecution) on project hbase-server: ExecutionException: java.lang.RuntimeException: There was an error in the forked process [ERROR] java.lang.ArrayIndexOutOfBoundsException: 1 [ERROR] at org.apache.maven.surefire.common.junit4.JUnit4ProviderUtil.generateFailingTests(JUnit4ProviderUtil.java:64) [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:151) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hbase-server Build step 'Invoke top-level Maven targets' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : # Post-build task script. TODO: Check this in and have all builds reference check-in. pwd && ls # NOTE!!!! The below code has been copied and pasted from ./dev-tools/run-test.sh # Do not change here without syncing there and vice-versa. ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then echo "Suspicious java process found - waiting 30s to see if there are just slow to stop" sleep 30 ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie tests{color}, they should have been killed by surefire but survived" jps -v | grep surefirebooter | grep -e '-Dhbase.test' jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1 | xargs -n 1 jstack # Exit with error exit 1 else echo "We're ok: there is no zombie test, but some tests took some time to stop" fi else echo "We're ok: there is no zombie test" fi Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8 [yahoo-not-h2] $ /bin/bash -xe /tmp/hudson5400316151251034396.sh + pwd <https://builds.apache.org/job/HBase-1.4/jdk=JDK_1_8,label=yahoo-not-h2/ws/> + ls bin CHANGES.txt conf dev-support extra_env_var hbase-annotations hbase-archetypes hbase-assembly hbase-checkstyle hbase-client hbase-common hbase-examples hbase-external-blockcache hbase-hadoop2-compat hbase-hadoop-compat hbase-it hbase-native-client hbase-prefix-tree hbase-procedure hbase-protocol hbase-resource-bundle hbase-rest hbase-server hbase-shaded hbase-shell hbase-testing-util hbase-thrift LICENSE.txt NOTICE.txt pom.xml README.txt src target ++ jps -v ++ grep surefirebooter ++ grep -e -Dhbase.test ++ wc -l + ZOMBIE_TESTS_COUNT=0 + [[ 0 != 0 ]] + echo 'We'\''re ok: there is no zombie test' We're ok: there is no zombie test POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Archiving artifacts Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8 No prior successful build to compare, so performing full copy of artifacts Recording test results Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8 Setting JDK_1_7_LATEST__HOME=/home/jenkins/tools/java/latest1.7 Setting JDK_1_8_LATEST__HOME=/home/jenkins/tools/java/latest1.8