[
https://issues.apache.org/jira/browse/HBASE-14846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Kyle Purtell resolved HBASE-14846.
-----------------------------------------
Resolution: Incomplete
> IT test suite fails when run standalone: "mvn -Dtest=NoUnitTests package
> verify"
> --------------------------------------------------------------------------------
>
> Key: HBASE-14846
> URL: https://issues.apache.org/jira/browse/HBASE-14846
> Project: HBase
> Issue Type: Umbrella
> Reporter: Michael Stack
> Priority: Major
>
> Seeing how IT tests fail sometimes up on apache builds, I tried running them
> locally.
> Most fail. See below. Some fail because they use too much resource. See
> HBASE-14819 where a test was using > 2k threads when run standalone (mac os x
> has limit of 2031 according to
> https://plumbr.eu/outofmemoryerror/unable-to-create-new-native-thread). Up on
> apache build, some are OOME'ing.
> {code}
> -------------------------------------------------------
> T E S T S
> -------------------------------------------------------
> Running org.apache.hadoop.hbase.IntegrationTestAcidGuarantees
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 559.189 sec -
> in org.apache.hadoop.hbase.IntegrationTestAcidGuarantees
> Running org.apache.hadoop.hbase.IntegrationTestDDLMasterFailover
> Running org.apache.hadoop.hbase.IntegrationTestIngest
> Running org.apache.hadoop.hbase.IntegrationTestIngestStripeCompactions
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 677.357 sec -
> in org.apache.hadoop.hbase.IntegrationTestIngestStripeCompactions
> Running org.apache.hadoop.hbase.IntegrationTestIngestWithACL
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 220.775 sec
> <<< FAILURE! - in org.apache.hadoop.hbase.IntegrationTestIngestWithACL
> testIngest(org.apache.hadoop.hbase.IntegrationTestIngestWithACL) Time
> elapsed: 220.26 sec <<< ERROR!
> java.io.IOException: Shutting down
> at
> org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:225)
> at
> org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:448)
> at
> org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:225)
> at
> org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:94)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1077)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1036)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:908)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:890)
> at
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:877)
> at
> org.apache.hadoop.hbase.IntegrationTestingUtility.initializeCluster(IntegrationTestingUtility.java:78)
> at
> org.apache.hadoop.hbase.IntegrationTestIngest.setUpCluster(IntegrationTestIngest.java:84)
> at
> org.apache.hadoop.hbase.IntegrationTestIngestWithACL.setUpCluster(IntegrationTestIngestWithACL.java:64)
> Running org.apache.hadoop.hbase.IntegrationTestIngestWithEncryption
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 720.259 sec -
> in org.apache.hadoop.hbase.IntegrationTestIngestWithEncryption
> Running org.apache.hadoop.hbase.IntegrationTestIngestWithMOB
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1,206.761 sec
> <<< FAILURE! - in org.apache.hadoop.hbase.IntegrationTestIngestWithMOB
> testIngest(org.apache.hadoop.hbase.IntegrationTestIngestWithMOB) Time
> elapsed: 1,206.212 sec <<< ERROR!
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
> attempts=36, exceptions:
> Wed Nov 18 19:29:47 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:30:04 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:30:21 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:30:39 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:30:56 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:31:15 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:31:36 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:32:02 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:32:29 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:32:55 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:33:22 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:33:59 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:34:36 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:35:14 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:35:51 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:36:28 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:37:05 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:37:42 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:38:19 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:38:56 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:39:34 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:40:11 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:40:48 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:41:25 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:42:02 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:42:40 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:43:17 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:43:54 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:44:31 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:45:08 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:45:45 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:46:23 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:47:00 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:47:37 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:48:14 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> Wed Nov 18 19:48:51 PST 2015,
> RpcRetryingCaller{globalStartTime=1447903770109, pause=100, maxAttempts=36},
> org.apache.hadoop.hbase.MasterNotRunningException:
> org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
> ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
> at
> org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:221)
> at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:539)
> at
> org.apache.hadoop.hbase.client.ConnectionImplementation.checkIfBaseNodeAvailable(ConnectionImplementation.java:524)
> at
> org.apache.hadoop.hbase.client.ConnectionImplementation.access$2(ConnectionImplementation.java:520)
> at
> org.apache.hadoop.hbase.client.ConnectionImplementation$StubMaker.makeStubNoRetries(ConnectionImplementation.java:1208)
> at
> org.apache.hadoop.hbase.client.ConnectionImplementation$StubMaker.makeStub(ConnectionImplementation.java:1250)
> at
> org.apache.hadoop.hbase.client.ConnectionImplementation$MasterServiceStubMaker.makeStub(ConnectionImplementation.java:1279)
> at
> org.apache.hadoop.hbase.client.ConnectionImplementation.getKeepAliveMasterService(ConnectionImplementation.java:1436)
> at
> org.apache.hadoop.hbase.client.MasterCallable.prepare(MasterCallable.java:38)
> at
> org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:116)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3937)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:511)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:503)
> at
> org.apache.hadoop.hbase.IntegrationTestIngestWithMOB.initTable(IntegrationTestIngestWithMOB.java:117)
> Running org.apache.hadoop.hbase.IntegrationTestIngestWithTags
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 792.584 sec -
> in org.apache.hadoop.hbase.IntegrationTestIngestWithTags
> Running org.apache.hadoop.hbase.IntegrationTestIngestWithVisibilityLabels
> Running org.apache.hadoop.hbase.IntegrationTestLazyCfLoading
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 152.914 sec -
> in org.apache.hadoop.hbase.IntegrationTestLazyCfLoading
> Running org.apache.hadoop.hbase.IntegrationTestManyRegions
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.204 sec -
> in org.apache.hadoop.hbase.IntegrationTestManyRegions
> Running org.apache.hadoop.hbase.IntegrationTestMetaReplicas
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.39 sec -
> in org.apache.hadoop.hbase.IntegrationTestMetaReplicas
> Running org.apache.hadoop.hbase.IntegrationTestRegionReplicaReplication
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 284.393 sec
> <<< FAILURE! - in
> org.apache.hadoop.hbase.IntegrationTestRegionReplicaReplication
> testIngest(org.apache.hadoop.hbase.IntegrationTestRegionReplicaReplication)
> Time elapsed: 283.841 sec <<< FAILURE!
> java.lang.AssertionError: Load failed with error code 1
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.hadoop.hbase.IntegrationTestRegionReplicaReplication.runIngestTest(IntegrationTestRegionReplicaReplication.java:197)
> at
> org.apache.hadoop.hbase.IntegrationTestRegionReplicaReplication.testIngest(IntegrationTestRegionReplicaReplication.java:112)
> Running org.apache.hadoop.hbase.ipc.IntegrationTestRpcClient
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 318.491 sec -
> in org.apache.hadoop.hbase.ipc.IntegrationTestRpcClient
> Running org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 339.821 sec
> <<< FAILURE! - in org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad
> testBulkLoad(org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad) Time
> elapsed: 339.719 sec <<< FAILURE!
> java.lang.AssertionError: expected:<true> but was:<false>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:834)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:144)
> at
> org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad.runCheck(IntegrationTestBulkLoad.java:719)
> at
> org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad.testBulkLoad(IntegrationTestBulkLoad.java:217)
> Running org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 94.827 sec -
> in org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv
> Running org.apache.hadoop.hbase.mapreduce.IntegrationTestTableMapReduceUtil
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.558 sec -
> in org.apache.hadoop.hbase.mapreduce.IntegrationTestTableMapReduceUtil
> Running org.apache.hadoop.hbase.mttr.IntegrationTestMTTR
> Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1,671.08 sec
> <<< FAILURE! - in org.apache.hadoop.hbase.mttr.IntegrationTestMTTR
> testRestartRsHoldingTable(org.apache.hadoop.hbase.mttr.IntegrationTestMTTR)
> Time elapsed: 120.697 sec <<< ERROR!
> java.util.concurrent.ExecutionException: java.io.IOException: did timeout
> 60000ms waiting for region server to start: localhost
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at
> org.apache.hadoop.hbase.mttr.IntegrationTestMTTR.run(IntegrationTestMTTR.java:318)
> at
> org.apache.hadoop.hbase.mttr.IntegrationTestMTTR.testRestartRsHoldingTable(IntegrationTestMTTR.java:272)
> Caused by: java.io.IOException: did timeout 60000ms waiting for region server
> to start: localhost
> at
> org.apache.hadoop.hbase.HBaseCluster.waitForRegionServerToStart(HBaseCluster.java:154)
> at org.apache.hadoop.hbase.chaos.actions.Action.startRs(Action.java:157)
> at
> org.apache.hadoop.hbase.chaos.actions.RestartActionBaseAction.restartRs(RestartActionBaseAction.java:61)
> at
> org.apache.hadoop.hbase.chaos.actions.RestartRsHoldingTableAction.perform(RestartRsHoldingTableAction.java:44)
> at
> org.apache.hadoop.hbase.mttr.IntegrationTestMTTR$ActionCallable.call(IntegrationTestMTTR.java:586)
> at
> org.apache.hadoop.hbase.mttr.IntegrationTestMTTR$ActionCallable.call(IntegrationTestMTTR.java:577)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Running org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 319.675 sec -
> in org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList
> Running
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 280.915 sec
> <<< FAILURE! - in
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility
> testContinuousIngest(org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility)
> Time elapsed: 280.805 sec <<< ERROR!
> java.lang.RuntimeException: Verify.verify failed
> at
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop.verify(IntegrationTestBigLinkedListWithVisibility.java:575)
> at
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop.runVerify(IntegrationTestBigLinkedListWithVisibility.java:517)
> at
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop.run(IntegrationTestBigLinkedListWithVisibility.java:618)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility.testContinuousIngest(IntegrationTestBigLinkedListWithVisibility.java:638)
> Running org.apache.hadoop.hbase.test.IntegrationTestLoadAndVerify
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 343.291 sec -
> in org.apache.hadoop.hbase.test.IntegrationTestLoadAndVerify
> Running org.apache.hadoop.hbase.test.IntegrationTestReplication
> Running
> org.apache.hadoop.hbase.test.IntegrationTestTimeBoundedMultiGetRequestsWithRegionReplicas
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 636.687 sec -
> in
> org.apache.hadoop.hbase.test.IntegrationTestTimeBoundedMultiGetRequestsWithRegionReplicas
> Running
> org.apache.hadoop.hbase.test.IntegrationTestTimeBoundedRequestsWithRegionReplicas
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1,271.384 sec
> <<< FAILURE! - in
> org.apache.hadoop.hbase.test.IntegrationTestTimeBoundedRequestsWithRegionReplicas
> testIngest(org.apache.hadoop.hbase.test.IntegrationTestTimeBoundedRequestsWithRegionReplicas)
> Time elapsed: 1,270.886 sec <<< FAILURE!
> java.lang.AssertionError: Verification failed with error code 1
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.hadoop.hbase.test.IntegrationTestTimeBoundedRequestsWithRegionReplicas.runIngestTest(IntegrationTestTimeBoundedRequestsWithRegionReplicas.java:215)
> Running
> org.apache.hadoop.hbase.test.IntegrationTestWithCellVisibilityLoadAndVerify
> Running org.apache.hadoop.hbase.trace.IntegrationTestSendTraceRequests
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 120.366 sec -
> in org.apache.hadoop.hbase.trace.IntegrationTestSendTraceRequests
> Results :
> Failed tests:
> IntegrationTestRegionReplicaReplication.testIngest:112->runIngestTest:197
> Load failed with error code 1
> IntegrationTestBulkLoad.testBulkLoad:217->runCheck:719 expected:<true> but
> was:<false>
>
> IntegrationTestTimeBoundedRequestsWithRegionReplicas>IntegrationTestIngest.testIngest:112->runIngestTest:215
> Verification failed with error code 1
> Tests in error:
>
> IntegrationTestIngestWithACL>IntegrationTestBase.setUp:133->setUpCluster:64->IntegrationTestIngest.setUpCluster:84
> » IO
>
> IntegrationTestIngestWithMOB>IntegrationTestBase.setUp:133->IntegrationTestIngest.setUpCluster:92->initTable:117
> » RetriesExhausted
> IntegrationTestMTTR.testRestartRsHoldingTable:272->run:318 » Execution
> java.io...
> IntegrationTestBigLinkedListWithVisibility.testContinuousIngest:638 »
> Runtime ...
> Tests run: 28, Failures: 3, Errors: 4, Skipped: 2
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
