[
https://issues.apache.org/jira/browse/HBASE-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306238#comment-14306238
]
Ted Yu commented on HBASE-12966:
--------------------------------
Running TestEnableTableHandler (after removing MasterTests) on branch-1, I got:
{code}
testEnableTableWithNoRegionServers(org.apache.hadoop.hbase.master.handler.TestEnableTableHandler)
Time elapsed: 68.679 sec <<< ERROR!
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
attempts=351, exceptions:
Wed Feb 04 15:43:16 PST 2015, null, java.net.SocketTimeoutException:
callTimeout=60000, callDuration=60669: row
'testEnableTableWithNoRegionServers,,' on table 'hbase:meta' at
region=hbase:meta,,1.1588230740, hostname=10.11.3.249,53624,1423093331967,
seqNum=0
at
org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:271)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:207)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:61)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at
org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:297)
at
org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:272)
at
org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:144)
at
org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:139)
at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:801)
at
org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:601)
at
org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:365)
at
org.apache.hadoop.hbase.master.handler.EnableTableHandler.prepare(EnableTableHandler.java:95)
at
org.apache.hadoop.hbase.master.handler.TestEnableTableHandler.testEnableTableWithNoRegionServers(TestEnableTableHandler.java:86)
Caused by: java.net.SocketTimeoutException: callTimeout=60000,
callDuration=60669: row 'testEnableTableWithNoRegionServers,,' on table
'hbase:meta' at region=hbase:meta,,1.1588230740,
hostname=10.11.3.249,53624,1423093331967, seqNum=0
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159)
at
org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:64)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Can't get
the locations
at
org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:312)
at
org.apache.hadoop.hbase.client.ScannerCallable.prepare(ScannerCallable.java:141)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCallableWithReplicas.java:337)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:124)
at
org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:64)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{code}
Can you double check ?
> NPE in HMaster while recovering tables in Enabling state
> --------------------------------------------------------
>
> Key: HBASE-12966
> URL: https://issues.apache.org/jira/browse/HBASE-12966
> Project: HBase
> Issue Type: Bug
> Components: master
> Reporter: ramkrishna.s.vasudevan
> Assignee: Andrey Stepachev
> Fix For: 2.0.0
>
> Attachments: HBASE-12966-branch-1.patch, HBASE-12966-branch-1.patch,
> HBASE-12966.patch, HBASE-12966.patch, HBASE-12966.patch, HBASE-12966.patch
>
>
> {code}
> java.lang.NullPointerException
> at
> org.apache.hadoop.hbase.master.handler.EnableTableHandler.handleEnableTable(EnableTableHandler.java:210)
> at
> org.apache.hadoop.hbase.master.handler.EnableTableHandler.process(EnableTableHandler.java:142)
> at
> org.apache.hadoop.hbase.master.AssignmentManager.recoverTableInEnablingState(AssignmentManager.java:1695)
> at
> org.apache.hadoop.hbase.master.AssignmentManager.joinCluster(AssignmentManager.java:416)
> at
> org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:720)
> at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:170)
> at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1459)
> at java.lang.Thread.run(Thread.java:745)
> 2015-02-04 16:11:45,932 FATAL [stobdtserver3:16040.activeMasterManager]
> master.HMaster: Master server abort: loaded coprocessors are:
> [org.apache.hadoop.hbor.MultiRowMutationEndpoint]
> 2015-02-04 16:11:45,933 FATAL [stobdtserver3:16040.activeMasterManager]
> master.HMaster: Unhandled exception. Starting shutdown.
> java.lang.NullPointerException
> at
> org.apache.hadoop.hbase.master.handler.EnableTableHandler.handleEnableTable(EnableTableHandler.java:210)
> at
> org.apache.hadoop.hbase.master.handler.EnableTableHandler.process(EnableTableHandler.java:142)
> at
> org.apache.hadoop.hbase.master.AssignmentManager.recoverTableInEnablingState(AssignmentManager.java:1695)
> at
> org.apache.hadoop.hbase.master.AssignmentManager.joinCluster(AssignmentManager.java:416)
> at
> org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:720)
> at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:170)
> at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1459)
> at java.lang.Thread.run(Thread.java:745)
> {code}
> A table was trying to recover from ENABLING state and the master got the
> above exception. Note that the set up was 2 master with 1 RS (total 3
> machines).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
