lihuaqing created PHOENIX-2420:
----------------------------------
Summary: Phoenix connnection blocked
Key: PHOENIX-2420
URL: https://issues.apache.org/jira/browse/PHOENIX-2420
Project: Phoenix
Issue Type: Bug
Reporter: lihuaqing
I use phoenix-4.5.0-HBase-0.98, hbase-0.98.12.1-hadoop2, apache hadoop2.6.0,
kerberos.
I create a lot of tables in the phoenix and load large data with bulk_dataload
(http://phoenix.apache.org/bulk_dataload.html) and excute many queries on these
data. It is ok at the begin, But run about ten days, all phoenix tables
blocked and new connection can build. This following is the log:
org.apache.hadoop.hbase.client.RpcRetryingCaller@62b1da82, java.io.IOException:
java.io.IOException: Timed out waiting for lock for row: \x00SYSTEM\x00CATALOG
at
org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:3695)
at org.apache.hadoop.hbase.regionserver.HRegion.getRowLock(HRegion.java:3656)
at org.apache.hadoop.hbase.regionserver.HRegion.getRowLock(HRegion.java:3721)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.acquireLock(MetaDataEndpointImpl.java:1275)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1162)
at
org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11619)
at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:5907)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:3464)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:3446)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:30950)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2093) at
org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at
org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at
java.lang.Thread.run(Thread.java:745) Thu Nov 12 05:43:52 CST 2015,
please help me, thanks very much!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)