[
https://issues.apache.org/jira/browse/PHOENIX-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lihuaqing updated PHOENIX-2420:
-------------------------------
Description:
I use phoenix-4.5.0-HBase-0.98, hbase-0.98.12.1-hadoop2, apache hadoop2.6.0,
kerberos.
I create a lot of tables in the phoenix and load large data with bulk_dataload
(http://phoenix.apache.org/bulk_dataload.html) and excute many queries on these
data. It is ok at the begin, But run about ten days, all phoenix tables
blocked and new connection cann't build. This following is the log:
org.apache.hadoop.hbase.client.RpcRetryingCaller@62b1da82, java.io.IOException:
java.io.IOException: Timed out waiting for lock for row: \x00SYSTEM\x00CATALOG
at
org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:3695)
at org.apache.hadoop.hbase.regionserver.HRegion.getRowLock(HRegion.java:3656)
at org.apache.hadoop.hbase.regionserver.HRegion.getRowLock(HRegion.java:3721)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.acquireLock(MetaDataEndpointImpl.java:1275)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1162)
at
org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11619)
at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:5907)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:3464)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:3446)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:30950)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2093) at
org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at
org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at
java.lang.Thread.run(Thread.java:745) Thu Nov 12 05:43:52 CST 2015,
please help me, thanks very much!
was:
I use phoenix-4.5.0-HBase-0.98, hbase-0.98.12.1-hadoop2, apache hadoop2.6.0,
kerberos.
I create a lot of tables in the phoenix and load large data with bulk_dataload
(http://phoenix.apache.org/bulk_dataload.html) and excute many queries on these
data. It is ok at the begin, But run about ten days, all phoenix tables
blocked and new connection can build. This following is the log:
org.apache.hadoop.hbase.client.RpcRetryingCaller@62b1da82, java.io.IOException:
java.io.IOException: Timed out waiting for lock for row: \x00SYSTEM\x00CATALOG
at
org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:3695)
at org.apache.hadoop.hbase.regionserver.HRegion.getRowLock(HRegion.java:3656)
at org.apache.hadoop.hbase.regionserver.HRegion.getRowLock(HRegion.java:3721)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.acquireLock(MetaDataEndpointImpl.java:1275)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1162)
at
org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11619)
at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:5907)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:3464)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:3446)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:30950)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2093) at
org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at
org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at
java.lang.Thread.run(Thread.java:745) Thu Nov 12 05:43:52 CST 2015,
please help me, thanks very much!
> Phoenix connnection blocked
> ---------------------------
>
> Key: PHOENIX-2420
> URL: https://issues.apache.org/jira/browse/PHOENIX-2420
> Project: Phoenix
> Issue Type: Bug
> Reporter: lihuaqing
>
> I use phoenix-4.5.0-HBase-0.98, hbase-0.98.12.1-hadoop2, apache hadoop2.6.0,
> kerberos.
> I create a lot of tables in the phoenix and load large data with
> bulk_dataload (http://phoenix.apache.org/bulk_dataload.html) and excute many
> queries on these data. It is ok at the begin, But run about ten days, all
> phoenix tables blocked and new connection cann't build. This following is the
> log:
> org.apache.hadoop.hbase.client.RpcRetryingCaller@62b1da82,
> java.io.IOException: java.io.IOException: Timed out waiting for lock for row:
> \x00SYSTEM\x00CATALOG at
> org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:3695)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.getRowLock(HRegion.java:3656) at
> org.apache.hadoop.hbase.regionserver.HRegion.getRowLock(HRegion.java:3721) at
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.acquireLock(MetaDataEndpointImpl.java:1275)
> at
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1162)
> at
> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11619)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:5907)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execServiceOnRegion(HRegionServer.java:3464)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execService(HRegionServer.java:3446)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:30950)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2093) at
> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at
> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at
> java.lang.Thread.run(Thread.java:745) Thu Nov 12 05:43:52 CST 2015,
> please help me, thanks very much!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
