maybe the time different between regionserver and Kylie host cause this problem
| | yuzhang | | Email:[email protected] | Signature is customized by Netease Mail Master On 04/19/2019 09:53, JiaTao Tao wrote: Hi You can adjust "kylin.metadata.hbase-rpc-timeout" to a larger value. And then run metadata/StorageCleanup, It will reduce the data in Hbase. -- Regards! Aron Tao 蒋慧明 <[email protected]> 于2019年4月18日周四 下午2:35写道： Hi, I met below error when I run cube in Kylin. It happened in the "#4 Step Name: Build Dimension Dictionary" | Tue Apr 16 14:18:06 GMT+08:00 2019, RpcRetryingCaller{globalStartTime=1555395481041, pause=100, retries=1}, java.io.IOException: Call to [HBASE URL] failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=15589, waitTime=5001, operationTimeout=5000 expired. at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65) ... 3 more Caused by: java.io.IOException: Call to ip-10-10-110-102.cn-north-1.compute.internal/10.10.110.102:16020 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=15589, waitTime=5001, operationTimeout=5000 expired. at org.apache.hadoop.hbase.ipc.AbstractRpcClient.wrapException(AbstractRpcClient.java:292) at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1274) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:35396) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:224) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:65) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:212) | The normal dimension of this cube is about 25. Then I created a new cube with 3 normal dimensions and run it. The job is successful. When I tried to do metadata backup and metadata clean wich cmd "metastore.sh", I also met the error: "org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=15589, waitTime=5001, operationTimeout=5000 expired". Does anyone know about the root cause of this problem? And how to fix it? Thanks a lot! | |
