while using EMR and autoscaling during multiple cube builds.

Some builds intermittently fail with the following exception and halt that
cube build.  Typically restarting the build completes successfully.

---------------

5d388edae3b13f9f1d6a709720cc5378. is closing

at
org.apache.hadoop.hbase.regionserver.HRegion.startRegionOperation(HRegion.java:8612)

at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2772)

at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:7364)

at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:7323)

at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:7316)

at
org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2263)

at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:36609)

at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2354)

at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:124)

at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:297)

at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:277)


at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:386)

at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:94)

at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:409)

at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:405)

at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103)

at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118)

at
org.apache.hadoop.hbase.ipc.BlockingRpcConnection.readResponse(BlockingRpcConnection.java:600)

at
org.apache.hadoop.hbase.ipc.BlockingRpcConnection.run(BlockingRpcConnection.java:334)

... 1 more

-----------------


  Anyone run into this and know the cause?  I'm assuming because of the
autoscaling the region START/END change as the cluster grows shrinks in
turn this may change where the metadata table is hosted...

Also a ticket for moving metadata off of hbase here:
https://issues.apache.org/jira/browse/KYLIN-3488

Thanks

Reply via email to