I have some good news. I have rebuilt the current Kylin Master1.2 against
CDH5.5.3. I had to bring some of 1.1.3 branch changes dealing with Cloudera
API around additional methods for RegionScanner interface.
Also, I had exclude some HBase (server) dependencies in the pom and upgrade
curator binaries. Compiles/Builds ok, server starts ok, kylin sample cube
build and query works fine. I did apply this to our ongoing POC with over
1B rows. Build and most queries work. However, there is one query against
time dimension (which had reported to Luke directly due to sensitive nature)
and that is throwing a new error. Earlier it was AbstractMethod error
related to getBatch interface of Scanner that is now fixed due to binary
compatibility with CDH5.5.2.
But now, it fails with
Caused by:
org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.AbstractMethodError
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at
org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AbstractMethodError
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
... 4 more
at
org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1219)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651)
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:213)
I have remote debugged it. Here is the stack
<http://apache-kylin.74782.x6.nabble.com/file/n3745/Debugger_stack.png>
Similar query (See bel0w) on the sample cube works great.
//this works
SELECT SUM(PRICE) FROM KYLIN_SALES
WHERE PART_DT=DATE'2012-01-01'
//this does not (1B rows in fact table)
SELECT
CURRENCY
,SUM(TXN_AMT) TOT_USD_TXN_AMT
FROM TXN_FCT_ORC as TXN_FCT_ORC
INNER JOIN DIM_ORC as DT_DIM_ORC
ON BOOK_DT_KEY = DT_DIM_ORC.DT_KEY
INNER JOIN CCY_DIM_ORC as CCY_DIM_ORC
ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_DIM_ORC.CCY_KEY
WHERE DT_DIM_ORC.DT_KEY=date'2015-03-03'
GROUP BY
CCY_DIM_ORC.CCY_NM, DT_DIM_ORC.CDR_YR
ORDER BY TOT_USD_TXN_AMT DESC
--
View this message in context:
http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3745.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
