I used the CubeStatsReader commander, but it failed
The log are like this, can anyone help me?
bin/kylin.sh org.apache.kylin.engine.mr.common.CubeStatsReader kylin_sales_model
KYLIN_HOME is set to /opt/kylin
KYLIN_HOME is set to /opt/kylin
2017-04-01 22:11:48,703 WARN [main] mapreduce.TableMapReduceUtil: The
hbase-prefix-tree module jar containing PrefixTreeCodec is not present.
Continuing without it.
Logging initialized using configuration in
file:/etc/hive/conf.dist/hive-log4j.properties
HCAT_HOME not found, try to find hcatalog path from hadoop home
KYLIN_JVM_SETTINGS is -Xms1024M -Xmx4096M -Xss1024K -XX:MaxPermSize=128M
-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps
-Xloggc:/opt/kylin/logs/kylin.gc.10233 -XX:+UseGCLogFileRotation
-XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M
KYLIN_DEBUG_SETTINGS is not set, will not enable remote debuging
KYLIN_LD_LIBRARY_SETTINGS is not set, Usually it's okay unless you want to
specify your own native path
CubeStatsReader is used to read cube statistic saved in metadata store
2017-04-01 22:12:15,909 INFO [main KylinConfig:267]: New KylinConfig 870508748
2017-04-01 22:12:15,972 WARN [main KylinConfig:197]: KYLIN_CONF property was
not set, will seek KYLIN_HOME env variable
2017-04-01 22:12:16,001 INFO [main KylinConfig:62]: Initialized a new
KylinConfig from getInstanceFromEnv : 870508748
2017-04-01 22:12:16,157 INFO [main CubeManager:136]: Initializing CubeManager
with config kylin_metadata@hbase
2017-04-01 22:12:16,213 INFO [main ResourceStore:80]: Using metadata url
kylin_metadata@hbase for resource store
2017-04-01 22:12:17,759 INFO [main HBaseConnection:231]: connection is null or
closed, creating a new one
2017-04-01 22:12:22,268 INFO [main RecoverableZooKeeper:120]: Process
identifier=hconnection-0x2c45fe1a connecting to ZooKeeper
ensemble=localhost:2181
2017-04-01 22:12:22,332 INFO [main ZooKeeper:100]: Client
environment:zookeeper.version=3.4.5-cdh5.8.0--1, built on 06/16/2016 19:37 GMT
2017-04-01 22:12:22,333 INFO [main ZooKeeper:100]: Client
environment:host.name=quickstart.cloudera
2017-04-01 22:12:22,333 INFO [main ZooKeeper:100]: Client
environment:java.version=1.7.0_67
2017-04-01 22:12:22,333 INFO [main ZooKeeper:100]: Client
environment:java.vendor=Oracle Corporation
2017-04-01 22:12:22,334 INFO [main ZooKeeper:100]: Client
environment:java.home=/usr/java/jdk1.7.0_67-cloudera/jre
2017-04-01 22:12:22,385 INFO [main ZooKeeper:100]: Client
environment:java.library.path=/usr/lib/hadoop/lib/native:/usr/lib/hbase/bin/../lib/native/Linux-amd64-64
2017-04-01 22:12:22,386 INFO [main ZooKeeper:100]: Client
environment:java.io.tmpdir=/tmp
2017-04-01 22:12:22,386 INFO [main ZooKeeper:100]: Client
environment:java.compiler=<NA>
2017-04-01 22:12:22,476 INFO [main ZooKeeper:100]: Client
environment:os.name=Linux
2017-04-01 22:12:22,501 INFO [main ZooKeeper:100]: Client
environment:os.arch=amd64
2017-04-01 22:12:22,501 INFO [main ZooKeeper:100]: Client
environment:os.version=2.6.32-573.el6.x86_64
2017-04-01 22:12:22,517 INFO [main ZooKeeper:100]: Client
environment:user.name=root
2017-04-01 22:12:22,535 INFO [main ZooKeeper:100]: Client
environment:user.home=/root
2017-04-01 22:12:22,536 INFO [main ZooKeeper:100]: Client
environment:user.dir=/opt/apache-kylin-1.6.0-cdh5.7-bin
2017-04-01 22:12:22,537 INFO [main ZooKeeper:438]: Initiating client
connection, connectString=localhost:2181 sessionTimeout=90000
watcher=hconnection-0x2c45fe1a0x0, quorum=localhost:2181, baseZNode=/hbase
2017-04-01 22:12:22,695 INFO [main-SendThread(localhost:2181) ClientCnxn:975]:
Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt
to authenticate using SASL (unknown error)
2017-04-01 22:12:22,781 INFO [main-SendThread(localhost:2181) ClientCnxn:852]:
Socket connection established, initiating session, client: /127.0.0.1:34694,
server: localhost/127.0.0.1:2181
2017-04-01 22:12:22,914 INFO [main-SendThread(localhost:2181)
ClientCnxn:1235]: Session establishment complete on server
localhost/127.0.0.1:2181, sessionid = 0x15b2c9b0fcb0015, negotiated timeout =
40000
2017-04-01 22:13:21,857 ERROR [main ResourceStore:89]: Create new store
instance failed
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:83)
at
org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:102)
at org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:965)
at
org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:892)
at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:141)
at org.apache.kylin.cube.CubeManager.getInstance(CubeManager.java:105)
at
org.apache.kylin.engine.mr.common.CubeStatsReader.main(CubeStatsReader.java:295)
Caused by: java.lang.IllegalArgumentException: File not exist by
'kylin_metadata@hbase':
/opt/apache-kylin-1.6.0-cdh5.7-bin/kylin_metadata@hbase<mailto:/opt/apache-kylin-1.6.0-cdh5.7-bin/kylin_metadata@hbase>
at
org.apache.kylin.common.persistence.FileResourceStore.<init>(FileResourceStore.java:49)
... 11 more
2017-04-01 22:13:21,862 ERROR [main ResourceStore:89]: Create new store
instance failed
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:83)
at
org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:102)
at org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:965)
at
org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:892)
at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:141)
at org.apache.kylin.cube.CubeManager.getInstance(CubeManager.java:105)
at
org.apache.kylin.engine.mr.common.CubeStatsReader.main(CubeStatsReader.java:295)
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
after attempts=6, exceptions:
Sat Apr 01 22:13:21 PDT 2017, null, java.net.SocketTimeoutException:
callTimeout=60000, callDuration=114823: row 'kylin_metadata,,' on table
'hbase:meta' at region=hbase:meta,,1.1588230740,
hostname=quickstart.cloudera,60020,1491102188279, seqNum=0
at
org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:207)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at
org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:320)
at
org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:295)
at
org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:160)
at
org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:155)
at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:867)
at
org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:602)
at
org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)
at
org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:410)
at
org.apache.kylin.storage.hbase.HBaseConnection.tableExists(HBaseConnection.java:254)
at
org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:276)
at
org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:90)
at
org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:86)
... 11 more
Caused by: java.net.SocketTimeoutException: callTimeout=60000,
callDuration=114823: row 'kylin_metadata,,' on table 'hbase:meta' at
region=hbase:meta,,1.1588230740,
hostname=quickstart.cloudera,60020,1491102188279, seqNum=0
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159)
at
org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494)
at
org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupConnection(RpcClientImpl.java:416)
at
org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupIOstreams(RpcClientImpl.java:722)
at
org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.writeRequest(RpcClientImpl.java:906)
at
org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.tracedWriteRequest(RpcClientImpl.java:873)
at
org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1242)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:226)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:331)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:34094)
at
org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:394)
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:203)
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:64)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:360)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:334)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126)
... 4 more
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find
metadata store by url: kylin_metadata@hbase
at
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:91)
at
org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:102)
at org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:965)
at
org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:892)
at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:141)
at org.apache.kylin.cube.CubeManager.getInstance(CubeManager.java:105)
at
org.apache.kylin.engine.mr.common.CubeStatsReader.main(CubeStatsReader.java:295)
2017-04-01 22:13:21,911 INFO [Thread-0
ConnectionManager$HConnectionImplementation:1830]: Closing zookeeper
sessionid=0x15b2c9b0fcb0015
2017-04-01 22:13:21,928 INFO [Thread-0 ZooKeeper:684]: Session:
0x15b2c9b0fcb0015 closed
2017-04-01 22:13:21,929 INFO [main-EventThread ClientCnxn:512]: EventThread
shut down
