It fails to connect hbase -- Caused by: java.net.ConnectException: Connection refused
On Sun, Apr 2, 2017 at 2:24 PM, Yang Hui <[email protected]> wrote: > I used the CubeStatsReader commander, but it failed > The log are like this, can anyone help me? > > bin/kylin.sh org.apache.kylin.engine.mr.common.CubeStatsReader > kylin_sales_model > KYLIN_HOME is set to /opt/kylin > KYLIN_HOME is set to /opt/kylin > 2017-04-01 22:11:48,703 WARN [main] mapreduce.TableMapReduceUtil: The > hbase-prefix-tree module jar containing PrefixTreeCodec is not present. > Continuing without it. > > Logging initialized using configuration in file:/etc/hive/conf.dist/hive- > log4j.properties > HCAT_HOME not found, try to find hcatalog path from hadoop home > KYLIN_JVM_SETTINGS is -Xms1024M -Xmx4096M -Xss1024K -XX:MaxPermSize=128M > -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps > -Xloggc:/opt/kylin/logs/kylin.gc.10233 -XX:+UseGCLogFileRotation > -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M > KYLIN_DEBUG_SETTINGS is not set, will not enable remote debuging > KYLIN_LD_LIBRARY_SETTINGS is not set, Usually it's okay unless you want to > specify your own native path > CubeStatsReader is used to read cube statistic saved in metadata store > 2017-04-01 22:12:15,909 INFO [main KylinConfig:267]: New KylinConfig > 870508748 > 2017-04-01 22:12:15,972 WARN [main KylinConfig:197]: KYLIN_CONF property > was not set, will seek KYLIN_HOME env variable > 2017-04-01 22:12:16,001 INFO [main KylinConfig:62]: Initialized a new > KylinConfig from getInstanceFromEnv : 870508748 > 2017-04-01 22:12:16,157 INFO [main CubeManager:136]: Initializing > CubeManager with config kylin_metadata@hbase > 2017-04-01 22:12:16,213 INFO [main ResourceStore:80]: Using metadata url > kylin_metadata@hbase for resource store > 2017-04-01 22:12:17,759 INFO [main HBaseConnection:231]: connection is > null or closed, creating a new one > 2017-04-01 22:12:22,268 INFO [main RecoverableZooKeeper:120]: Process > identifier=hconnection-0x2c45fe1a connecting to ZooKeeper > ensemble=localhost:2181 > 2017-04-01 22:12:22,332 INFO [main ZooKeeper:100]: Client > environment:zookeeper.version=3.4.5-cdh5.8.0--1, built on 06/16/2016 > 19:37 GMT > 2017-04-01 22:12:22,333 INFO [main ZooKeeper:100]: Client environment: > host.name=quickstart.cloudera > 2017-04-01 22:12:22,333 INFO [main ZooKeeper:100]: Client > environment:java.version=1.7.0_67 > 2017-04-01 22:12:22,333 INFO [main ZooKeeper:100]: Client > environment:java.vendor=Oracle Corporation > 2017-04-01 22:12:22,334 INFO [main ZooKeeper:100]: Client > environment:java.home=/usr/java/jdk1.7.0_67-cloudera/jre > 2017-04-01 22:12:22,385 INFO [main ZooKeeper:100]: Client > environment:java.library.path=/usr/lib/hadoop/lib/native:/ > usr/lib/hbase/bin/../lib/native/Linux-amd64-64 > 2017-04-01 22:12:22,386 INFO [main ZooKeeper:100]: Client > environment:java.io.tmpdir=/tmp > 2017-04-01 22:12:22,386 INFO [main ZooKeeper:100]: Client > environment:java.compiler=<NA> > 2017-04-01 22:12:22,476 INFO [main ZooKeeper:100]: Client environment: > os.name=Linux > 2017-04-01 22:12:22,501 INFO [main ZooKeeper:100]: Client > environment:os.arch=amd64 > 2017-04-01 22:12:22,501 INFO [main ZooKeeper:100]: Client > environment:os.version=2.6.32-573.el6.x86_64 > 2017-04-01 22:12:22,517 INFO [main ZooKeeper:100]: Client environment: > user.name=root > 2017-04-01 22:12:22,535 INFO [main ZooKeeper:100]: Client > environment:user.home=/root > 2017-04-01 22:12:22,536 INFO [main ZooKeeper:100]: Client > environment:user.dir=/opt/apache-kylin-1.6.0-cdh5.7-bin > 2017-04-01 22:12:22,537 INFO [main ZooKeeper:438]: Initiating client > connection, connectString=localhost:2181 sessionTimeout=90000 > watcher=hconnection-0x2c45fe1a0x0, quorum=localhost:2181, baseZNode=/hbase > 2017-04-01 22:12:22,695 INFO [main-SendThread(localhost:2181) > ClientCnxn:975]: Opening socket connection to server localhost/ > 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown > error) > 2017-04-01 22:12:22,781 INFO [main-SendThread(localhost:2181) > ClientCnxn:852]: Socket connection established, initiating session, client: > /127.0.0.1:34694, server: localhost/127.0.0.1:2181 > 2017-04-01 22:12:22,914 INFO [main-SendThread(localhost:2181) > ClientCnxn:1235]: Session establishment complete on server localhost/ > 127.0.0.1:2181, sessionid = 0x15b2c9b0fcb0015, negotiated timeout = 40000 > 2017-04-01 22:13:21,857 ERROR [main ResourceStore:89]: Create new store > instance failed > java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at sun.reflect.NativeConstructorAccessorImpl.newInstance( > NativeConstructorAccessorImpl.java:57) > at sun.reflect.DelegatingConstructorAccessorImpl.newInstance( > DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java: > 526) > at org.apache.kylin.common.persistence.ResourceStore. > createResourceStore(ResourceStore.java:83) > at org.apache.kylin.common.persistence.ResourceStore. > getStore(ResourceStore.java:102) > at org.apache.kylin.cube.CubeManager.getStore( > CubeManager.java:965) > at org.apache.kylin.cube.CubeManager.loadAllCubeInstance( > CubeManager.java:892) > at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:141) > at org.apache.kylin.cube.CubeManager.getInstance( > CubeManager.java:105) > at org.apache.kylin.engine.mr.common.CubeStatsReader.main( > CubeStatsReader.java:295) > Caused by: java.lang.IllegalArgumentException: File not exist by > 'kylin_metadata@hbase': /opt/apache-kylin-1.6.0-cdh5. > 7-bin/kylin_metadata@hbase<mailto:/opt/apache-kylin-1.6. > 0-cdh5.7-bin/kylin_metadata@hbase> > at org.apache.kylin.common.persistence.FileResourceStore. > <init>(FileResourceStore.java:49) > ... 11 more > 2017-04-01 22:13:21,862 ERROR [main ResourceStore:89]: Create new store > instance failed > java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at sun.reflect.NativeConstructorAccessorImpl.newInstance( > NativeConstructorAccessorImpl.java:57) > at sun.reflect.DelegatingConstructorAccessorImpl.newInstance( > DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java: > 526) > at org.apache.kylin.common.persistence.ResourceStore. > createResourceStore(ResourceStore.java:83) > at org.apache.kylin.common.persistence.ResourceStore. > getStore(ResourceStore.java:102) > at org.apache.kylin.cube.CubeManager.getStore( > CubeManager.java:965) > at org.apache.kylin.cube.CubeManager.loadAllCubeInstance( > CubeManager.java:892) > at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:141) > at org.apache.kylin.cube.CubeManager.getInstance( > CubeManager.java:105) > at org.apache.kylin.engine.mr.common.CubeStatsReader.main( > CubeStatsReader.java:295) > Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: > Failed after attempts=6, exceptions: > Sat Apr 01 22:13:21 PDT 2017, null, java.net.SocketTimeoutException: > callTimeout=60000, callDuration=114823: row 'kylin_metadata,,' on table > 'hbase:meta' at region=hbase:meta,,1.1588230740, > hostname=quickstart.cloudera,60020,1491102188279, seqNum=0 > > at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadRepli > cas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276) > at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas. > call(ScannerCallableWithReplicas.java:207) > at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas. > call(ScannerCallableWithReplicas.java:60) > at org.apache.hadoop.hbase.client.RpcRetryingCaller. > callWithoutRetries(RpcRetryingCaller.java:200) > at org.apache.hadoop.hbase.client.ClientScanner.call( > ClientScanner.java:320) > at org.apache.hadoop.hbase.client.ClientScanner. > nextScanner(ClientScanner.java:295) > at org.apache.hadoop.hbase.client.ClientScanner. > initializeScannerInConstruction(ClientScanner.java:160) > at org.apache.hadoop.hbase.client.ClientScanner.<init>( > ClientScanner.java:155) > at org.apache.hadoop.hbase.client.HTable.getScanner( > HTable.java:867) > at org.apache.hadoop.hbase.MetaTableAccessor.fullScan( > MetaTableAccessor.java:602) > at org.apache.hadoop.hbase.MetaTableAccessor.tableExists( > MetaTableAccessor.java:366) > at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists( > HBaseAdmin.java:410) > at org.apache.kylin.storage.hbase.HBaseConnection. > tableExists(HBaseConnection.java:254) > at org.apache.kylin.storage.hbase.HBaseConnection. > createHTableIfNeeded(HBaseConnection.java:276) > at org.apache.kylin.storage.hbase.HBaseResourceStore. > createHTableIfNeeded(HBaseResourceStore.java:90) > at org.apache.kylin.storage.hbase.HBaseResourceStore.< > init>(HBaseResourceStore.java:86) > ... 11 more > Caused by: java.net.SocketTimeoutException: callTimeout=60000, > callDuration=114823: row 'kylin_metadata,,' on table 'hbase:meta' at > region=hbase:meta,,1.1588230740, > hostname=quickstart.cloudera,60020,1491102188279, > seqNum=0 > at org.apache.hadoop.hbase.client.RpcRetryingCaller. > callWithRetries(RpcRetryingCaller.java:159) > at org.apache.hadoop.hbase.client.ResultBoundedCompletionService > $QueueingFuture.run(ResultBoundedCompletionService.java:65) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect( > SocketChannelImpl.java:739) > at org.apache.hadoop.net.SocketIOWithTimeout.connect( > SocketIOWithTimeout.java:206) > at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530) > at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494) > at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection. > setupConnection(RpcClientImpl.java:416) > at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection. > setupIOstreams(RpcClientImpl.java:722) > at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection. > writeRequest(RpcClientImpl.java:906) > at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection. > tracedWriteRequest(RpcClientImpl.java:873) > at org.apache.hadoop.hbase.ipc.RpcClientImpl.call( > RpcClientImpl.java:1242) > at org.apache.hadoop.hbase.ipc.AbstractRpcClient. > callBlockingMethod(AbstractRpcClient.java:226) > at org.apache.hadoop.hbase.ipc.AbstractRpcClient$ > BlockingRpcChannelImplementation.callBlockingMethod( > AbstractRpcClient.java:331) > at org.apache.hadoop.hbase.protobuf.generated. > ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:34094) > at org.apache.hadoop.hbase.client.ScannerCallable. > openScanner(ScannerCallable.java:394) > at org.apache.hadoop.hbase.client.ScannerCallable.call( > ScannerCallable.java:203) > at org.apache.hadoop.hbase.client.ScannerCallable.call( > ScannerCallable.java:64) > at org.apache.hadoop.hbase.client.RpcRetryingCaller. > callWithoutRetries(RpcRetryingCaller.java:200) > at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$ > RetryingRPC.call(ScannerCallableWithReplicas.java:360) > at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$ > RetryingRPC.call(ScannerCallableWithReplicas.java:334) > at org.apache.hadoop.hbase.client.RpcRetryingCaller. > callWithRetries(RpcRetryingCaller.java:126) > ... 4 more > Exception in thread "main" java.lang.IllegalArgumentException: Failed to > find metadata store by url: kylin_metadata@hbase > at org.apache.kylin.common.persistence.ResourceStore. > createResourceStore(ResourceStore.java:91) > at org.apache.kylin.common.persistence.ResourceStore. > getStore(ResourceStore.java:102) > at org.apache.kylin.cube.CubeManager.getStore( > CubeManager.java:965) > at org.apache.kylin.cube.CubeManager.loadAllCubeInstance( > CubeManager.java:892) > at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:141) > at org.apache.kylin.cube.CubeManager.getInstance( > CubeManager.java:105) > at org.apache.kylin.engine.mr.common.CubeStatsReader.main( > CubeStatsReader.java:295) > 2017-04-01 22:13:21,911 INFO [Thread-0 ConnectionManager$ > HConnectionImplementation:1830]: Closing zookeeper > sessionid=0x15b2c9b0fcb0015 > 2017-04-01 22:13:21,928 INFO [Thread-0 ZooKeeper:684]: Session: > 0x15b2c9b0fcb0015 closed > 2017-04-01 22:13:21,929 INFO [main-EventThread ClientCnxn:512]: > EventThread shut down > >
