> Is it OK to deploy StandAlone Hbase cluster with seperate Zookeeper different from the main cluster? No. Kylin only works with 1 HBase and its related Zookeeper.
> How Kylin get yarn config when submmiting job? Kylin took Hadoop config from classpath. And the most classpath comes from HBase shell. On Wed, Oct 25, 2017 at 4:33 PM, Yuxiang Mai <[email protected]> wrote: > Hi, experts > > We are now deploying standalone Hbase out of the hadoop cluster to improve > the query performance. > http://kylin.apache.org/blog/2016/06/10/standalone-hbase-cluster/ > > The new Hbase cluster use seperate zookeeper nodes from the main cluster. > Kylin server can access both the Hbase, hadoop & hive resource. > But in this configuration, cude build failed in the first step: > > There are 3 hive commands in the first step: > DROP TABLE IF EXISTS kylin_intermediate_test1_ba3c5910_ff7d_4669_b28a_ > 4ec2736d60dc; > > CREATE EXTERNAL TABLE IF NOT EXISTS kylin_intermediate_test1_ > ba3c5910_ff7d_4669_b28a_4ec2736d60dc > ... > INSERT OVERWRITE TABLE > kylin_intermediate_test1_ba3c5910_ff7d_4669_b28a_4ec2736d60dc > SELECT > ...... > > > drop & create table are OK, but failed on "insert overwrite" with the > following exception. > > > FAILED: IllegalArgumentException java.net.UnknownHostException: maincluster > > at org.apache.kylin.common.util.CliCommandExecutor.execute( > CliCommandExecutor.java:92) > at org.apache.kylin.source.hive.CreateFlatHiveTableStep. > createFlatHiveTable(CreateFlatHiveTableStep.java:52) > at org.apache.kylin.source.hive.CreateFlatHiveTableStep.doWork( > CreateFlatHiveTableStep.java:70) > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:124) > at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork( > DefaultChainedExecutable.java:64) > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:124) > at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run( > DefaultScheduler.java:142) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > > > It seems MR job are failed to submit to YARN. In our debug, seems job is > not submitted to main cluster. > So my question is: > 1. Is it OK to deploy StandAlone Hbase cluster with seperate Zookeeper > different from the main cluster? > 2. How Kylin get yarn config when submmiting job? I can only find hive & > hbase config, but not yarn related config. > > > Thanks a lot. > > -- > Yuxiang Mai > >
