Hi qing, the information you provided is very good for trouble shooting, thank you.
Kylin dose a check after creating the hbase table; if detects the table is not available in HBase, it will throw such exception, so user can check the issue at the first moment. >From the error it seems the HBase region servers are not in good state. Please check your HBase healthy status first; If all region servers are running, drop this table manually, and then resume this job from Kylin's UI, Kylin will re-try this step. 2016-04-08 17:42 GMT+08:00 qing·ye <[email protected]>: > > env: > > hadoop 2.7.1 > hbase 1.1.4 > hive 2.0.0 > kylin-1.5.0-HBase1.1.3(special version) > > I an login in the web ui:192.168.10.20:7070/kylin with ADMIN/KYLIN > > when i select action Build and the select a data then submit the job > the job is submit successful > > then a change the tab to monitor see how it works > > step 1 - 4 is working well > > but when it comes step 5:create Htable ,it throws a problem : > > > > (我能正常运行kylin项目并且能正常访问，我用sample.sh做测试，然后试图执行一个build操作，选择了一个日期以后。我提交了任务，能正常提交，然后我进入了monitor去看执行进度，然后第1-4步都能够成功执行，到第五步创建Htable的时候报错了，看了下log > 提示的是 result code ：2 。看了控制台kylin.log的日志，报错如下：) > > -------------------------------------------------------------------------------------------------------------------- > > 2016-04-08 17:11:24,207 DEBUG [pool-7-thread-5] service.CubeService:578 : > on > updateOnNewSegmentReady: kylin_sales_cube > 2016-04-08 17:11:24,207 DEBUG [pool-7-thread-5] service.CubeService:581 : > server mode: all > 2016-04-08 17:11:24,209 INFO [http-bio-7070-exec-8] > controller.CacheController:64 : wipe cache type: CUBE event:UPDATE > name:kylin_sales_cube > 2016-04-08 17:11:24,210 INFO [http-bio-7070-exec-8] > service.CacheService:169 : rebuild cache type: CUBE name:kylin_sales_cube > 2016-04-08 17:11:24,216 DEBUG [http-bio-7070-exec-8] cube.CubeManager:840 : > Reloaded new cube: kylin_sales_cube with reference > beingCUBE[name=kylin_sales_cube] having 1 segments:KYLIN_XSLUXA5KGI > 2016-04-08 17:11:24,221 INFO [http-bio-7070-exec-8] > service.CacheService:122 : removeOLAPDataSource is called for project > learn_kylin > 2016-04-08 17:11:24,221 WARN [http-bio-7070-exec-8] > service.CacheService:108 : skip cleaning cache for > 2fbca32a-a33e-4b69-83dd-0bb8b1f8c53b > 2016-04-08 17:11:24,222 DEBUG [http-bio-7070-exec-8] > service.CubeService:578 > : on updateOnNewSegmentReady: kylin_sales_cube > 2016-04-08 17:11:24,222 DEBUG [http-bio-7070-exec-8] > service.CubeService:581 > : server mode: all > 2016-04-08 17:11:24,630 INFO [pool-7-thread-5] steps.CubeHTableUtil:92 : > hbase will use snappy to compress data > 2016-04-08 17:11:24,632 INFO [pool-7-thread-5] steps.CubeHTableUtil:92 : > hbase will use snappy to compress data > 2016-04-08 17:11:24,671 INFO [pool-7-thread-5] > util.DeployCoprocessorCLI:180 : Add coprocessor on KYLIN_XSLUXA5KGI > 2016-04-08 17:11:24,673 INFO [pool-7-thread-5] > util.DeployCoprocessorCLI:160 : hbase table KYLIN_XSLUXA5KGI deployed with > coprocessor. > 2016-04-08 17:11:29,217 ERROR [pool-7-thread-5] steps.CubeHTableUtil:135 : > Failed to create HTable > java.lang.IllegalArgumentException: table KYLIN_XSLUXA5KGI created, but is > not available due to some reasons > at > com.google.common.base.Preconditions.checkArgument(Preconditions.java:92) > at > > org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:132) > at > > org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:104) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at > > org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60) > at > > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114) > at > > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50) > at > > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114) > at > > org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > 2016-04-08 17:11:29,228 ERROR [pool-7-thread-5] steps.CreateHTableJob:109 : > table KYLIN_XSLUXA5KGI created, but is not available due to some reasons > java.lang.IllegalArgumentException: table KYLIN_XSLUXA5KGI created, but is > not available due to some reasons > at > com.google.common.base.Preconditions.checkArgument(Preconditions.java:92) > at > > org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:132) > at > > org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:104) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at > > org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60) > at > > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114) > at > > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50) > at > > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114) > at > > org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > 2016-04-08 17:11:29,246 DEBUG [pool-7-thread-5] > hbase.HBaseResourceStore:277 > : Update row /execute_output/4020e441-a770-4200-b1c3-c8da3ead190c-04 from > oldTs: 1460106683759, to newTs: 1460106689234, operation result: true > 2016-04-08 17:11:29,263 DEBUG [pool-7-thread-5] > hbase.HBaseResourceStore:277 > : Update row /execute_output/4020e441-a770-4200-b1c3-c8da3ead190c-04 from > oldTs: 1460106689234, to newTs: 1460106689254, operation result: true > 2016-04-08 17:11:29,264 INFO [pool-7-thread-5] > manager.ExecutableManager:273 : job > id:4020e441-a770-4200-b1c3-c8da3ead190c-04 from RUNNING to ERROR > > > > ------------------------------------------------------------------------------------------------------------- > > it says : "table KYLIN_XSLUXA5KGI created, but is not available due to some > reasons" > but don't say why. > > then i locate the source jar to find where the hint from > in kylin-coprocessor-1.5.0-SNAPSHOT.jar | > org.apache.kylin.storage.hbase.steps.CubeHTableUtil.java > > line 131 and 132 : > > admin.createTable(tableDesc, splitKeys); > > Preconditions.checkArgument(admin.isTableAvailable(TableName.valueOf(tableName)), > "table " + tableName + " created, but is not available due to some > reasons"); > > so, as you see , the table which created in hbase is not avilable. > > （通过报错信息，我去找源代码试图找出错误原因，但是源代码里面给的信息也不是很明确，说的是这个表不是可用的，但是为什么不可用却没说） > > and when i check my hbase web console , i find the table data is not on any > region > > in Task Tab like this: > < > http://apache-kylin.74782.x6.nabble.com/file/n4102/%E4%BB%BB%E5%8A%A1%E5%8F%B0%E6%8F%90%E7%A4%BA.png > > > > the table have a task seems like closing regin > > give some table info .hope it can give you some information > < > http://apache-kylin.74782.x6.nabble.com/file/n4102/%E6%8A%A5%E9%94%992.png > > > > （通过查看hbase web控制台 我发现这张表的信息如下： > > 'KYLIN_XSLUXA5KGI', {TABLE_ATTRIBUTES => {coprocessor$1 => > > 'hdfs://master1:9000/home/hadoop/kylin/kylin_hdfs_working_dir/kylin_metadata/coprocessor/kylin-coprocessor-1.5.0-SNAPSHOT-0.jar|org.apache.kylin.storage.hbase.ii.coprocessor.endpoint.IIEndpoint|1000|', > coprocessor$2 => > > 'hdfs://master1:9000/home/hadoop/kylin/kylin_hdfs_working_dir/kylin_metadata/coprocessor/kylin-coprocessor-1.5.0-SNAPSHOT-0.jar|org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService|1001|', > coprocessor$3 => > > 'hdfs://master1:9000/home/hadoop/kylin/kylin_hdfs_working_dir/kylin_metadata/coprocessor/kylin-coprocessor-1.5.0-SNAPSHOT-0.jar|org.apache.kylin.storage.hbase.cube.v1.coprocessor.observer.AggregateRegionObserver|1002|', > METADATA => {'CREATION_TIME' => '1460106684505', 'KYLIN_HOST' => > 'kylin_metadata', 'OWNER' => '[email protected]', 'SPLIT_POLICY' => > 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}, {NAME > => > 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', COMPRESSION => 'SNAPPY', > BLOCKSIZE > => '4194304'}, {NAME => 'F2', DATA_BLOCK_ENCODING => 'FAST_DIFF', > COMPRESSION => 'SNAPPY', BLOCKSIZE => '4194304'} > > 会不会是协处理器的问题？ > ） > > 然后发现在build以后，生成的表没有在任何region上面 > 还执行了closing region 的任务 > Closing region > KYLIN_XSLUXA5KGI,\x00\x01,1460106684846.971eccb68fa9ce8116596ea73cc9ebb0. > > Name > ：KYLIN_XSLUXA5KGI,,1460106684846.fe79ee4e998f5816b7d9639d8313fba6. > Region Server ：not deployed > > 这是不是表示数据没有写入任何的region中？ > > > at last , my kylin.properties is like this: > > > ------------------------------------------------------------------------------------------- > [email protected] > kylin.rest.servers=192.168.10.10:7070(master1 is my namenode ip,also > running > zookeeper) > kylin.metadata.url=kylin_metadata@hbase > kylin.storage.url=hbase > kylin.hdfs.working.dir=/home/hadoop/kylin/kylin_hdfs_working_dir > kylin.job.jar=/home/hadoop/kylin/lib/kylin-job-1.5.0-SNAPSHOT.jar > > kylin.coprocessor.local.jar=/home/hadoop/kylin/lib/kylin-coprocessor-1.5.0-SNAPSHOT.jar > kylin.job.mapreduce.default.reduce.input.mb=500 > > kylin.job.remote.cli.working.dir=/home/hadoop/kylin/kylin_job_remote_cli_working_dir > > > ------------------------------------------------------------------------------------------- > > in file kylin_job and kylin_hive , i just changed the replication "4" and > compression "fasle" > > > please help me ,thanks > regards > > a hopeless gilr from qingdao.shandong.china > > > （最后，我把我的配置信息贴出来，希望你们帮帮我 —— 一个无助的女程序员） > > ^ ^ > > > > > > > > > > > > > > > > > > > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/an-error-occurred-when-build-a-sample-cube-at-step-5-create-HTable-tp4102.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi
