This is the root cause. The metadata was inconsistent at that point. > Failed to find 2a3e69cf-7ff1-4c7a-97b2-8909dac4fe51 in cube CUBE[name=Remain_Cube3
On Wed, Aug 23, 2017 at 11:29 AM, yuyong.zhai <[email protected]> wrote: > discard the cube and rebuild success > > > > 原始邮件 > *发件人:* yuyong.zhai<[email protected]> > *收件人:* [email protected]<[email protected]> > *发送时间:* 2017年8月23日(周三) 11:26 > *主题:* error execute MapReduceExecutable{id=, name=Extract Fact Table > Distinct Columns, state=RUNNING > > 2017-08-23 11:09:21,414 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:106 : Starting: Kylin_Fact_Distinct_Columns_ > Remain_Cube3_Step > > 2017-08-23 11:09:21,414 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > common.AbstractHadoopJob:163 : append job jar: > xxx/kylin/lib/kylin-job-2.0.0.jar > > 2017-08-23 11:09:21,414 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > common.AbstractHadoopJob:171 : append kylin.hbase.dependency: > xxx/hbase/lib/hbase-common-0.98.12.1-hadoop2.jar to mapreduce.application. > classpath > > 2017-08-23 11:09:21,414 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > common.AbstractHadoopJob:176 : Didn't find mapreduce.application.classpath > in job configuration, will run 'mapred classpath' to get the default value. > > 2017-08-23 11:09:21,414 INFO [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] > execution.AbstractExecutable:110 : Executing AbstractExecutable (Load > HFile to HBase Table) > > 2017-08-23 11:09:21,415 DEBUG [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] > dao.ExecutableDao:217 : updating job output, id: fdeea049-dab0-4f71-96b7- > 249e4ac03915-17 > > 2017-08-23 11:09:21,416 INFO [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] > execution.ExecutableManager:389 : job > id:fdeea049-dab0-4f71-96b7-249e4ac03915-17 > from READY to RUNNING > > 2017-08-23 11:09:21,432 INFO [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] > common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable: > > 2017-08-23 11:09:21,432 INFO [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] > common.HadoopShellExecutable:59 : -input xxxxxx/kylin_metadata/kylin- > fdeea049-dab0-4f71-96b7-249e4ac03915/Funnel_Result/hfile -htablename > KYLIN_2P0N6JLP28 -cubename Funnel_Result > > 2017-08-23 11:09:21,623 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > common.AbstractHadoopJob:202 : Hive Dependencies After > Filtered:xxx/hive/lib/hive-exec-2.1.1.jar,xxx/hive/lib/ > hive-metastore-2.1.1.jar,xxx/hive/hcatalog/share/hcatalog/ > hive-hcatalog-core-2.1.1.jar > > 2017-08-23 11:09:21,623 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > common.AbstractHadoopJob:230 : Kafka Dependencies: > > 2017-08-23 11:09:21,625 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > common.AbstractHadoopJob:358 : Job 'tmpjars' updated -- file:xxxxxxxx > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:112 : Failed to find > 2a3e69cf-7ff1-4c7a-97b2-8909dac4fe51 > in cube CUBE[name=Remain_Cube3] > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170523000000_20170601000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170601000000_20170627000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170627000000_20170628000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170627000000_20170628000000 with > status NEW > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170628000000_20170629000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170629000000_20170630000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170630000000_20170701000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170701000000_20170702000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170702000000_20170703000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170703000000_20170704000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170704000000_20170705000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170705000000_20170706000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170706000000_20170707000000 with > status READY > > 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170707000000_20170708000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170708000000_20170709000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170709000000_20170710000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170710000000_20170711000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170711000000_20170712000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170712000000_20170713000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170713000000_20170714000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170714000000_20170715000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170715000000_20170716000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170716000000_20170717000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170717000000_20170718000000 with > status READY > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170718000000_20170719000000 with > status NEW > > 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > steps.FactDistinctColumnsJob:114 : 20170719000000_20170720000000 with > status READY > > 2017-08-23 11:09:21,628 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > common.MapReduceExecutable:130 : error execute MapReduceExecutable{id= > ab916702-dfe1-4bfa-b976-b1c4c5e8286 > > f-02, name=Extract Fact Table Distinct Columns, state=RUNNING} > > java.lang.IllegalStateException > > at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob. > run(FactDistinctColumnsJob.java:116) > > at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:102) > > at org.apache.kylin.engine.mr.common.MapReduceExecutable. > doWork(MapReduceExecutable.java:123) > > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:124) > > at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork( > DefaultChainedExecutable.java:64) > > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:124) > > at org.apache.kylin.job.impl.threadpool.DefaultScheduler$ > JobRunner.run(DefaultScheduler.java:142) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:745) > > 2017-08-23 11:09:21,628 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] > execution.AbstractExecutable:119 : Retry 1 > >
