discard the cube and rebuild success
原始邮件 发件人: yuyong.zhai<[email protected]> 收件人: [email protected]<[email protected]> 发送时间: 2017年8月23日(周三) 11:26 主题: error execute MapReduceExecutable{id=, name=Extract Fact Table Distinct Columns, state=RUNNING 2017-08-23 11:09:21,414 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:106 : Starting: Kylin_Fact_Distinct_Columns_Remain_Cube3_Step 2017-08-23 11:09:21,414 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:163 : append job jar: xxx/kylin/lib/kylin-job-2.0.0.jar 2017-08-23 11:09:21,414 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:171 : append kylin.hbase.dependency: xxx/hbase/lib/hbase-common-0.98.12.1-hadoop2.jar to mapreduce.application.classpath 2017-08-23 11:09:21,414 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:176 : Didn't find mapreduce.application.classpath in job configuration, will run 'mapred classpath' to get the default value. 2017-08-23 11:09:21,414 INFO [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] execution.AbstractExecutable:110 : Executing AbstractExecutable (Load HFile to HBase Table) 2017-08-23 11:09:21,415 DEBUG [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] dao.ExecutableDao:217 : updating job output, id: fdeea049-dab0-4f71-96b7-249e4ac03915-17 2017-08-23 11:09:21,416 INFO [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] execution.ExecutableManager:389 : job id:fdeea049-dab0-4f71-96b7-249e4ac03915-17 from READY to RUNNING 2017-08-23 11:09:21,432 INFO [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable: 2017-08-23 11:09:21,432 INFO [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] common.HadoopShellExecutable:59 : -input xxxxxx/kylin_metadata/kylin-fdeea049-dab0-4f71-96b7-249e4ac03915/Funnel_Result/hfile -htablename KYLIN_2P0N6JLP28 -cubename Funnel_Result 2017-08-23 11:09:21,623 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:202 : Hive Dependencies After Filtered:xxx/hive/lib/hive-exec-2.1.1.jar,xxx/hive/lib/hive-metastore-2.1.1.jar,xxx/hive/hcatalog/share/hcatalog/hive-hcatalog-core-2.1.1.jar 2017-08-23 11:09:21,623 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:230 : Kafka Dependencies: 2017-08-23 11:09:21,625 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:358 : Job 'tmpjars' updated -- file:xxxxxxxx 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:112 : Failed to find 2a3e69cf-7ff1-4c7a-97b2-8909dac4fe51 in cube CUBE[name=Remain_Cube3] 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170523000000_20170601000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170601000000_20170627000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170627000000_20170628000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170627000000_20170628000000 with status NEW 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170628000000_20170629000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170629000000_20170630000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170630000000_20170701000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170701000000_20170702000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170702000000_20170703000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170703000000_20170704000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170704000000_20170705000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170705000000_20170706000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170706000000_20170707000000 with status READY 2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170707000000_20170708000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170708000000_20170709000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170709000000_20170710000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170710000000_20170711000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170711000000_20170712000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170712000000_20170713000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170713000000_20170714000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170714000000_20170715000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170715000000_20170716000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170716000000_20170717000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170717000000_20170718000000 with status READY 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170718000000_20170719000000 with status NEW 2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170719000000_20170720000000 with status READY 2017-08-23 11:09:21,628 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.MapReduceExecutable:130 : error execute MapReduceExecutable{id=ab916702-dfe1-4bfa-b976-b1c4c5e8286 f-02, name=Extract Fact Table Distinct Columns, state=RUNNING} java.lang.IllegalStateException at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:116) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:102) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:123) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:142) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2017-08-23 11:09:21,628 INFO [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] execution.AbstractExecutable:119 : Retry 1
