More complete log is provided to facilitate your analysis.
2021-01-23 10:33:51,318 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] execution.AbstractExecutable:161 :
Executing AbstractExecutable (Convert Lookup Table to
HFile:DBO.MASTER_PRODUCT_ACTUALS_V)
2021-01-23 10:33:51,322 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] execution.ExecutableManager:479 :
job id:810ac500-c1d6-e69e-b9af-fe75b4e51e48-06 from READY to RUNNING
2021-01-23 10:33:51,447 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] common.MapReduceExecutable:141 :
parameters of the MapReduceExecutable: -conf
/usr/local/kylin/conf/kylin_job_conf.xml -cubename
gap_store_sales_merchplan_v01_04_lkup -output
hdfs://node01/kylin/kylin_metadata/kylin-810ac500-c1d6-e69e-b9af-fe75b4e51e4
8/DBO.MASTER_PRODUCT_ACTUALS_V/hfile -tableName DBO.MASTER_PRODUCT_ACTUALS_V
-cubingJobId 810ac500-c1d6-e69e-b9af-fe75b4e51e48 -snapshotID
07a2849e-2571-63ce-340d-54562d9bdb8a -jobname
Kylin_LookupTable_HFile_Generator_DBO.MASTER_PRODUCT_ACTUALS_V_Step
2021-01-23 10:33:51,449 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] lookup.LookupTableToHFileJob:164 :
the table:DBO.MASTER_PRODUCT_ACTUALS_V
snapshot:07a2849e-2571-63ce-340d-54562d9bdb8a exist, remove it
2021-01-23 10:33:51,450 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69]
lookup.ExtTableSnapshotInfoManager:87 : Snapshot with resource path
/ext_table_snapshot/DBO.MASTER_PRODUCT_ACTUALS_V/07a2849e-2571-63ce-340d-545
62d9bdb8a.snapshot is removed due to EXPLICIT
2021-01-23 10:33:51,452 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] lookup.LookupTableToHFileJob:167 :
remove related HBase
table:KYLIN_LOOKUP_DBO.MASTER_PRODUCT_ACTUALS_V_6WYWJIOV3O for
snapshot:07a2849e-2571-63ce-340d-54562d9bdb8a
2021-01-23 10:33:51,461 DEBUG [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] hbase.HBaseConnection:394 : delete
HTable 'KYLIN_LOOKUP_DBO.MASTER_PRODUCT_ACTUALS_V_6WYWJIOV3O'
2021-01-23 10:33:53,461 INFO [BadQueryDetector]
service.BadQueryDetector:148 : Detect bad query.
2021-01-23 10:33:55,003 DEBUG [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] hbase.HBaseConnection:401 : HTable
'KYLIN_LOOKUP_DBO.MASTER_PRODUCT_ACTUALS_V_6WYWJIOV3O' deleted
2021-01-23 10:33:55,003 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] lookup.LookupTableToHFileJob:108 :
create HTable for source table snapshot:DBO.MASTER_PRODUCT_ACTUALS_V
2021-01-23 10:33:55,009 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] steps.CubeHTableUtil:249 : hbase
will not use any compression algorithm to compress data
2021-01-23 10:33:56,232 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] lookup.LookupTableToHFileJob:113 :
created snapshot information
at:/ext_table_snapshot/DBO.MASTER_PRODUCT_ACTUALS_V/07a2849e-2571-63ce-340d-
54562d9bdb8a.snapshot
2021-01-23 10:33:56,275 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] common.AbstractHadoopJob:227 :
Didn't find mapreduce.application.classpath in job configuration, will run
'mapred classpath' to get the default value.
2021-01-23 10:33:56,344 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] common.AbstractHadoopJob:230 : The
default mapred classpath is:
/usr/local/hadoop/etc/hadoop,/usr/local/hadoop/share/hadoop/common/lib/*,/us
r/local/hadoop/share/hadoop/common/*,/usr/local/hadoop/share/hadoop/hdfs,/us
r/local/hadoop/share/hadoop/hdfs/lib/*,/usr/local/hadoop/share/hadoop/hdfs/*
,/usr/local/hadoop/share/hadoop/yarn/lib/*,/usr/local/hadoop/share/hadoop/ya
rn/*,/usr/local/hadoop/share/hadoop/mapreduce/lib/*,/usr/local/hadoop/share/
hadoop/mapreduce/*,,/lib/*,/usr/local/hadoop/contrib/capacity-scheduler/*.ja
r,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.4
.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common
-2.7.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-
core-2.7.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-cli
ent-hs-2.7.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-c
lient-hs-plugins-2.7.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/hadoop-m
apreduce-client-jobclient-2.7.4.jar,/usr/local/hadoop/share/hadoop/mapreduce
/hadoop-mapreduce-client-jobclient-2.7.4-tests.jar,/usr/local/hadoop/share/h
adoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.4.jar,/usr/local/hadoop/
share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.4.jar,/usr/local/hadoop
/share/hadoop/yarn/hadoop-yarn-api-2.7.4.jar,/usr/local/hadoop/share/hadoop/
yarn/hadoop-yarn-applications-distributedshell-2.7.4.jar,/usr/local/hadoop/s
hare/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.4.jar,/u
sr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.4.jar,/usr/local/ha
doop/share/hadoop/yarn/hadoop-yarn-common-2.7.4.jar,/usr/local/hadoop/share/
hadoop/yarn/hadoop-yarn-registry-2.7.4.jar,/usr/local/hadoop/share/hadoop/ya
rn/hadoop-yarn-server-applicationhistoryservice-2.7.4.jar,/usr/local/hadoop/
share/hadoop/yarn/hadoop-yarn-server-common-2.7.4.jar,/usr/local/hadoop/shar
e/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.4.jar,/usr/local/hadoop/sha
re/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.4.jar,/usr/local/hadoo
p/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.4.jar,/usr/loc
al/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.4.jar,/usr/local/ha
doop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.4.jar,/usr/local/had
oop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar,/usr/local/hadoop/share/h
adoop/mapreduce/lib/asm-3.2.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib
/avro-1.7.4.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compres
s-1.4.1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar,
/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar,/usr/local/hadoop
/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar,/usr/local/hadoop/share/ha
doop/mapreduce/lib/hadoop-annotations-2.7.4.jar,/usr/local/hadoop/share/hado
op/mapreduce/lib/hamcrest-core-1.3.jar,/usr/local/hadoop/share/hadoop/mapred
uce/lib/jackson-core-asl-1.9.13.jar,/usr/local/hadoop/share/hadoop/mapreduce
/lib/jackson-mapper-asl-1.9.13.jar,/usr/local/hadoop/share/hadoop/mapreduce/
lib/javax.inject-1.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-c
ore-1.9.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.ja
r,/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar,/usr/lo
cal/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar,/usr/local/hadoop/share
/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar,/usr/local/hadoop/share/hadoop/
mapreduce/lib/log4j-1.2.17.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/
netty-3.6.2.Final.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer
-2.3.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.ja
r,/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar,/usr/
local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar,/usr/local/hadoop/modules
/*.jar
2021-01-23 10:33:56,583 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] common.AbstractHadoopJob:634 :
tmpFilesString is : null
2021-01-23 10:33:56,584 ERROR [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] common.MapReduceExecutable:159 :
error execute
MapReduceExecutable{id=810ac500-c1d6-e69e-b9af-fe75b4e51e48-06, name=Convert
Lookup Table to HFile:DBO.MASTER_PRODUCT_ACTUALS_V, state=RUNNING}
java.lang.RuntimeException: java.io.IOException:
NoSuchObjectException(message:DBO.MASTER_PRODUCT_ACTUALS_V table not found)
at
org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(H
iveMRInput.java:83)
at
org.apache.kylin.storage.hbase.lookup.LookupTableToHFileJob.run(LookupTableT
oHFileJob.java:124)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecut
able.java:144)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable
.java:178)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChaine
dExecutable.java:71)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable
.java:178)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultS
cheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
42)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
17)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException:
NoSuchObjectException(message:DBO.MASTER_PRODUCT_ACTUALS_V table not found)
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.
java:97)
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.
java:51)
at
org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(H
iveMRInput.java:80)
... 9 more
Caused by: NoSuchObjectException(message:DBO.MASTER_PRODUCT_ACTUALS_V table
not found)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(Hiv
eMetaStore.java:1808)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMeta
Store.java:1778)
at sun.reflect.GeneratedMethodAccessor236.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandle
r.java:107)
at com.sun.proxy.$Proxy105.get_table(Unknown Source)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreC
lient.java:1208)
at sun.reflect.GeneratedMethodAccessor299.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMeta
StoreClient.java:152)
at com.sun.proxy.$Proxy108.getTable(Unknown Source)
at
org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:180)
at
org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(Initializ
eInput.java:105)
at
org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.
java:86)
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.
java:95)
... 11 more
2021-01-23 10:33:56,591 INFO [Scheduler 714740536 Job
810ac500-c1d6-e69e-b9af-fe75b4e51e48-69] execution.ExecutableManager:479 :
job id:810ac500-c1d6-e69e-b9af-fe75b4e51e48-06 from RUNNING to ERROR
