lufeng created KYLIN-2590:
-----------------------------
Summary: Cube build error on Step 7 Build Base Cuboid Data
Key: KYLIN-2590
URL: https://issues.apache.org/jira/browse/KYLIN-2590
Project: Kylin
Issue Type: Bug
Affects Versions: v1.6.0
Reporter: lufeng
The cube build failed on step 7 with following error message. Any help please
Hadoop 2.7 HBase 1.1.2 Kylin 1.6.0 Tez 0.7.0
<<<
2017-05-01 01:10:38,430 INFO [pool-9-thread-10] common.AbstractHadoopJob:499 :
HDFS meta dir is:
file:///opt/kylin/bin/../tomcat/temp/kylin_job_meta8686959176405233518/meta
2017-05-01 01:10:38,430 INFO [pool-9-thread-10] common.AbstractHadoopJob:372 :
Job 'tmpfiles' updated --
file:///opt/kylin/bin/../tomcat/temp/kylin_job_meta8686959176405233518/meta
2017-05-01 01:10:38,433 INFO [pool-9-thread-10] mapred.FileInputFormat:249 :
Total input paths to process : 0
2017-05-01 01:10:38,433 INFO [pool-9-thread-10] common.AbstractHadoopJob:506 :
tempMetaFileString is :
file:///opt/kylin/bin/../tomcat/temp/kylin_job_meta8686959176405233518/meta
2017-05-01 01:10:38,440 ERROR [pool-9-thread-10] common.MapReduceExecutable:127
: error execute MapReduceExecutable{id=37f887a1-1f2a-40d0-a4dc-9eca7be28ab7-06,
name=Build Base Cuboid Data, state=RUNNING}
java.lang.IllegalArgumentException: Map input splits are 0 bytes, something is
wrong!
at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.getTotalMapInputMB(AbstractHadoopJob.java:555)
at
org.apache.kylin.engine.mr.steps.CuboidJob.setReduceTaskNum(CuboidJob.java:175)
at org.apache.kylin.engine.mr.steps.CuboidJob.run(CuboidJob.java:138)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
>>>>
---
I sovled this issue by changing execution engine from Tez to MR。 Because Tez
engine has zero file issue . https://issues.apache.org/jira/browse/HIVE-13988
I think Kylin should not blocked by empty segment.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
