[
https://issues.apache.org/jira/browse/KYLIN-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780443#comment-16780443
]
ASF GitHub Bot commented on KYLIN-3727:
---------------------------------------
Sidonet commented on pull request #494: KYLIN-3727 Check if where is no
directories, then finish job successf…
URL: https://github.com/apache/kylin/pull/494
…ully.
Input path for HBase load consists
_SUCCESS
F1
F2
etc...
So, check if no folders exist, then skip loading step.
Test for non-empty cube:
2019-02-28 14:56:20,333 INFO [Scheduler 136668115 Job
0143a095-92fe-c8e0-a919-428682e2f15d-238] execution.ExecutableManager:453 : job
id:0143a095-92fe-c8e0-a919-428682e2f15d-08 from READY to RUNNING
2019-02-28 14:56:20,354 INFO [Scheduler 136668115 Job
0143a095-92fe-c8e0-a919-428682e2f15d-238] common.HadoopShellExecutable:59 :
parameters of the HadoopShellExecutable: -input
hdfs://***:8020/kylin/kylin_metadata/kylin-0143a095-92fe-c8e0-a919-428682e2f15d/ORCTESTCUBE/hfile
-htablename KYLIN_D9OV6ZF44W -cubename ORCTESTCUBE
2019-02-28 14:56:25,416 DEBUG [Scheduler 136668115 Job
0143a095-92fe-c8e0-a919-428682e2f15d-238] steps.BulkLoadJob:95 : Start to run
LoadIncrementalHFiles
Test in my env for empty cube:
2019-02-28 14:42:15,699 INFO [Scheduler 136668115 Job
199180ac-8ab3-708f-c89c-6f2166a7d27d-102] execution.ExecutableManager:453 : job
id:199180ac-8ab3-708f-c89c-6f2166a7d27d-08 from READY to RUNNING
2019-02-28 14:42:15,784 INFO [Scheduler 136668115 Job
199180ac-8ab3-708f-c89c-6f2166a7d27d-102] common.HadoopShellExecutable:59 :
parameters of the HadoopShellExecutable: -input
hdfs://***:8020/kylin/kylin_metadata/kylin-199180ac-8ab3-708f-c89c-6f2166a7d27d/kylin_sales_cube_orc/hfile
-htablename KYLIN_MP2UWUVS0X -cubename kylin_sales_cube_orc
2019-02-28 14:42:21,402 DEBUG [Scheduler 136668115 Job
199180ac-8ab3-708f-c89c-6f2166a7d27d-102] steps.BulkLoadJob:100 : Nothing to
load, cube is empty
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> kylin2.5.2 不能构建空的cube,否则出现 HadoopShellException异常
> --------------------------------------------------
>
> Key: KYLIN-3727
> URL: https://issues.apache.org/jira/browse/KYLIN-3727
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: v2.5.2
> Reporter: shiyu
> Assignee: Alexander
> Priority: Major
> Labels: Kylin
> Attachments: KYLIN-3727.master.001.patch,
> image-2018-12-19-08-38-19-791.png
>
>
> 注:kylin 已经开启,是否容忍数据源为空，默认值为 TRUE
> kylin.job.allow-empty-segment=true
> 出错位置:#12 Step Name: Load HFile to HBase Table
> !image-2018-12-19-08-38-19-791.png!
> 异常信息:HadoopShellException
> org.apache.kylin.engine.mr.exception.HadoopShellException: result code:-1
> at
> org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
