[
https://issues.apache.org/jira/browse/KYLIN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603857#comment-16603857
]
Chao Long commented on KYLIN-3534:
----------------------------------
Root cause: The output file has been compressed in SparkFactDistinct.java，and
at the step of updateCubeInfo it read compressed file directly(read as txt
file), so it can not get the correct data.
> Failed at update cube info step
> -------------------------------
>
> Key: KYLIN-3534
> URL: https://issues.apache.org/jira/browse/KYLIN-3534
> Project: Kylin
> Issue Type: Bug
> Reporter: Yichen Zhou
> Assignee: Chao Long
> Priority: Major
> Fix For: v2.5.0
>
>
> When building cube with spark(full build), I got the following error in the
> step of "Update Cube Info":
> {quote}2018-09-04 14:49:49,007 INFO [Scheduler 1888858588 Job
> d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
> steps.UpdateCubeInfoAfterBuildStep:158 : updateSegment step. TRANS_ID
> minValue:x�3�.�) maxValue:null
> 2018-09-04 14:49:49,008 ERROR [Scheduler 1888858588 Job
> d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.AbstractExecutable:165 :
> error running Executable:
> UpdateCubeInfoAfterBuildStep\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2-09,
> name=Update Cube Info, state=RUNNING}
> 2018-09-04 14:49:49,011 INFO [Scheduler 1888858588 Job
> d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.ExecutableManager:434 :
> job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2-09 from RUNNING to ERROR
> 2018-09-04 14:49:49,012 ERROR [Scheduler 1888858588 Job
> d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.AbstractExecutable:165 :
> error running Executable: CubingJob\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2,
> name=BUILD CUBE - cube_global_dictionary_spark - FULL_BUILD - GMT+08:00
> 2018-09-04 11:51:58, state=RUNNING}
> 2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 :
> Servers in the cluster: [localhost:7070]
> 2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 :
> Announcing new broadcast to all: BroadcastEvent\{entity=execute_output,
> event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2}
> 2018-09-04 14:49:49,015 INFO [Scheduler 1888858588 Job
> d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.ExecutableManager:434 :
> job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2 from RUNNING to ERROR
> 2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 :
> Servers in the cluster: [localhost:7070]
> 2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 :
> Announcing new broadcast to all: BroadcastEvent\{entity=execute_output,
> event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2}
> 2018-09-04 14:49:49,015 DEBUG [Scheduler 1888858588 Job
> d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.AbstractExecutable:316 :
> no need to send email, user list is empty
> 2018-09-04 14:49:49,017 ERROR [pool-10-thread-10]
> threadpool.DefaultScheduler:115 : ExecuteException
> job:d05156bb-2635-cb2f-ac19-b38f6147fcb2
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.job.exception.ExecuteException:java.lang.IllegalStateException
> at
> org.apache.kylin.cube.DimensionRangeInfo.<init>(DimensionRangeInfo.java:86)
> at
> org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.updateSegment(UpdateCubeInfoAfterBuildStep.java:166)
> at
> org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.doWork(UpdateCubeInfoAfterBuildStep.java:85)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> {quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
