already dig into kylin.log and found the only exception below which might
related to the merge issue,any clue?
2017-12-03 08:38:39,156 DEBUG [Thread-23387] model.Segments:180 : Cube
CUBE_UXIP_EVENT_PARAM2 has 1 building segments
2017-12-03 08:38:39,157 ERROR [Thread-23387] service.CacheService:88 : Error in
updateOnNewSegmentReady()
java.lang.IllegalArgumentException
at
com.google.common.base.Preconditions.checkArgument(Preconditions.java:76)
at org.apache.kylin.cube.CubeManager.mergeSegments(CubeManager.java:547)
at
org.apache.kylin.rest.service.CubeService.mergeCubeSegment(CubeService.java:618)
at
org.apache.kylin.rest.service.CubeService.updateOnNewSegmentReady(CubeService.java:566)
at
org.apache.kylin.rest.service.CubeService$$FastClassBySpringCGLIB$$17a07c0e.invoke(<generated>)
at
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:669)
at
org.apache.kylin.rest.service.CubeService$$EnhancerBySpringCGLIB$$e2b75386.updateOnNewSegmentReady(<generated>)
at
org.apache.kylin.rest.service.CacheService$1$1.run(CacheService.java:86)
2017-12-03 08:38:39,240 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e3e766e-00a5-46d2-bd37-b74fb6d1f2b8] deleted successfully.
2017-12-03 08:38:39,246 INFO [Scheduler 71286977 Job
1bc8fc5b-1bde-40e0-b913-72f0cc519665-1125] execution.ExecutableManager:421 :
job id:1bc8fc5b-1bde-40e0-b913-72f0cc519665-01 from RUNNING to SUCCEED
2017-12-03 08:38:39,262 INFO [Scheduler 71286977 Job
1bc8fc5b-1bde-40e0-b913-72f0cc519665-1125] execution.ExecutableManager:421 :
job id:1bc8fc5b-1bde-40e0-b913-72f0cc519665 from RUNNING to READY
2017-12-03 08:38:39,366 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e4160ee-6154-46e4-8f0a-3ee2fa85a688] deleted successfully.
2017-12-03 08:38:39,455 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e47a8ad-fdb5-43ed-9bcb-dcca4f280b97] deleted successfully.
2017-12-03 08:38:39,545 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e5518ef-dfff-4772-a353-a1b79e0c3ee4] deleted successfully.
2017-12-03 08:38:39,634 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e7b8422-a784-4752-b4b5-c55068fb558a] deleted successfully.
2017-12-03 08:38:39,721 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e87f7f5-7000-4846-959c-8eddbab83ddc] deleted successfully.
2017-12-03 08:38:39,808 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e8a6bcc-2945-4a28-a4c7-8a3f1dcec968] deleted successfully.
2017-12-03 08:38:39,853 INFO [pool-8-thread-1] threadpool.DefaultScheduler:123
: Job Fetcher: 0 should running, 0 actual running, 0 stopped, 1 ready, 2106
already succeed, 77 error, 184 discarded, 0 others
2017-12-03 08:38:39,894 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e915dfb-f57f-494e-9323-2813ce6e9a02] deleted successfully.
2017-12-03 08:38:39,981 DEBUG [http-bio-7070-exec-53] service.AclService:217 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
5e933f95-2863-4979-8034-e78e8baf1b3e] deleted successfully.
2017-12-03 08:38:40,063 INFO [pool-8-thread-1] threadpool.DefaultScheduler:113
: CubingJob{id=1bc8fc5b-1bde-40e0-b913-72f0cc519665, name=MERGE CUBE -
CUBE_UXIP_EVENT_PARAM2 - 20171118000000_20171125000000 - GMT+08:00 2017-12-03
08:38:10, state=READY} prepare to schedule
2017-12-03 08:38:40,063 INFO [pool-8-thread-1] threadpool.DefaultScheduler:116
: CubingJob{id=1bc8fc5b-1bde-40e0-b913-72f0cc519665, name=MERGE CUBE -
CUBE_UXIP_EVENT_PARAM2 - 20171118000000_20171125000000 - GMT+08:00 2017-12-03
08:38:10, state=READY} scheduled
2017-12-03 08:38:40,063 INFO [Scheduler 71286977 Job
1bc8fc5b-1bde-40e0-b913-72f0cc519665-1125] execution.AbstractExecutable:111 :
Executing AbstractExecutable (MERGE CUBE - CUBE_UXIP_EVENT_PARAM2 -
20171118000000_20171125000000 - GMT+08:00 2017-12-03 08:38:10)
________________________________
赵天烁
Kevin Zhao
[email protected]<mailto:[email protected]>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com
From: 赵天烁<mailto:[email protected]>
Date: 2017-11-30 22:59
To: [email protected]<mailto:[email protected]>
Subject: Re: Re: auto merge
all right, I'll have a look
来自 赵天烁的 魅族 MX
-------- 原始邮件 --------
发件人：Billy Liu <[email protected]>
时间：周四 11月30日 22:57
收件人：dev <[email protected]>
抄送：Shuangyin Ge <[email protected]>
主题：Re: Re: auto merge
Hi Tianshuo,
When you found the auto merge not work as expected, could you check the
kylin.log? It should say why no merge happened.
2017-11-30 10:42 GMT+08:00 赵天烁 <[email protected]>:
> sometimes auto Merge is not avaliable in my kylin cluster which lead those
> segments keep increasing so I also need to use rest API to commit a merge
> job,is there anyone else run into the same problem?
>
> ________________________________
> 赵天烁
> Kevin Zhao
> [email protected]<mailto:[email protected]>
>
> 珠海市魅族科技有限公司
> MEIZU Technology Co., Ltd.
> 广东省珠海市科技创新海岸魅族科技楼
> MEIZU Tech Bldg., Technology & Innovation Coast
> Zhuhai, 519085, Guangdong, China
> meizu.com
>
> From: Shuangyin Ge<mailto:[email protected]>
> Date: 2017-11-30 10:17
> To: [email protected]<mailto:[email protected]>
> Subject: Re: auto merge
>
> Hello,
>
> When you build a cube there is an option for Auto Merge, or maybe you can
> try RESTful API http://kylin.apache.org/docs21/howto/howto_use_
> restapi.html?
> There is a merge API available.
>
> 2017-11-29 14:03 GMT+08:00 hankunlun <[email protected]>:
>
> > Can the merge operation of kylin be implemented regularly?
> > 请问kylin的merge操作可以定时实现吗？
> >
> > --
> > Sent from: http://apache-kylin.74782.x6.nabble.com/
> >
>
