I've use metastore.sh removed /model_desc/membership_marking.json and /model_desc/gaoji_sale_model.json and restarted kylin , but still can't build systemcube automatically.
2019-08-28 lk_hadoop 发件人："lk_hadoop"<[email protected]> 发送时间：2019-08-28 09:21 主题：回复: 回复: 回复：CubeBuildingCLI not work well 收件人："user"<[email protected]> 抄送："dev"<[email protected]> NowI have upgrade from kylin2.6.1 to kylin2.6.3 , I still face the issue of building system cube. I follow the tutorial use cron job to call system_cube_build.sh , eche time I will get the error log ,and I can't see any build job from the web ui: 2019-08-27 20:20:11,909 DEBUG [main] cachesync.CachedCrudAssist:118 : Reloading DataModelDesc from kylin_metadata(key='/model_desc')@kylin_metadata@hbase ... 2019-08-27 16:40:02,319 ERROR [http-bio-7070-exec-10] controller.BasicController:63 : org.apache.kylin.rest.exception.InternalErrorException at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:399) at org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:355) at org.apache.kylin.rest.controller.CubeController.build(CubeController.java:344) ... Caused by: java.lang.NullPointerException at org.apache.kylin.rest.controller.CubeController.checkBuildingSegment(CubeController.java:995) at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:394) ... 80 more 2019-08-27 16:40:02,342 ERROR [http-bio-7070-exec-8] controller.CubeController:398 : java.lang.NullPointerException at org.apache.kylin.rest.controller.CubeController.checkBuildingSegment(CubeController.java:995) at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:394) at org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:355) at org.apache.kylin.rest.controller.CubeController.build(CubeController.java:344) ... and I also can find some error from the system cube build's log : 2019-08-27 20:20:11,943 ERROR [main] cachesync.CachedCrudAssist:143 : Error loading DataModelDesc at /model_desc/gaoji_sale_model.json java.lang.IllegalStateException: Error loading DataModelDesc at /model_desc/gaoji_sale_model.json at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadAt(CachedCrudAssist.java:168) at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadQuietlyAt(CachedCrudAssist.java:141) at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadAll(CachedCrudAssist.java:124) at org.apache.kylin.metadata.model.DataModelManager.init(DataModelManager.java:99) at org.apache.kylin.metadata.model.DataModelManager.<init>(DataModelManager.java:79) .... Caused by: java.lang.IllegalStateException: No project found for model gaoji_sale_model at org.apache.kylin.metadata.project.ProjectManager.getProjectOfModel(ProjectManager.java:384) at org.apache.kylin.metadata.model.DataModelManager$1.initEntityAfterReload(DataModelManager.java:89) at org.apache.kylin.metadata.model.DataModelManager$1.initEntityAfterReload(DataModelManager.java:86) at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadAt(CachedCrudAssist.java:159) ... 45 more 2019-08-27 20:20:11,952 ERROR [main] cachesync.CachedCrudAssist:143 : Error loading DataModelDesc at /model_desc/membership_marking.json java.lang.IllegalStateException: Error loading DataModelDesc at /model_desc/membership_marking.json ... Caused by: java.lang.IllegalStateException: No project found for model membership_marking at org.apache.kylin.metadata.project.ProjectManager.getProjectOfModel(ProjectManager.java:384) at org.apache.kylin.metadata.model.DataModelManager$1.initEntityAfterReload(DataModelManager.java:89) at org.apache.kylin.metadata.model.DataModelManager$1.initEntityAfterReload(DataModelManager.java:86) at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadAt(CachedCrudAssist.java:159) ... 45 more all that models which cause error , I've deleted already, why kylin still want to load it from meta_table ？ how can I delete it ? is this the reason which cause the system cube build error ? but when I use admin to reload metadata from the web ui , all the build jobs should be executed will appear to the web ui and begin to run. 2019-08-28 lk_hadoop 发件人："lk_hadoop"<[email protected]> 发送时间：2019-04-08 19:24 主题：回复: 回复：CubeBuildingCLI not work well 收件人："user"<[email protected]> 抄送： thanks for reply @Chao Long . I have confirmed that there no other crontab tasks , and the error msg just print out when the crontab job called. 2019-04-08 lk_hadoop 发件人："Chao Long" <[email protected]> 发送时间：2019-04-08 14:47 主题：回复：CubeBuildingCLI not work well 收件人："user"<[email protected]> 抄送： Hi, CubeBuildingCLI will not call method in CubeController, the stack trace show some exceptions throw from method CubeController.build(), which will be called by rest api. So you may check if there are other running cube-building crontab tasks. ------------------ Best Regards, Chao Long ------------------ 原始邮件 ------------------ 发件人: "lk_hadoop"<[email protected]>; 发送时间: 2019年3月25日(星期一) 下午5:20 收件人: "user"<[email protected]>; 主题: CubeBuildingCLI not work well hi,all: I'm using kylin 2.6.1 with CDH57, When calling CubeBuildingCLI the job will not be scheduled,only when I click "reload metadata" on kylin's web , The job can be scheduled. and if CubeBuildingCLI was called from crontab , I can see error message from the log : 2019-03-25 16:20:02,325 ERROR [http-bio-7070-exec-2] controller.BasicController:63 : org.apache.kylin.rest.exception.InternalErrorException at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:398) at org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:354) at org.apache.kylin.rest.controller.CubeController.build(CubeController.java:343) at sun.reflect.GeneratedMethodAccessor210.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970) at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:653) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846) at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:215) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:494) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:1025) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1137) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.apache.kylin.rest.controller.CubeController.checkBuildingSegment(CubeController.java:984) at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:393) ... 77 more 2019-03-25 lk_hadoop
