Hi Billy:

Thanks for your suggest, I will try it. Hope can response good news.

2018-03-27 9:11 GMT+08:00 Billy Liu <[email protected]>:

> For the first question, it seems some classpath conflict issue
> existing there "NoSuchMethodError", try google "HiveMetaStoreClient
> NoSuchMethodError"
>
> For the second question, to enable the dashboard, please follow the
> http://kylin.apache.org/docs23/howto/howto_setup_systemcube.html
> first.
>
> With Warm regards
>
> Billy Liu
>
>
> 2018-03-26 17:59 GMT+08:00 凡梦星尘 <[email protected]>:
> > Hi guys:
> >
> > Congratulation  to Kylin release 2.3.0 with so many features.
> >
> > The last weekend I had try to upgrade this newest version to test ENV.
> All
> > things going is good and run well sample cube under MR mode. But when I
> try
> > to switch Spark mode not success. After fixed some problems that meet a
> > hard trouble not fixed. The error log see below:
> >
> > java.lang.RuntimeException: java.io.IOException:
> > com.google.common.util.concurrent.UncheckedExecutionException:
> > java.lang.RuntimeException: Unable to instantiate
> > org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient
> >         at org.apache.kylin.source.hive.HiveMRInput$
> HiveTableInputFormat.configureJob(HiveMRInput.java:116)
> >         at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> setupMapper(FactDistinctColumnsJob.java:121)
> >         at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:99)
> >         at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:130)
> >         at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:162)
> >         at org.apache.kylin.job.execution.DefaultChainedExecutable.
> doWork(DefaultChainedExecutable.java:67)
> >         at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:162)
> >         at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:300)
> >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
> >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
> >         at java.lang.Thread.run(Thread.java:748)
> > Caused by: java.io.IOException:
> > com.google.common.util.concurrent.UncheckedExecutionException:
> > java.lang.RuntimeException: Unable to instantiate
> > org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient
> >         at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:97)
> >         at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:51)
> >         at org.apache.kylin.source.hive.HiveMRInput$
> HiveTableInputFormat.configureJob(HiveMRInput.java:113)
> >         ... 10 more
> > Caused by: com.google.common.util.concurrent.
> UncheckedExecutionException:
> > java.lang.RuntimeException: Unable to instantiate
> > org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient
> >         at com.google.common.cache.LocalCache$Segment.get(
> LocalCache.java:2256)
> >         at com.google.common.cache.LocalCache.get(LocalCache.java:3985)
> >         at com.google.common.cache.LocalCache$LocalManualCache.
> get(LocalCache.java:4788)
> >         at org.apache.hive.hcatalog.common.HiveClientCache.
> getOrCreate(HiveClientCache.java:292)
> >         at org.apache.hive.hcatalog.common.HiveClientCache.get(
> HiveClientCache.java:267)
> >         at org.apache.hive.hcatalog.common.HCatUtil.
> getHiveMetastoreClient(HCatUtil.java:558)
> >         at org.apache.hive.hcatalog.mapreduce.InitializeInput.
> getInputJobInfo(InitializeInput.java:104)
> >         at org.apache.hive.hcatalog.mapreduce.InitializeInput.
> setInput(InitializeInput.java:88)
> >         at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:95)
> >         ... 12 more
> > Caused by: java.lang.RuntimeException: Unable to instantiate
> > org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient
> >         at org.apache.hadoop.hive.metastore.MetaStoreUtils.
> newInstance(MetaStoreUtils.java:1566)
> >         at org.apache.hadoop.hive.metastore.
> RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:92)
> >         at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.
> getProxy(RetryingMetaStoreClient.java:138)
> >         at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.
> getProxy(RetryingMetaStoreClient.java:124)
> >         at org.apache.hive.hcatalog.common.HiveClientCache$5.call(
> HiveClientCache.java:297)
> >         at org.apache.hive.hcatalog.common.HiveClientCache$5.call(
> HiveClientCache.java:292)
> >         at com.google.common.cache.LocalCache$LocalManualCache$1.
> load(LocalCache.java:4791)
> >         at com.google.common.cache.LocalCache$LoadingValueReference.
> loadFuture(LocalCache.java:3584)
> >         at com.google.common.cache.LocalCache$Segment.loadSync(
> LocalCache.java:2372)
> >         at com.google.common.cache.LocalCache$Segment.
> lockedGetOrLoad(LocalCache.java:2335)
> >         at com.google.common.cache.LocalCache$Segment.get(
> LocalCache.java:2250)
> >         ... 20 more
> > Caused by: java.lang.reflect.InvocationTargetException
> >         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> >         at sun.reflect.NativeConstructorAccessorImpl.newInstance(
> NativeConstructorAccessorImpl.java:62)
> >         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> DelegatingConstructorAccessorImpl.java:45)
> >         at java.lang.reflect.Constructor.newInstance(Constructor.java:
> 423)
> >         at org.apache.hadoop.hive.metastore.MetaStoreUtils.
> newInstance(MetaStoreUtils.java:1564)
> >         ... 30 more
> > Caused by: java.lang.NoSuchMethodError:
> > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.
> <init>(Lorg/apache/hadoop/hive/conf/HiveConf;Lorg/
> apache/hadoop/hive/metastore/HiveMetaHookLoader;Ljava/lang/Boolean;)V
> >         at org.apache.hive.hcatalog.common.HiveClientCache$
> CacheableHiveMetaStoreClient.<init>(HiveClientCache.java:409)
> >         ... 35 more
> >
> > result code:2
> >
> >
> > At first time I had research some likely issues on forum but there not
> same
> > with me. Also try used the resolve ways but still not work. So someone
> can
> > give me more useful suggest.
> >
> > Thanks.
> >
> >
> > PS:
> >
> > 1. Hadoop ENV screenshot photo:
> >
> > http://77l54p.com1.z0.glb.clouddn.com/hdp_stack_versions_2.6.4.png-alias
> >
> > 2. Other errors about dashboard page action, detail info see below logs:
> >
> > 2018-03-26 17:44:32,580 INFO  [Query
> > 89e44f1b-5636-4c4b-98cb-423237effe81-49] service.QueryService:428 :
> > Using project: KYLIN_SYSTEM
> > 2018-03-26 17:44:32,585 INFO  [Query
> > 89e44f1b-5636-4c4b-98cb-423237effe81-49] service.QueryService:429 :
> > The original query:  select
> > count(*),sum(QUERY_TIME_COST)/(count(QUERY_TIME_COST)),max(
> QUERY_TIME_COST),min(QUERY_TIME_COST)
> > from KYLIN.HIVE_METRICS_QUERY_QA where KDAY_DATE >= '2018-03-19' and
> > KDAY_DATE <= '2018-03-25' and PROJECT ='LEARN_KYLIN' and EXCEPTION =
> > 'NULL'
> > 2018-03-26 17:44:32,583 ERROR [http-bio-7070-exec-5]
> > controller.BasicController:61 :
> > java.lang.NullPointerException
> >         at org.apache.kylin.rest.util.QueryRequestLimits.<init>(
> QueryRequestLimits.java:107)
> >         at org.apache.kylin.rest.service.QueryService.doQueryWithCache(
> QueryService.java:454)
> >         at org.apache.kylin.rest.service.QueryService.doQueryWithCache(
> QueryService.java:390)
> >         at org.apache.kylin.rest.controller.DashboardController.
> getChartData(DashboardController.java:111)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> >         at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:498)
> >         at org.springframework.web.method.support.
> InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
> >         at org.springframework.web.method.support.
> InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
> >         at org.springframework.web.servlet.mvc.method.annotation.
> ServletInvocableHandlerMethod.invokeAndHandle(
> ServletInvocableHandlerMethod.java:97)
> >         at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.invokeHandlerMethod(
> RequestMappingHandlerAdapter.java:827)
> >         at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.
> java:738)
> >         at org.springframework.web.servlet.mvc.method.
> AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
> >         at org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:967)
> >         at org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:901)
> >                 at org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:967)
> >         at org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:901)
> >         at org.springframework.web.servlet.FrameworkServlet.
> processRequest(FrameworkServlet.java:970)
> >         at org.springframework.web.servlet.FrameworkServlet.
> doGet(FrameworkServlet.java:861)
> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:624)
> >         at org.springframework.web.servlet.FrameworkServlet.
> service(FrameworkServlet.java:846)
> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> >         at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:303)
> >         at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
> >         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
> >         at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
> >         at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:317)
> >         at org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
> >         at org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.access.
> ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.session.
> SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.authentication.
> AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.
> java:111)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.servletapi.
> SecurityContextHolderAwareRequestFilter.doFilter(
> SecurityContextHolderAwareRequestFilter.java:170)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.savedrequest.
> RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.authentication.www.
> BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.
> java:158)
> >         at org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.authentication.
> AbstractAuthenticationProcessingFilter.doFilter(
> AbstractAuthenticationProcessingFilter.java:200)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.authentication.logout.
> LogoutFilter.doFilter(LogoutFilter.java:116)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.header.HeaderWriterFilter.
> doFilterInternal(HeaderWriterFilter.java:64)
> >
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.header.HeaderWriterFilter.
> doFilterInternal(HeaderWriterFilter.java:64)
> >         at org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.context.request.async.
> WebAsyncManagerIntegrationFilter.doFilterInternal(
> WebAsyncManagerIntegrationFilter.java:56)
> >         at org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.context.
> SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilt
> er.java:105)
> >         at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> >         at org.springframework.security.web.FilterChainProxy.
> doFilterInternal(FilterChainProxy.java:214)
> >         at org.springframework.security.web.FilterChainProxy.doFilter(
> FilterChainProxy.java:177)
> >         at org.springframework.web.filter.DelegatingFilterProxy.
> invokeDelegate(DelegatingFilterProxy.java:346)
> >         at org.springframework.web.filter.DelegatingFilterProxy.
> doFilter(DelegatingFilterProxy.java:262)
> >         at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
> >         at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
> >         at com.thetransactioncompany.cors.CORSFilter.doFilter(
> CORSFilter.java:209)
> >         at com.thetransactioncompany.cors.CORSFilter.doFilter(
> CORSFilter.java:244)
> >         at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
> >         at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
> >         at org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:219)
> >         at org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:110)
> >         at org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:169)
> >         at org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:103)
> >         at org.apache.catalina.valves.AccessLogValve.invoke(
> AccessLogValve.java:962)
> >         at org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:116)
> >         at org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:445)
> >         at org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1115)
> >         at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:637)
> >         at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.
> run(JIoEndpoint.java:316)
> >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
> >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
> >         at org.apache.tomcat.util.threads.TaskThread$
> WrappingRunnable.run(TaskThread.java:61)
> >         at java.lang.Thread.run(Thread.java:748)
>

Reply via email to