Re: build cube时遇到 Failed to parse hive conf file

2017-03-27 Thread ShaoFeng Shi 
Check whether the $KYLIN_HOME/conf/kylin_hive_conf.xml is a well formatted
XML file. If it is invalid, such exception will be thrown.

2017-03-27 7:51 GMT+08:00 35925138 <35925...@qq.com>:

> log如下：
> 2017-03-22 09:07:32,081 ERROR [http-bio-7070-exec-8]
> controller.CubeController:298 : Failed to parse hive con
> f file
> java.lang.RuntimeException: Failed to parse hive conf file
> at org.apache.kylin.job.JoinedFlatTable.generateHiveSetStatements(
> JoinedFlatTable.java:76)
> at org.apache.kylin.source.hive.HiveMRInput$BatchCubingInputSide.
> createFlatHiveTableStep(HiveMRInput.
> java:236)
> at org.apache.kylin.source.hive.HiveMRInput$BatchCubingInputSide.
> addStepPhase1_CreateFlatTable(HiveMR
> Input.java:140)
> at org.apache.kylin.engine.mr.BatchCubingJobBuilder2.build(
> BatchCubingJobBuilder2.java:58)
> at org.apache.kylin.engine.mr.MRBatchCubingEngine2.
> createBatchCubingJob(MRBatchCubingEngine2.java:42)
> at org.apache.kylin.engine.EngineFactory.createBatchCubingJob(
> EngineFactory.java:55)
> at org.apache.kylin.rest.service.JobService.submitJob(
> JobService.java:218)
> at org.apache.kylin.rest.service.JobService$$
> FastClassBySpringCGLIB$$83a44b2a.invoke()
> at org.springframework.cglib.proxy.MethodProxy.invoke(
> MethodProxy.java:204)
> at org.springframework.aop.framework.CglibAopProxy$
> CglibMethodInvocation.invokeJoinpoint(CglibAopProx
> y.java:700)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.ja
> va:150)
>
>   at org.springframework.aop.framework.CglibAopProxy$
> DynamicAdvisedInterceptor.intercept(CglibAopProxy.
> java:633)
> at org.apache.kylin.rest.service.JobService$$
> EnhancerBySpringCGLIB$$a48c500a.submitJob()
> at org.apache.kylin.rest.controller.CubeController.
> buildInternal(CubeController.java:295)
> at org.apache.kylin.rest.controller.CubeController.
> rebuild(CubeController.java:273)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.springframework.web.method.support.InvocableHandlerMethod.
> doInvoke(InvocableHandlerMethod.java
> :221)
> at org.springframework.web.method.support.InvocableHandlerMethod.
> invokeForRequest(InvocableHandlerMet
> hod.java:136)
> at org.springframework.web.servlet.mvc.method.annotation.
> ServletInvocableHandlerMethod.invokeAndHandl
> e(ServletInvocableHandlerMethod.java:104)
> at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.invokeHandleMet
> hod(RequestMappingHandlerAdapter.java:743)
> at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.handleInternal(
> RequestMappingHandlerAdapter.java:672)
> at org.springframework.web.servlet.mvc.method.
> AbstractHandlerMethodAdapter.handle(AbstractHandlerMeth
> odAdapter.java:82)
> at org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:933)
> at org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:867)
> at org.springframework.web.servlet.FrameworkServlet.
> processRequest(FrameworkServlet.java:951)
> at org.springframework.web.servlet.FrameworkServlet.
> doPut(FrameworkServlet.java:864)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:653)
> at org.springframework.web.servlet.FrameworkServlet.
> service(FrameworkServlet.java:827)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:303)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
> at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
> at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
> at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.jav
> a:330)
> at org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.invoke(FilterSecurityI
> nterceptor.java:118)
> at org.springfram

?????? build cube?????? Failed to parse hive conf file

2017-03-26 Thread 35925138 
log??
2017-03-22 09:07:32,081 ERROR [http-bio-7070-exec-8] 
controller.CubeController:298 : Failed to parse hive con
f file
java.lang.RuntimeException: Failed to parse hive conf file
at 
org.apache.kylin.job.JoinedFlatTable.generateHiveSetStatements(JoinedFlatTable.java:76)
at 
org.apache.kylin.source.hive.HiveMRInput$BatchCubingInputSide.createFlatHiveTableStep(HiveMRInput.
java:236)
at 
org.apache.kylin.source.hive.HiveMRInput$BatchCubingInputSide.addStepPhase1_CreateFlatTable(HiveMR
Input.java:140)
at 
org.apache.kylin.engine.mr.BatchCubingJobBuilder2.build(BatchCubingJobBuilder2.java:58)
at 
org.apache.kylin.engine.mr.MRBatchCubingEngine2.createBatchCubingJob(MRBatchCubingEngine2.java:42)
at 
org.apache.kylin.engine.EngineFactory.createBatchCubingJob(EngineFactory.java:55)
at 
org.apache.kylin.rest.service.JobService.submitJob(JobService.java:218)
at 
org.apache.kylin.rest.service.JobService$$FastClassBySpringCGLIB$$83a44b2a.invoke()
at 
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at 
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProx
y.java:700)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.ja
va:150)

  at 
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.
java:633)
at 
org.apache.kylin.rest.service.JobService$$EnhancerBySpringCGLIB$$a48c500a.submitJob()
at 
org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:295)
at 
org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:273)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java
:221)
at 
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMet
hod.java:136)
at 
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandl
e(ServletInvocableHandlerMethod.java:104)
at 
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMet
hod(RequestMappingHandlerAdapter.java:743)
at 
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(
RequestMappingHandlerAdapter.java:672)
at 
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMeth
odAdapter.java:82)
at 
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933)
at 
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)
at 
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951)
at 
org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:864)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:653)
at 
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.jav
a:330)
at 
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityI
nterceptor.java:118)
at 
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurit
yInterceptor.java:84)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.jav
a:342)
at 
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFi
lter.java:113)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.jav
a:342)
at 
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.
java:103)
at 
org.springframework.security.web.FilterChainProxy

Re: build cube时遇到 Failed to parse hive conf file

2017-03-24 Thread Li Yang 
Do you have a stacktrace when "Failed to parse hive conf file" happens? It
sounds like a bug, but we need the detailed logs to hunt down the root
cause.

Cheers
Yang

2017-03-22 11:04 GMT+08:00 35925138 <35925...@qq.com>:

> 你好dev:
> 我建立好cube后，进行build，遇到Failed to parse hive conf file这个错误，
> 再次build，就提示我 Segments overlap: user_a
> ction[20170301010500_20170322183000] and user_action[20170301010500_
> 20170322183000]
>
>
> 可是我是初次build，不应该会有重复的segment吧，而且我看了一下，这两个segment是同一个，
> kylin版本是1.5.4
> hive版本是1.2.1

Re: 遇到Failed to parse hive conf file这个错误

2017-03-23 Thread ShaoFeng Shi 
hi, what's the detail error of "Failed to parse hive conf file"? did you
identify the root cause of this error?

Besides, please discard the error job before submitting a new job for the
same time range. When discard a job, its associated segment will be dropped
automatically.

在 2017年3月23日 下午4:24，35925138 <35925...@qq.com>写道：

> 你好dev:
> 我建立好cube后，进行build，遇到Failed to parse hive conf file这个错误，
> 再次build，就提示我 Segments overlap: user_a
> ction[20170301010500_20170322183000] and user_action[20170301010500_
> 20170322183000]
>
>
> 可是我是初次build，不应该会有重复的segment吧，而且我看了一下，这两个segment是同一个，
> kylin版本是1.5.4
> hive版本是1.2.1




-- 
Best regards,

Shaofeng Shi 史少锋

????Failed to parse hive conf file????????

2017-03-23 Thread 35925138 
dev:
cubebuild??Failed to parse hive conf file??
build?? Segments overlap: user_a
ction[20170301010500_20170322183000] and 
user_action[20170301010500_20170322183000]


build??segment??segment??
kylin??1.5.4
hive??1.2.1

build cube?????? Failed to parse hive conf file

2017-03-21 Thread 35925138 
dev:
cubebuild??Failed to parse hive conf file??
build?? Segments overlap: user_a
ction[20170301010500_20170322183000] and 
user_action[20170301010500_20170322183000]


build??segment??segment??
kylin??1.5.4
hive??1.2.1