from the source code to find the problem that need more logs. may be the error is from QueryService.query
2016-08-16 langren_qing 发件人:沙漠火狐 [via Apache Kylin] <[email protected]> 发送时间:2016-08-15 10:33 主题:Fail to query the very long SQL with Kylin1.5.3 收件人:"echo"<[email protected]> 抄送: Hi I got a error when I execute the very long sql, but I cut short the sql, it can query succsess. The kylin version is 1.5.3 for CDH5.7. The SQL is : select DIM_SITE.SITE_ID as c0, dim_page_entrance.PAGE_ID as c1, DIM_SHOP.SHOP_ID as c2, DIM_DATE.DATE_ID as c3, DIM_GOODS_TYPE.GOODS_TYPE_ID as c4, sum(sale.DETL_PAGE_PV) as m0, count(distinct sale.GU_ID) as m1 from FCT_ORDR_PATH_OLAP as sale join DIM_SITE as DIM_SITE on sale.SITE_ID = DIM_SITE.SITE_ID join DIM_PAGE as dim_page_entrance on sale.LAST_ENTRANCE_PAGE_ID = dim_page_entrance.PAGE_ID join DIM_SHOP as DIM_SHOP on sale.SHOP_ID = DIM_SHOP.SHOP_ID join DIM_DATE as DIM_DATE on sale.DATE_ID = DIM_DATE.DATE_ID join DIM_GOODS_TYPE as DIM_GOODS_TYPE on sale.GOODS_TYPE_ID = DIM_GOODS_TYPE.GOODS_TYPE_ID where DIM_SITE.SITE_ID in (1, 2) and dim_page_entrance.PAGE_ID in (-1, 1, 17, 33, 35, 36, 37, 38, 39, 40, 41, 42, 43, 45, 46, 47, 48, 49, 54, 63, 66, 133, 135, 177, 178, 179, 189, 219, 221, 222, 223, 224, 225, 226, 228, 229, 230, 233, 234, 235, 236, 254, 268, 279, 280, 316, 317, 318, 319, 320, 321, 322, 323, 324, 10002, 10006, 10012, 10013, 10014, 10015, 10016, 10017, 10018, 10020, 10040, 10041, 10058, 10059, 10060, 10062, 10063, 10065, 10066, 10067, 10068) and DIM_SHOP.SHOP_ID in (83, 104, 207, 360, 417, 450, 502, 618, 634, 655, 779, 829, 872, 896, 984, 1012, 1056, 1063, 1079, 1098, 1179, 1221, 1233, 1237, 1238, 1264, 1332, 1366, 1384, 1530, 1532, 1544, 1566, 1593, 1597, 1600, 1601, 1605, 1614, 1647, 1709, 1732, 1735, 1765, 1776, 1796, 1840, 1867, 1875, 1900, 1936, 1946, 1948, 1952, 1956, 1957, 1958, 1959, 1961, 1964, 1978, 1979, 1981, 1984, 1989, 1991, 2092, 2165, 2221, 2256, 2341, 2352, 2394, 2424, 2540, 2563, 2597, 2619, 2642, 2654, 2670, 2684, 2705, 2715, 2781, 2786, 2828, 2880, 2909, 2958, 2970, 3007, 3054, 3062, 3089, 3141, 3151, 3208, 3230, 3295, 3305, 3386, 3388, 3416, 3551, 3721, 3750, 3775, 3819, 3855, 3905, 3931, 3998, 4010, 4013, 4014, 4221, 4235, 4255, 4260, 4275, 4287, 4291, 4310, 4311, 4341, 4344, 4352, 4358, 4369, 4381, 4382, 4385, 4387, 4389, 4393, 4413, 4415, 4417, 4418, 4419, 4421, 4425, 4426, 4427, 4431, 4434, 4436, 4454, 4459, 4480, 4523, 4599, 4713, 4717, 4913, 4949, 4962, 4998, 5067, 5078, 5097, 5176, 5199, 5287, 5342, 5423, 5450, 5484, 5535, 5549, 5551, 5607, 5617, 5630, 5676, 5685, 5759, 5863, 5912, 5958, 6009, 6014, 6020, 6024, 6045, 6164, 6265, 6297, 6360, 6364, 6367, 6447, 6451, 6466, 6486, 6529, 6565, 6594, 6597, 6648, 6726, 6732, 6758, 6833, 6919, 7001, 7039, 7043, 7069, 7118, 7128, 7134, 7137, 7188, 7189, 7216, 7221, 7273, 7284, 7310, 7376, 7436, 7451, 7553, 7611, 7641, 7650, 7670, 7737, 7747, 7767, 7771, 7878, 7978, 7999, 8019, 8028, 8066, 8119, 8129, 8151, 8195, 8229, 8234, 8324, 8396, 8519, 8538, 8553, 8668, 8741, 8750, 8764, 8780, 8782, 8891, 8978, 9039, 9067, 9155, 9234, 9246, 9258, 9301, 9326, 9357, 9379, 9429, 9469, 9483, 9488, 9513, 9539, 9703, 9709, 9755, 9758, 9770, 9837, 9881, 9987, 10159, 10165, 10193, 10240, 10348, 10373, 10401, 10496, 10516, 10552, 10570, 10605, 10656, 10707, 10719, 10724, 10733, 10787, 10803, 10869, 10920, 11052, 11079, 11134, 11142, 11209, 11327, 11332, 11450, 11488, 11578, 11586, 11615, 11726, 11772, 11785, 11830, 11909, 11911, 11939, 11957, 11970, 11997, 12043, 12058, 12097, 12283, 12345, 12367, 12500, 12569, 12609) and DIM_DATE.DATE_ID = '2016-07-02' and DIM_GOODS_TYPE.GOODS_TYPE_ID = 2 group by DIM_SITE.SITE_ID, dim_page_entrance.PAGE_ID, DIM_SHOP.SHOP_ID, DIM_DATE.DATE_ID, DIM_GOODS_TYPE.GOODS_TYPE_ID I cut short half the DIM_SHOP.SHOP_ID condition, it query sucessful. the Error I got is : ==========================[QUERY]=============================== 2016-08-15 09:47:37,382 ERROR [http-bio-7070-exec-2] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor171.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:650) at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:195) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:436) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1078) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:625) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:318) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) ---------------------------------------------------------------------------------------------------------------------- is there any configs to set let the query pass. thanks! If you reply to this email, your message will be added to the discussion below: http://apache-kylin.74782.x6.nabble.com/Fail-to-query-the-very-long-SQL-with-Kylin1-5-3-tp5567.html To start a new topic under Apache Kylin, email [email protected] To unsubscribe from Apache Kylin, click here. NAML -- View this message in context: http://apache-kylin.74782.x6.nabble.com/Fail-to-query-the-very-long-SQL-with-Kylin1-5-3-tp5567p5576.html Sent from the Apache Kylin mailing list archive at Nabble.com.
