Metadata inconsistent means metadata is in invalid state. Though Cube building passes, query still expose the error. Please modify Cube description from Web UI and try again as rowkey reordering is easy there.
________________________________ 发件人: Shailesh Prajapati <shail...@infoworks.io> 发送时间: 2017年4月4日 18:03:31 收件人: dev@kylin.apache.org 主题: Re: Cube query failing on changing rowkeys column order Yes, the cube description was edited and it built successfully. Can you elaborate on what you mean by metadata being inconsistent? On Tue, Apr 4, 2017 at 3:23 PM, Li Yang <liy...@apache.org> wrote: > From the error log, the cube metadata seems inconsistent. Was the cube JSON > manually edited? > > On Tue, Apr 4, 2017 at 5:32 PM, Shailesh Prajapati <shail...@infoworks.io> > wrote: > > > Thanks for the reply. Its just not about query performance, my queries > are > > not working. I am actually trying with only 50 fact rows. As per my > > understanding, query should not fail with any order of rowkeys. > > > > On Tue, Apr 4, 2017 at 2:46 PM, Alberto Ramón <a.ramonporto...@gmail.com > > > > wrote: > > > > > hello, from http://kylin.apache.org/docs16/tutorial/create_cube.html > > > > > > "You can drag & drop a dimension column to adjust its position in > rowkey; > > > Put the mandantory dimension at the begining, then followed the > > dimensions > > > that heavily involved in filters (where condition). Put high > cardinality > > > dimensions ahead of low cardinality dimensions." > > > > > > Other way to improve query performance is use AGG > > > > > > Good Luck !! > > > > > > > > > > > > 2017-04-04 10:01 GMT+01:00 Shailesh Prajapati <shail...@infoworks.io>: > > > > > > > Hi, > > > > > > > > I am using kylin 1.6 and facing a wired issue with Cube description. > > > > Basically, I have two Cube desc having same dimensions, measures, > > > rowkeys, > > > > aggregation groups. The only difference is the ordering of keys in > > them. > > > > With first cube description, my queries are working and with second i > > am > > > > getting following exception: > > > > > > > > > > > > java.sql.SQLException: Error while executing SQL "SELECT > > > > sum(ss_ext_sales_price) total_sales, > > > > sum(ss_ext_discount_amt) total_discount, > > > > s_store_id, > > > > s_store_name > > > > FROM > > > > store_sales > > > > LEFT JOIN store > > > > ON (store_sales.ss_store_sk = store.s_store_sk) > > > > GROUP BY > > > > s_store_id, > > > > s_store_name > > > > ORDER BY > > > > total_sales, > > > > total_discount, > > > > s_store_id, > > > > s_store_name > > > > LIMIT 50000": null > > > > at org.apache.calcite.avatica.Helper.createException(Helper. > > > > java:56) > > > > at org.apache.calcite.avatica.Helper.createException(Helper. > > > > java:41) > > > > at org.apache.calcite.avatica.AvaticaStatement. > > executeInternal( > > > > AvaticaStatement.java:147) > > > > at org.apache.calcite.avatica.AvaticaStatement.executeQuery( > > > > AvaticaStatement.java:208) > > > > at org.apache.kylin.rest.service.QueryService.execute( > > > > QueryService.java:538) > > > > at org.apache.kylin.rest.service.QueryService. > > > queryWithSqlMassage( > > > > QueryService.java:452) > > > > at org.apache.kylin.rest.service.QueryService.query( > > > > QueryService.java:151) > > > > at org.apache.kylin.rest.service. > > QueryService.doQueryWithCache( > > > > QueryService.java:354) > > > > at org.apache.kylin.rest.controller.QueryController. > > > > query(QueryController.java:69) > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > > > > at sun.reflect.NativeMethodAccessorImpl.invoke( > > > > NativeMethodAccessorImpl.java:62) > > > > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > > > > DelegatingMethodAccessorImpl.java:43) > > > > at java.lang.reflect.Method.invoke(Method.java:498) > > > > at org.springframework.web.method.support. > > > InvocableHandlerMethod. > > > > doInvoke(InvocableHandlerMethod.java:221) > > > > at org.springframework.web.method.support. > > > InvocableHandlerMethod. > > > > invokeForRequest(InvocableHandlerMethod.java:136) > > > > at org.springframework.web.servlet.mvc.method.annotation. > > > > ServletInvocableHandlerMethod.invokeAndHandle( > > > > ServletInvocableHandlerMethod. > > > > java:104) > > > > at org.springframework.web.servlet.mvc.method.annotation. > > > > RequestMappingHandlerAdapter.invokeHandleMethod( > > > > RequestMappingHandlerAdapter.java:743) > > > > at org.springframework.web.servlet.mvc.method.annotation. > > > > RequestMappingHandlerAdapter.handleInternal( > > > RequestMappingHandlerAdapter. > > > > java:672) > > > > at org.springframework.web.servlet.mvc.method. > > > > AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter. > > > java:82) > > > > at org.springframework.web.servlet.DispatcherServlet. > > > > doDispatch(DispatcherServlet.java:933) > > > > at org.springframework.web.servlet.DispatcherServlet. > > > > doService(DispatcherServlet.java:867) > > > > at org.springframework.web.servlet.FrameworkServlet. > > > > processRequest( > > > > FrameworkServlet.java:951) > > > > at org.springframework.web.servlet.FrameworkServlet. > > > > doPost(FrameworkServlet.java:853) > > > > at javax.servlet.http.HttpServlet.service( > > HttpServlet.java:650) > > > > at org.springframework.web.servlet.FrameworkServlet. > > > > service(FrameworkServlet.java:827) > > > > at javax.servlet.http.HttpServlet.service( > > HttpServlet.java:731) > > > > at org.apache.catalina.core.ApplicationFilterChain. > > > > internalDoFilter( > > > > ApplicationFilterChain.java:303) > > > > at org.apache.catalina.core.ApplicationFilterChain.doFilter( > > > > ApplicationFilterChain.java:208) > > > > at org.apache.tomcat.websocket.server.WsFilter.doFilter( > > > > WsFilter.java:52) > > > > at org.apache.catalina.core.ApplicationFilterChain. > > > > internalDoFilter( > > > > ApplicationFilterChain.java:241) > > > > at org.apache.catalina.core.ApplicationFilterChain.doFilter( > > > > ApplicationFilterChain.java:208) > > > > at org.springframework.security.web.FilterChainProxy$ > > > > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > > > > at org.springframework.security.web.access.intercept. > > > > FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) > > > > at org.springframework.security.web.access.intercept. > > > > FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor. > java:84) > > > > at org.springframework.security.web.FilterChainProxy$ > > > > VirtualFilterChain.doFilter(FilterChainProxy.java:342) > > > > at org.springframework.security.web.access. > > > > ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter. > > java:113) > > > > at org.springframework.security.web.FilterChainProxy$ > > > > VirtualFilterChain.doFilter(FilterChainProxy.java:342) > > > > at org.springframework.security.web.authentication. > > > > AnonymousAuthenticationFilter.doFilter( > AnonymousAuthenticationFilter. > > > > java:113) > > > > at org.springframework.security.web.FilterChainProxy$ > > > > VirtualFilterChain.doFilter(FilterChainProxy.java:342) > > > > at org.springframework.security.web.servletapi. > > > > SecurityContextHolderAwareRequestFilter.doFilter( > > > > SecurityContextHolderAwareRequestFilter.java:54) > > > > at org.springframework.security.web.FilterChainProxy$ > > > > VirtualFilterChain.doFilter(FilterChainProxy.java:342) > > > > at io.infoworks.security.jwt.JwtAuthenticationTokenFilter. > > > > successfulAuthentication(JwtAuthenticationTokenFilter.java:64) > > > > at org.springframework.security.web.authentication. > > > > AbstractAuthenticationProcessingFilter.doFilter( > > > > AbstractAuthenticationProcessingFilter.java:219) > > > > at org.springframework.security.web.FilterChainProxy$ > > > > VirtualFilterChain.doFilter(FilterChainProxy.java:342) > > > > at org.springframework.security.web.context. > > > > SecurityContextPersistenceFilter.doFilter( > > SecurityContextPersistenceFilt > > > > er.java:87) > > > > at org.springframework.security.web.FilterChainProxy$ > > > > VirtualFilterChain.doFilter(FilterChainProxy.java:342) > > > > at org.springframework.security.web.FilterChainProxy. > > > > doFilterInternal(FilterChainProxy.java:192) > > > > at org.springframework.security. > web.FilterChainProxy.doFilter( > > > > FilterChainProxy.java:160) > > > > at org.springframework.web.filter.DelegatingFilterProxy. > > > > invokeDelegate(DelegatingFilterProxy.java:343) > > > > at org.springframework.web.filter.DelegatingFilterProxy. > > > doFilter( > > > > DelegatingFilterProxy.java:260) > > > > at org.apache.catalina.core.ApplicationFilterChain. > > > > internalDoFilter( > > > > ApplicationFilterChain.java:241) > > > > at org.apache.catalina.core.ApplicationFilterChain.doFilter( > > > > ApplicationFilterChain.java:208) > > > > at com.thetransactioncompany.cors.CORSFilter.doFilter( > > > > CORSFilter.java:209) > > > > at com.thetransactioncompany.cors.CORSFilter.doFilter( > > > > CORSFilter.java:244) > > > > at org.apache.catalina.core.ApplicationFilterChain. > > > > internalDoFilter( > > > > ApplicationFilterChain.java:241) > > > > at org.apache.catalina.core.ApplicationFilterChain.doFilter( > > > > ApplicationFilterChain.java:208) > > > > at org.apache.catalina.core.StandardWrapperValve.invoke( > > > > StandardWrapperValve.java:220) > > > > at org.apache.catalina.core.StandardContextValve.invoke( > > > > StandardContextValve.java:122) > > > > at org.apache.catalina.authenticator. > AuthenticatorBase.invoke( > > > > AuthenticatorBase.java:505) > > > > at org.apache.catalina.core.StandardHostValve.invoke( > > > > StandardHostValve.java:169) > > > > at org.apache.catalina.valves.ErrorReportValve.invoke( > > > > ErrorReportValve.java:103) > > > > at org.apache.catalina.valves.AccessLogValve.invoke( > > > > AccessLogValve.java:956) > > > > at org.apache.catalina.core.StandardEngineValve.invoke( > > > > StandardEngineValve.java:116) > > > > at org.apache.catalina.connector.CoyoteAdapter.service( > > > > CoyoteAdapter.java:436) > > > > at org.apache.coyote.http11.AbstractHttp11Processor.process( > > > > AbstractHttp11Processor.java:1078) > > > > at org.apache.coyote.AbstractProtocol$ > > AbstractConnectionHandler. > > > > process(AbstractProtocol.java:625) > > > > at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor. > > > > run(JIoEndpoint.java:316) > > > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > > > > ThreadPoolExecutor.java:1142) > > > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > > > > ThreadPoolExecutor.java:617) > > > > at org.apache.tomcat.util.threads.TaskThread$ > > > WrappingRunnable.run( > > > > TaskThread.java:61) > > > > at java.lang.Thread.run(Thread.java:745) > > > > Caused by: java.lang.IllegalStateException > > > > at org.apache.kylin.gridtable.GTInfo.validateColumnBlocks( > > > > GTInfo.java:198) > > > > at org.apache.kylin.gridtable.GTInfo.validate(GTInfo.java: > 167) > > > > at org.apache.kylin.gridtable.GTInfo$Builder.build(GTInfo. > > > > java:269) > > > > at org.apache.kylin.cube.gridtable.CubeGridTable. > > > > newGTInfo(CubeGridTable.java:53) > > > > at org.apache.kylin.cube.gridtable.CubeGridTable. > > > > newGTInfo(CubeGridTable.java:36) > > > > at org.apache.kylin.storage.gtrecord.CubeScanRangePlanner. > > > > <init>(CubeScanRangePlanner.java:88) > > > > at org.apache.kylin.storage.gtrecord.CubeSegmentScanner.< > > > > init>(CubeSegmentScanner.java:74) > > > > at org.apache.kylin.storage.gtrecord. > > > > GTCubeStorageQueryBase.search( > > > > GTCubeStorageQueryBase.java:130) > > > > at org.apache.kylin.query.enumerator.OLAPEnumerator. > > > > queryStorage(OLAPEnumerator.java:114) > > > > at org.apache.kylin.query.enumerator.OLAPEnumerator. > > > > moveNext(OLAPEnumerator.java:65) > > > > at Baz$1$1.moveNext(Unknown Source) > > > > at org.apache.calcite.linq4j.EnumerableDefaults.groupBy_( > > > > EnumerableDefaults.java:823) > > > > at org.apache.calcite.linq4j.EnumerableDefaults.groupBy( > > > > EnumerableDefaults.java:758) > > > > at org.apache.calcite.linq4j.DefaultEnumerable.groupBy( > > > > DefaultEnumerable.java:302) > > > > at Baz.bind(Unknown Source) > > > > at org.apache.calcite.jdbc.CalcitePrepare$ > > > > CalciteSignature.enumerable(CalcitePrepare.java:327) > > > > at org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable( > > > > CalciteConnectionImpl.java:282) > > > > at org.apache.calcite.jdbc.CalciteMetaImpl._createIterable( > > > > CalciteMetaImpl.java:553) > > > > at org.apache.calcite.jdbc.CalciteMetaImpl.createIterable( > > > > CalciteMetaImpl.java:544) > > > > at org.apache.calcite.avatica.AvaticaResultSet.execute( > > > > AvaticaResultSet.java:187) > > > > at org.apache.calcite.jdbc.CalciteResultSet.execute( > > > > CalciteResultSet.java:65) > > > > at org.apache.calcite.jdbc.CalciteResultSet.execute( > > > > CalciteResultSet.java:44) > > > > at org.apache.calcite.avatica.AvaticaConnection$1.execute( > > > > AvaticaConnection.java:605) > > > > at org.apache.calcite.jdbc.CalciteMetaImpl. > prepareAndExecute( > > > > CalciteMetaImpl.java:599) > > > > at org.apache.calcite.avatica.AvaticaConnection. > > > > prepareAndExecuteInternal(AvaticaConnection.java:613) > > > > at org.apache.calcite.avatica.AvaticaStatement. > > executeInternal( > > > > AvaticaStatement.java:139) > > > > ... 68 more > > > > > > > > > > > > *cube desc 1: * > > > > https://gist.github.com/shaipraj/a09991ad1599bca5f43b38c5565dbebe > > > > *cube desc 2: * > > > > https://gist.github.com/shaipraj/527cec8f03d55234c63d80b06353b7de > > > > > > > > > > > > When i reordered the rowkeys in cube desc 2, my queries worked. My > > > > question, are these rowkeys needs to be in order? if yes then on what > > > > basis? and if not then what this exception is about? > > > > > > > > > > > > Thanks > > > > > > > > > > > > > > > -- > > Shailesh > > > -- Shailesh
