Try "select count(*) from KYLIN_SALES" instead of "select * from
KYLIN_SALES".
Kylin answers aggregated queries, not detailed queries.
On Wed, May 9, 2018 at 2:55 PM, SUDIPTA PAUL <sdiptap...@gmail.com> wrote:
> Hi Kylin Team,
>
>
>
> I have tried both Kylin 2.3.1 and 2.3.0 on AWS EMR. I can build sample
> cubes – sales cube and stream cube but when running query on cube I am
> getting below error. Any help will be appreciated.
>
>
>
> org.apache.kylin.metadata.realization.NoRealizationFoundException: No
> model
> found for OLAPContext,
> CUBE_NOT_CONTAIN_ALL_COLUMN[1_2e7caa31:DEFAULT.KYLIN_SALES.SLR_SEGMENT_CD,
> 1_2e7caa31:DEFAULT.KYLIN_SALES.ITEM_COUNT],
> rel#0:OLAPTableScan.OLAP.[](table=[DEFAULT, KYLIN_SALES],ctx=,fields=[0,
> 1,
> 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14])
>
>
>
> Below details error log:
>
>
>
>
>
> 2018-05-09 06:14:56,721 DEBUG [http-bio-7070-exec-2]
> project.ProjectL2Cache:195 : Loading L2 project cache for learn_kylin
>
> 2018-05-09 06:14:56,721 WARN [http-bio-7070-exec-2]
> realization.RealizationRegistry:91 : No provider for realization type
> INVERTED_INDEX
>
> 2018-05-09 06:14:56,721 WARN [http-bio-7070-exec-2]
> realization.RealizationRegistry:91 : No provider for realization type
> INVERTED_INDEX
>
> 2018-05-09 06:15:08,577 DEBUG [http-bio-7070-exec-4]
> schema.OLAPSchemaFactory:123 : Adding new schema file
> olap_model_6144337688881197358.json to cache
>
> 2018-05-09 06:15:08,577 DEBUG [http-bio-7070-exec-4]
> schema.OLAPSchemaFactory:124 : Schema json: {
>
> "version": "1.0",
>
> "defaultSchema": "DEFAULT",
>
> "schemas": [
>
> {
>
> "type": "custom",
>
> "name": "DEFAULT",
>
> "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory",
>
> "operand": {
>
> "project": "learn_kylin"
>
> },
>
> "functions": [
>
> {
>
> name: 'PERCENTILE',
>
> className:
> 'org.apache.kylin.measure.percentile.PercentileAggFunc'
>
> },
>
> {
>
> name: 'CONCAT',
>
> className: 'org.apache.kylin.query.udf.ConcatUDF'
>
> },
>
> {
>
> name: 'MASSIN',
>
> className: 'org.apache.kylin.query.udf.MassInUDF'
>
> },
>
> {
>
> name: 'INTERSECT_COUNT',
>
> className:
> 'org.apache.kylin.measure.bitmap.BitmapIntersectDistinctCountAggFunc'
>
> },
>
> {
>
> name: 'VERSION',
>
> className: 'org.apache.kylin.query.udf.VersionUDF'
>
> },
>
> {
>
> name: 'PERCENTILE_APPROX',
>
> className:
> 'org.apache.kylin.measure.percentile.PercentileAggFunc'
>
> }
>
> ]
>
> }
>
> ]
>
> }
>
>
>
> 2018-05-09 06:15:15,653 INFO [Scheduler 1863658236 FetcherRunner-40]
> threadpool.DefaultScheduler:268 : Job Fetcher: 0 should running, 0 actual
> running, 0 stopped, 0 ready, 3 already succeed, 0 error, 0 discarded, 0
> others
>
> 2018-05-09 06:15:18,609 INFO [Idle-Rpc-Conn-Sweeper-pool2-t1]
> ipc.AbstractRpcClient:217 : Cleanup idle connection to
> ip-10-225-138-141.ec2.internal/10.225.138.141:16020
>
> 2018-05-09 06:15:26,353 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:428 : Using
> project: learn_kylin
>
> 2018-05-09 06:15:26,353 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:429 : The
> original query: select * from KYLIN_SALES
>
> 2018-05-09 06:15:26,401 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:646 : The
> corrected query: select * from KYLIN_SALES
>
> LIMIT 50000
>
> 2018-05-09 06:15:28,188 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] acl.TableACLManager:58 :
> Initializing TableACLManager with config kylin_metadata@hbase
>
> 2018-05-09 06:15:28,188 DEBUG [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] cachesync.CachedCrudAssist:118 :
> Reloading TableACL from
> kylin_metadata(key='/table_acl')@kylin_metadata@hbase
>
> 2018-05-09 06:15:28,191 DEBUG [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] cachesync.CachedCrudAssist:127 :
> Loaded 0 TableACL(s) out of 0 resource
>
> 2018-05-09 06:15:28,205 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] util.PushDownUtil:83 : Query
> failed to utilize pre-calculation, routing to other engines
>
> java.sql.SQLException: Error while executing SQL "select * from KYLIN_SALES
>
> LIMIT 50000": No model found for OLAPContext,
> CUBE_NOT_CONTAIN_ALL_COLUMN[1_2e7caa31:DEFAULT.KYLIN_SALES.SLR_SEGMENT_CD,
> 1_2e7caa31:DEFAULT.KYLIN_SALES.ITEM_COUNT],
> rel#0:OLAPTableScan.OLAP.[](table=[DEFAULT, KYLIN_SALES],ctx=,fields=[0,
> 1,
> 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14])
>
> at org.apache.calcite.avatica.Helper.createException(Helper.
> java:56)
>
> at org.apache.calcite.avatica.Helper.createException(Helper.
> java:41)
>
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(
> AvaticaStatement.java:156)
>
> at
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(
> AvaticaStatement.java:218)
>
> at
> org.apache.kylin.rest.service.QueryService.execute(QueryService.java:931)
>
> at
> org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(
> QueryService.java:661)
>
> at
> org.apache.kylin.rest.service.QueryService.query(QueryService.java:188)
>
> at
> org.apache.kylin.rest.service.QueryService.queryAndUpdateCache(
> QueryService.java:496)
>
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(
> QueryService.java:455)
>
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(
> QueryService.java:390)
>
> at
> org.apache.kylin.rest.controller.QueryController.
> query(QueryController.java:86)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:498)
>
> at
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(
> InvocableHandlerMethod.java:205)
>
> at
> org.springframework.web.method.support.InvocableHandlerMethod.
> invokeForRequest(InvocableHandlerMethod.java:133)
>
> at
> org.springframework.web.servlet.mvc.method.annotation.
> ServletInvocableHandlerMethod.invokeAndHandle(
> ServletInvocableHandlerMethod.java:97)
>
> at
> org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.invokeHandlerMethod(
> RequestMappingHandlerAdapter.java:827)
>
> at
> org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.
> java:738)
>
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.
> handle(AbstractHandlerMethodAdapter.java:85)
>
> at
> org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:967)
>
> at
> org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:901)
>
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(
> FrameworkServlet.java:970)
>
> at
> org.springframework.web.servlet.FrameworkServlet.
> doPost(FrameworkServlet.java:872)
>
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
>
> at
> org.springframework.web.servlet.FrameworkServlet.
> service(FrameworkServlet.java:846)
>
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
>
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:303)
>
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
>
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:241)
>
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:317)
>
> at
> org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
>
> at
> org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.access.ExceptionTranslationFilter.
> doFilter(ExceptionTranslationFilter.java:114)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.session.SessionManagementFilter.doFilter(
> SessionManagementFilter.java:137)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.authentication.
> AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.
> java:111)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.servletapi.SecurityContextHolderAwareRequ
> estFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.savedrequest.RequestCacheAwareFilter.
> doFilter(RequestCacheAwareFilter.java:63)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.authentication.www.
> BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.
> java:158)
>
> at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.authentication.
> AbstractAuthenticationProcessingFilter.doFilter(
> AbstractAuthenticationProcessingFilter.java:200)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.authentication.logout.
> LogoutFilter.doFilter(LogoutFilter.java:116)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.header.HeaderWriterFilter.
> doFilterInternal(HeaderWriterFilter.java:64)
>
> at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.context.request.async.
> WebAsyncManagerIntegrationFilter.doFilterInternal(
> WebAsyncManagerIntegrationFilter.java:56)
>
> at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.context.SecurityContextPersistenceFilt
> er.doFilter(SecurityContextPersistenceFilter.java:105)
>
> at
> org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:331)
>
> at
> org.springframework.security.web.FilterChainProxy.doFilterInternal(
> FilterChainProxy.java:214)
>
> at
> org.springframework.security.web.FilterChainProxy.doFilter(
> FilterChainProxy.java:177)
>
> at
> org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(
> DelegatingFilterProxy.java:346)
>
> at
> org.springframework.web.filter.DelegatingFilterProxy.doFilter(
> DelegatingFilterProxy.java:262)
>
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:241)
>
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
> at
> com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209)
>
> at
> com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244)
>
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:241)
>
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:219)
>
> at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:110)
>
> at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:169)
>
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:103)
>
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:962)
>
> at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:116)
>
> at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:445)
>
> at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1115)
>
> at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:637)
>
> at
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.
> run(JIoEndpoint.java:318)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>
> at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>
> at java.lang.Thread.run(Thread.java:748)
>
> Caused by:
> org.apache.kylin.metadata.realization.NoRealizationFoundException: No
> model
> found for OLAPContext,
> CUBE_NOT_CONTAIN_ALL_COLUMN[1_2e7caa31:DEFAULT.KYLIN_SALES.SLR_SEGMENT_CD,
> 1_2e7caa31:DEFAULT.KYLIN_SALES.ITEM_COUNT],
> rel#0:OLAPTableScan.OLAP.[](table=[DEFAULT, KYLIN_SALES],ctx=,fields=[0,
> 1,
> 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14])
>
> at
> org.apache.kylin.query.routing.RealizationChooser.
> attemptSelectRealization(RealizationChooser.java:68)
>
> at
> org.apache.kylin.query.routing.RealizationChooser.selectRealization(
> RealizationChooser.java:59)
>
> at
> org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(
> OLAPToEnumerableConverter.java:91)
>
> at
> org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.
> implementRoot(EnumerableRelImplementor.java:108)
>
> at
> org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(
> EnumerableInterpretable.java:92)
>
> at
> org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.
> implement(CalcitePrepareImpl.java:1273)
>
> at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:331)
>
> at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:228)
>
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(
> CalcitePrepareImpl.java:800)
>
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(
> CalcitePrepareImpl.java:655)
>
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(
> CalcitePrepareImpl.java:617)
>
> at
> org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(
> CalciteConnectionImpl.java:214)
>
> at
> org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(
> CalciteMetaImpl.java:603)
>
> at
> org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(
> AvaticaConnection.java:638)
>
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(
> AvaticaStatement.java:149)
>
> ... 83 more
>
> 2018-05-09 06:15:28,229 DEBUG [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] util.PushDownUtil:95 : Query
> Pushdown runner org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl@
> 5000859a
>
> 2018-05-09 06:15:28,275 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] jdbc.Utils:325 : Supplied
> authorities: 10.225.138.32:10000
>
> 2018-05-09 06:15:28,276 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] jdbc.Utils:444 : Resolved
> authority: 10.225.138.32:10000
>
> 2018-05-09 06:15:31,672 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] jdbc.Utils:325 : Supplied
> authorities: 10.225.138.32:10000
>
> 2018-05-09 06:15:31,672 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] jdbc.Utils:444 : Resolved
> authority: 10.225.138.32:10000
>
> 2018-05-09 06:15:35,400 WARN [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] common.QueryContext:183 : Cannot
> find CubeSegmentStatisticsResult for context 0
>
> 2018-05-09 06:15:35,400 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:1068 :
> Processed rows for each storageContext:
>
> 2018-05-09 06:15:35,405 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.BadQueryDetector:204 :
> Pushdown query has been running 9.022 seconds (project:learn_kylin, thread:
> 0x31, user:ADMIN, query id:7eb69e4e-150d-4da6-b1a8-b310a32753d2) -- select
> * from KYLIN_SALES
>
> 2018-05-09 06:15:35,412 DEBUG [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] badquery.
> BadQueryHistoryManager:65
> : Loaded 30 Bad Query(s)
>
> 2018-05-09 06:15:35,421 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:510 : Stats
> of SQL response: isException: false, duration: 9069, total scan count 0
>
> 2018-05-09 06:15:35,421 DEBUG [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] util.CheckUtil:35 : query is
> executed with pushdown, but it is non-select, or the cache for pushdown is
> disabled
>
> 2018-05-09 06:15:35,422 INFO [Query
> 7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:328 :
>
> ==========================[QUERY]===============================
>
> Query Id: 7eb69e4e-150d-4da6-b1a8-b310a32753d2
>
> SQL: select * from KYLIN_SALES
>
> User: ADMIN
>
> Success: true
>
> Duration: 9.07
>
> Project: learn_kylin
>
> Realization Names: []
>
> Cuboid Ids: []
>
> Total scan count: 0
>
> Total scan bytes: 0
>
> Result row count: 10000
>
> Accept Partial: true
>
> Is Partial Result: false
>
> Hit Exception Cache: false
>
> Storage cache used: false
>
> Is Query Push-Down: true
>
> Is Prepare: false
>
> Trace URL: null
>
> Message: null
>
> ==========================[QUERY]===============================
>
>
>
>
> --
> Thanks & Regards,
> Sudipta Paul
>
