Hi Kylin Team,
I have tried both Kylin 2.3.1 and 2.3.0 on AWS EMR. I can build sample
cubes – sales cube and stream cube but when running query on cube I am
getting below error. Any help will be appreciated.
org.apache.kylin.metadata.realization.NoRealizationFoundException: No model
found for OLAPContext,
CUBE_NOT_CONTAIN_ALL_COLUMN[1_2e7caa31:DEFAULT.KYLIN_SALES.SLR_SEGMENT_CD,
1_2e7caa31:DEFAULT.KYLIN_SALES.ITEM_COUNT],
rel#0:OLAPTableScan.OLAP.[](table=[DEFAULT, KYLIN_SALES],ctx=,fields=[0, 1,
2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14])
Below details error log:
2018-05-09 06:14:56,721 DEBUG [http-bio-7070-exec-2]
project.ProjectL2Cache:195 : Loading L2 project cache for learn_kylin
2018-05-09 06:14:56,721 WARN [http-bio-7070-exec-2]
realization.RealizationRegistry:91 : No provider for realization type
INVERTED_INDEX
2018-05-09 06:14:56,721 WARN [http-bio-7070-exec-2]
realization.RealizationRegistry:91 : No provider for realization type
INVERTED_INDEX
2018-05-09 06:15:08,577 DEBUG [http-bio-7070-exec-4]
schema.OLAPSchemaFactory:123 : Adding new schema file
olap_model_6144337688881197358.json to cache
2018-05-09 06:15:08,577 DEBUG [http-bio-7070-exec-4]
schema.OLAPSchemaFactory:124 : Schema json: {
"version": "1.0",
"defaultSchema": "DEFAULT",
"schemas": [
{
"type": "custom",
"name": "DEFAULT",
"factory": "org.apache.kylin.query.schema.OLAPSchemaFactory",
"operand": {
"project": "learn_kylin"
},
"functions": [
{
name: 'PERCENTILE',
className:
'org.apache.kylin.measure.percentile.PercentileAggFunc'
},
{
name: 'CONCAT',
className: 'org.apache.kylin.query.udf.ConcatUDF'
},
{
name: 'MASSIN',
className: 'org.apache.kylin.query.udf.MassInUDF'
},
{
name: 'INTERSECT_COUNT',
className:
'org.apache.kylin.measure.bitmap.BitmapIntersectDistinctCountAggFunc'
},
{
name: 'VERSION',
className: 'org.apache.kylin.query.udf.VersionUDF'
},
{
name: 'PERCENTILE_APPROX',
className:
'org.apache.kylin.measure.percentile.PercentileAggFunc'
}
]
}
]
}
2018-05-09 06:15:15,653 INFO [Scheduler 1863658236 FetcherRunner-40]
threadpool.DefaultScheduler:268 : Job Fetcher: 0 should running, 0 actual
running, 0 stopped, 0 ready, 3 already succeed, 0 error, 0 discarded, 0
others
2018-05-09 06:15:18,609 INFO [Idle-Rpc-Conn-Sweeper-pool2-t1]
ipc.AbstractRpcClient:217 : Cleanup idle connection to
ip-10-225-138-141.ec2.internal/10.225.138.141:16020
2018-05-09 06:15:26,353 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:428 : Using
project: learn_kylin
2018-05-09 06:15:26,353 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:429 : The
original query: select * from KYLIN_SALES
2018-05-09 06:15:26,401 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:646 : The
corrected query: select * from KYLIN_SALES
LIMIT 50000
2018-05-09 06:15:28,188 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] acl.TableACLManager:58 :
Initializing TableACLManager with config kylin_metadata@hbase
2018-05-09 06:15:28,188 DEBUG [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] cachesync.CachedCrudAssist:118 :
Reloading TableACL from
kylin_metadata(key='/table_acl')@kylin_metadata@hbase
2018-05-09 06:15:28,191 DEBUG [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] cachesync.CachedCrudAssist:127 :
Loaded 0 TableACL(s) out of 0 resource
2018-05-09 06:15:28,205 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] util.PushDownUtil:83 : Query
failed to utilize pre-calculation, routing to other engines
java.sql.SQLException: Error while executing SQL "select * from KYLIN_SALES
LIMIT 50000": No model found for OLAPContext,
CUBE_NOT_CONTAIN_ALL_COLUMN[1_2e7caa31:DEFAULT.KYLIN_SALES.SLR_SEGMENT_CD,
1_2e7caa31:DEFAULT.KYLIN_SALES.ITEM_COUNT],
rel#0:OLAPTableScan.OLAP.[](table=[DEFAULT, KYLIN_SALES],ctx=,fields=[0, 1,
2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14])
at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
at
org.apache.kylin.rest.service.QueryService.execute(QueryService.java:931)
at
org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:661)
at
org.apache.kylin.rest.service.QueryService.query(QueryService.java:188)
at
org.apache.kylin.rest.service.QueryService.queryAndUpdateCache(QueryService.java:496)
at
org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:455)
at
org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:390)
at
org.apache.kylin.rest.controller.QueryController.query(QueryController.java:86)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:158)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:962)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1115)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:318)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
Caused by:
org.apache.kylin.metadata.realization.NoRealizationFoundException: No model
found for OLAPContext,
CUBE_NOT_CONTAIN_ALL_COLUMN[1_2e7caa31:DEFAULT.KYLIN_SALES.SLR_SEGMENT_CD,
1_2e7caa31:DEFAULT.KYLIN_SALES.ITEM_COUNT],
rel#0:OLAPTableScan.OLAP.[](table=[DEFAULT, KYLIN_SALES],ctx=,fields=[0, 1,
2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14])
at
org.apache.kylin.query.routing.RealizationChooser.attemptSelectRealization(RealizationChooser.java:68)
at
org.apache.kylin.query.routing.RealizationChooser.selectRealization(RealizationChooser.java:59)
at
org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:91)
at
org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:108)
at
org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92)
at
org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1273)
at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:331)
at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:228)
at
org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:800)
at
org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:655)
at
org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:617)
at
org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214)
at
org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:603)
at
org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:638)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:149)
... 83 more
2018-05-09 06:15:28,229 DEBUG [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] util.PushDownUtil:95 : Query
Pushdown runner org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl@5000859a
2018-05-09 06:15:28,275 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] jdbc.Utils:325 : Supplied
authorities: 10.225.138.32:10000
2018-05-09 06:15:28,276 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] jdbc.Utils:444 : Resolved
authority: 10.225.138.32:10000
2018-05-09 06:15:31,672 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] jdbc.Utils:325 : Supplied
authorities: 10.225.138.32:10000
2018-05-09 06:15:31,672 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] jdbc.Utils:444 : Resolved
authority: 10.225.138.32:10000
2018-05-09 06:15:35,400 WARN [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] common.QueryContext:183 : Cannot
find CubeSegmentStatisticsResult for context 0
2018-05-09 06:15:35,400 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:1068 :
Processed rows for each storageContext:
2018-05-09 06:15:35,405 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.BadQueryDetector:204 :
Pushdown query has been running 9.022 seconds (project:learn_kylin, thread:
0x31, user:ADMIN, query id:7eb69e4e-150d-4da6-b1a8-b310a32753d2) -- select
* from KYLIN_SALES
2018-05-09 06:15:35,412 DEBUG [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] badquery.BadQueryHistoryManager:65
: Loaded 30 Bad Query(s)
2018-05-09 06:15:35,421 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:510 : Stats
of SQL response: isException: false, duration: 9069, total scan count 0
2018-05-09 06:15:35,421 DEBUG [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] util.CheckUtil:35 : query is
executed with pushdown, but it is non-select, or the cache for pushdown is
disabled
2018-05-09 06:15:35,422 INFO [Query
7eb69e4e-150d-4da6-b1a8-b310a32753d2-49] service.QueryService:328 :
==========================[QUERY]===============================
Query Id: 7eb69e4e-150d-4da6-b1a8-b310a32753d2
SQL: select * from KYLIN_SALES
User: ADMIN
Success: true
Duration: 9.07
Project: learn_kylin
Realization Names: []
Cuboid Ids: []
Total scan count: 0
Total scan bytes: 0
Result row count: 10000
Accept Partial: true
Is Partial Result: false
Hit Exception Cache: false
Storage cache used: false
Is Query Push-Down: true
Is Prepare: false
Trace URL: null
Message: null
==========================[QUERY]===============================
--
Thanks & Regards,
Sudipta Paul
