[jira] [Resolved] (KYLIN-2396) Percentile pre-aggregation implementation
[ https://issues.apache.org/jira/browse/KYLIN-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Li resolved KYLIN-2396. Resolution: Fixed Fix Version/s: v2.0.0 > Percentile pre-aggregation implementation > - > > Key: KYLIN-2396 > URL: https://issues.apache.org/jira/browse/KYLIN-2396 > Project: Kylin > Issue Type: New Feature >Affects Versions: v2.0.0 >Reporter: Dong Li >Assignee: Dong Li >Priority: Minor > Fix For: v2.0.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (KYLIN-2407) TPC-H query 20, routing bug in lookup query and cube query
[ https://issues.apache.org/jira/browse/KYLIN-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-2407: -- Summary: TPC-H query 20, routing bug in lookup query and cube query (was: TPC-H query 20, why this query returns no result?) > TPC-H query 20, routing bug in lookup query and cube query > -- > > Key: KYLIN-2407 > URL: https://issues.apache.org/jira/browse/KYLIN-2407 > Project: Kylin > Issue Type: Bug >Reporter: liyang >Assignee: Kaige Liu > Fix For: v2.0.0 > > Attachments: KYLIN-2407.patch > > > Below query returns no result. > {code} > with tmp3 as ( > select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey > from v_lineitem > inner join supplier on l_suppkey = s_suppkey > inner join nation on s_nationkey = n_nationkey > inner join part on l_partkey = p_partkey > where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01' > and n_name = 'CANADA' > and p_name like 'forest%' > group by l_partkey, l_suppkey > ), > tmp5 as ( > select > ps_suppkey > from > v_partsupp inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = > l_suppkey > where > ps_availqty > sum_quantity > ) > select > s_name, > s_address > from > supplier > where > s_suppkey IN (select ps_suppkey from tmp5) > order by s_name > {code} > While another similar query returns correct result. > {code} > with tmp3 as ( > select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey > from v_lineitem > inner join supplier on l_suppkey = s_suppkey > inner join nation on s_nationkey = n_nationkey > inner join part on l_partkey = p_partkey > where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01' > and n_name = 'CANADA' > and p_name like 'forest%' > group by l_partkey, l_suppkey > ) > select > s_name, > s_address > from > v_partsupp > inner join supplier on ps_suppkey = s_suppkey > inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = l_suppkey > where > ps_availqty > sum_quantity > group by > s_name, s_address > order by > s_name > {code} > Maybe something wrong with the "where ... IN ..." clause? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KYLIN-2407) TPC-H query 20, routing bug in lookup query and cube query
[ https://issues.apache.org/jira/browse/KYLIN-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952488#comment-15952488 ] liyang commented on KYLIN-2407: --- Nice patch!! Thanks Kaige!! > TPC-H query 20, routing bug in lookup query and cube query > -- > > Key: KYLIN-2407 > URL: https://issues.apache.org/jira/browse/KYLIN-2407 > Project: Kylin > Issue Type: Bug >Reporter: liyang >Assignee: Kaige Liu > Fix For: v2.0.0 > > Attachments: KYLIN-2407.patch > > > Below query returns no result. > {code} > with tmp3 as ( > select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey > from v_lineitem > inner join supplier on l_suppkey = s_suppkey > inner join nation on s_nationkey = n_nationkey > inner join part on l_partkey = p_partkey > where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01' > and n_name = 'CANADA' > and p_name like 'forest%' > group by l_partkey, l_suppkey > ), > tmp5 as ( > select > ps_suppkey > from > v_partsupp inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = > l_suppkey > where > ps_availqty > sum_quantity > ) > select > s_name, > s_address > from > supplier > where > s_suppkey IN (select ps_suppkey from tmp5) > order by s_name > {code} > While another similar query returns correct result. > {code} > with tmp3 as ( > select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey > from v_lineitem > inner join supplier on l_suppkey = s_suppkey > inner join nation on s_nationkey = n_nationkey > inner join part on l_partkey = p_partkey > where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01' > and n_name = 'CANADA' > and p_name like 'forest%' > group by l_partkey, l_suppkey > ) > select > s_name, > s_address > from > v_partsupp > inner join supplier on ps_suppkey = s_suppkey > inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = l_suppkey > where > ps_availqty > sum_quantity > group by > s_name, s_address > order by > s_name > {code} > Maybe something wrong with the "where ... IN ..." clause? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (KYLIN-2407) TPC-H query 20, why this query returns no result?
[ https://issues.apache.org/jira/browse/KYLIN-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-2407. --- Resolution: Fixed Fix Version/s: v2.0.0 > TPC-H query 20, why this query returns no result? > - > > Key: KYLIN-2407 > URL: https://issues.apache.org/jira/browse/KYLIN-2407 > Project: Kylin > Issue Type: Bug >Reporter: liyang >Assignee: Kaige Liu > Fix For: v2.0.0 > > Attachments: KYLIN-2407.patch > > > Below query returns no result. > {code} > with tmp3 as ( > select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey > from v_lineitem > inner join supplier on l_suppkey = s_suppkey > inner join nation on s_nationkey = n_nationkey > inner join part on l_partkey = p_partkey > where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01' > and n_name = 'CANADA' > and p_name like 'forest%' > group by l_partkey, l_suppkey > ), > tmp5 as ( > select > ps_suppkey > from > v_partsupp inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = > l_suppkey > where > ps_availqty > sum_quantity > ) > select > s_name, > s_address > from > supplier > where > s_suppkey IN (select ps_suppkey from tmp5) > order by s_name > {code} > While another similar query returns correct result. > {code} > with tmp3 as ( > select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey > from v_lineitem > inner join supplier on l_suppkey = s_suppkey > inner join nation on s_nationkey = n_nationkey > inner join part on l_partkey = p_partkey > where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01' > and n_name = 'CANADA' > and p_name like 'forest%' > group by l_partkey, l_suppkey > ) > select > s_name, > s_address > from > v_partsupp > inner join supplier on ps_suppkey = s_suppkey > inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = l_suppkey > where > ps_availqty > sum_quantity > group by > s_name, s_address > order by > s_name > {code} > Maybe something wrong with the "where ... IN ..." clause? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (KYLIN-2449) Rewrite should not run on OLAPAggregateRel if has no OLAPTable
[ https://issues.apache.org/jira/browse/KYLIN-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-2449. --- Resolution: Fixed Fix Version/s: v2.0.0 > Rewrite should not run on OLAPAggregateRel if has no OLAPTable > -- > > Key: KYLIN-2449 > URL: https://issues.apache.org/jira/browse/KYLIN-2449 > Project: Kylin > Issue Type: Bug >Reporter: Kaige Liu >Assignee: Kaige Liu > Fix For: v2.0.0 > > Attachments: KYLIN-2449.patch > > > If a OLAPAggregateRel's context does not contain any OLAPTable, it's no need > to rewrite column. Otherwise a NPE will be threw, for example: > {code} > Caused by: java.lang.NullPointerException > at > org.apache.kylin.query.relnode.OLAPAggregateRel.buildRewriteColumn(OLAPAggregateRel.java:217) > at > org.apache.kylin.query.relnode.OLAPAggregateRel.buildRewriteFieldsAndMetricsColumns(OLAPAggregateRel.java:340) > at > org.apache.kylin.query.relnode.OLAPAggregateRel.implementRewrite(OLAPAggregateRel.java:259) > at > org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158) > at > org.apache.kylin.query.relnode.OLAPSortRel.implementRewrite(OLAPSortRel.java:83) > at > org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158) > at > org.apache.kylin.query.relnode.OLAPLimitRel.implementRewrite(OLAPLimitRel.java:105) > at > org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158) > at > org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:94) > at > org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:108) > at > org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92) > at > org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1233) > at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:303) > at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:200) > at > org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:761) > at > org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:617) > at > org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:587) > at > org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:215) > at > org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:594) > at > org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:615) > at > org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:148) > ... 35 more > {code} > Test case: > {code} > SELECT > t1.leaf_categ_id, COUNT(*) AS nums > FROM > (SELECT > leaf_categ_id > FROM > test_kylin_fact > WHERE > lstg_format_name = 'ABIN') t1 > JOIN > (SELECT > leaf_categ_id > FROM > test_kylin_fact f > INNER JOIN test_order o ON f.order_id = o.order_id > WHERE > buyer_id > 100) t2 ON t1.leaf_categ_id = t2.leaf_categ_id > GROUP BY t1.leaf_categ_id > ORDER BY t1.leaf_categ_id > LIMIT 10 > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (KYLIN-2449) Rewrite should not run on OLAPAggregateRel if has no OLAPTable
[ https://issues.apache.org/jira/browse/KYLIN-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952480#comment-15952480 ] liyang commented on KYLIN-2449: --- Nice patch!! Thanks Kaige! > Rewrite should not run on OLAPAggregateRel if has no OLAPTable > -- > > Key: KYLIN-2449 > URL: https://issues.apache.org/jira/browse/KYLIN-2449 > Project: Kylin > Issue Type: Bug >Reporter: Kaige Liu >Assignee: Kaige Liu > Fix For: v2.0.0 > > Attachments: KYLIN-2449.patch > > > If a OLAPAggregateRel's context does not contain any OLAPTable, it's no need > to rewrite column. Otherwise a NPE will be threw, for example: > {code} > Caused by: java.lang.NullPointerException > at > org.apache.kylin.query.relnode.OLAPAggregateRel.buildRewriteColumn(OLAPAggregateRel.java:217) > at > org.apache.kylin.query.relnode.OLAPAggregateRel.buildRewriteFieldsAndMetricsColumns(OLAPAggregateRel.java:340) > at > org.apache.kylin.query.relnode.OLAPAggregateRel.implementRewrite(OLAPAggregateRel.java:259) > at > org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158) > at > org.apache.kylin.query.relnode.OLAPSortRel.implementRewrite(OLAPSortRel.java:83) > at > org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158) > at > org.apache.kylin.query.relnode.OLAPLimitRel.implementRewrite(OLAPLimitRel.java:105) > at > org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158) > at > org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:94) > at > org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:108) > at > org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92) > at > org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1233) > at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:303) > at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:200) > at > org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:761) > at > org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:617) > at > org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:587) > at > org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:215) > at > org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:594) > at > org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:615) > at > org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:148) > ... 35 more > {code} > Test case: > {code} > SELECT > t1.leaf_categ_id, COUNT(*) AS nums > FROM > (SELECT > leaf_categ_id > FROM > test_kylin_fact > WHERE > lstg_format_name = 'ABIN') t1 > JOIN > (SELECT > leaf_categ_id > FROM > test_kylin_fact f > INNER JOIN test_order o ON f.order_id = o.order_id > WHERE > buyer_id > 100) t2 ON t1.leaf_categ_id = t2.leaf_categ_id > GROUP BY t1.leaf_categ_id > ORDER BY t1.leaf_categ_id > LIMIT 10 > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (KYLIN-2508) Trans the time to UTC time when set the range of building cube
[ https://issues.apache.org/jira/browse/KYLIN-2508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luguosheng resolved KYLIN-2508. --- Resolution: Fixed > Trans the time to UTC time when set the range of building cube > -- > > Key: KYLIN-2508 > URL: https://issues.apache.org/jira/browse/KYLIN-2508 > Project: Kylin > Issue Type: Bug > Components: Website >Affects Versions: v1.6.0 >Reporter: luguosheng >Assignee: luguosheng > Fix For: v2.0.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Closed] (KYLIN-2432) Couldn't select partition column in some old browser (such as Google Chrome 18.0.1025.162)
[ https://issues.apache.org/jira/browse/KYLIN-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luguosheng closed KYLIN-2432. - > Couldn't select partition column in some old browser (such as Google Chrome > 18.0.1025.162) > -- > > Key: KYLIN-2432 > URL: https://issues.apache.org/jira/browse/KYLIN-2432 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.0.0 >Reporter: luguosheng >Assignee: luguosheng > Fix For: v2.0.0 > > > Couldn't select partition column in some old browser (such as Google Chrome > 18.0.1025.162) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (KYLIN-2432) Couldn't select partition column in some old browser (such as Google Chrome 18.0.1025.162)
[ https://issues.apache.org/jira/browse/KYLIN-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luguosheng resolved KYLIN-2432. --- Resolution: Fixed > Couldn't select partition column in some old browser (such as Google Chrome > 18.0.1025.162) > -- > > Key: KYLIN-2432 > URL: https://issues.apache.org/jira/browse/KYLIN-2432 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.0.0 >Reporter: luguosheng >Assignee: luguosheng > Fix For: v2.0.0 > > > Couldn't select partition column in some old browser (such as Google Chrome > 18.0.1025.162) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (KYLIN-2453) The "Monitor" page consumes high CPU
[ https://issues.apache.org/jira/browse/KYLIN-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-2453. --- Resolution: Not A Problem This turns out not a problem. It is only reproduce-able on certain version of firefox. > The "Monitor" page consumes high CPU > > > Key: KYLIN-2453 > URL: https://issues.apache.org/jira/browse/KYLIN-2453 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.0.0 >Reporter: liyang >Assignee: Zhixiong Chen > > Maybe some auto-pulling runs in the background? -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (KYLIN-2516) a table field can not be used as both dimension and measure in kylin 2.0
[ https://issues.apache.org/jira/browse/KYLIN-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-2516. --- Resolution: Resolved Assignee: liyang (was: Dong Li) Fix Version/s: v2.0.0 This is not a problem and is as designed. The exception behavior may be too strong and we could downgrade the error to a warning or something. But the key point is clear, at model level, a column is either dimension or measure and cannot be both. > a table field can not be used as both dimension and measure in kylin 2.0 > > > Key: KYLIN-2516 > URL: https://issues.apache.org/jira/browse/KYLIN-2516 > Project: Kylin > Issue Type: Bug > Components: Job Engine, Spark Engine >Affects Versions: v2.0.0 >Reporter: zhou degao >Assignee: liyang > Fix For: v2.0.0 > > > 2017-03-22 13:23:12,834 ERROR [http-nio-7070-exec-5] > controller.BasicController:54 : > java.lang.IllegalStateException: > DEFAULT.GITLOG_VIEW_85272BCA_D742_4FCA_B9DC_0FDF561719B2.PROJECT_NAME cannot > be both dimension and metrics at the same time in DataModelDesc > [name=_2099598761_model] > at > org.apache.kylin.metadata.model.DataModelDesc.validate(DataModelDesc.java:468) > at > org.apache.kylin.metadata.model.DataModelDesc.init(DataModelDesc.java:302) > at > org.apache.kylin.metadata.MetadataManager.saveDataModelDesc(MetadataManager.java:601) > at > org.apache.kylin.metadata.MetadataManager.createDataModelDesc(MetadataManager.java:586) > at > org.apache.kylin.rest.service.ModelService.createModelDesc(ModelService.java:91) > at > org.apache.kylin.rest.service.ModelService$$FastClassBySpringCGLIB$$eb0205be.invoke() > at > org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) > at > org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:629) > at > org.apache.kylin.rest.service.ModelService$$EnhancerBySpringCGLIB$$ae15dc41.createModelDesc() > at > org.apache.kylin.rest.controller.ModelController.saveModelDesc(ModelController.java:107) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136) > at > org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82) > at > org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933) > at > org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867) > at > org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951) > at > org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:853) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:648) > at > org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) > at > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) > at > org.springframewor