[jira] [Resolved] (KYLIN-2396) Percentile pre-aggregation implementation
[ https://issues.apache.org/jira/browse/KYLIN-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Li resolved KYLIN-2396. Resolution: Fixed Fix Version/s: v2.0.0 > Percentile pre-aggregation implementation > - > > Key: KYLIN-2396 > URL: https://issues.apache.org/jira/browse/KYLIN-2396 > Project: Kylin > Issue Type: New Feature >Affects Versions: v2.0.0 >Reporter: Dong Li >Assignee: Dong Li >Priority: Minor > Fix For: v2.0.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (KYLIN-2407) TPC-H query 20, routing bug in lookup query and cube query
[
https://issues.apache.org/jira/browse/KYLIN-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang updated KYLIN-2407:
--
Summary: TPC-H query 20, routing bug in lookup query and cube query (was:
TPC-H query 20, why this query returns no result?)
> TPC-H query 20, routing bug in lookup query and cube query
> --
>
> Key: KYLIN-2407
> URL: https://issues.apache.org/jira/browse/KYLIN-2407
> Project: Kylin
> Issue Type: Bug
>Reporter: liyang
>Assignee: Kaige Liu
> Fix For: v2.0.0
>
> Attachments: KYLIN-2407.patch
>
>
> Below query returns no result.
> {code}
> with tmp3 as (
> select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey
> from v_lineitem
> inner join supplier on l_suppkey = s_suppkey
> inner join nation on s_nationkey = n_nationkey
> inner join part on l_partkey = p_partkey
> where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01'
> and n_name = 'CANADA'
> and p_name like 'forest%'
> group by l_partkey, l_suppkey
> ),
> tmp5 as (
> select
> ps_suppkey
> from
> v_partsupp inner join tmp3 on ps_partkey = l_partkey and ps_suppkey =
> l_suppkey
> where
> ps_availqty > sum_quantity
> )
> select
> s_name,
> s_address
> from
> supplier
> where
> s_suppkey IN (select ps_suppkey from tmp5)
> order by s_name
> {code}
> While another similar query returns correct result.
> {code}
> with tmp3 as (
> select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey
> from v_lineitem
> inner join supplier on l_suppkey = s_suppkey
> inner join nation on s_nationkey = n_nationkey
> inner join part on l_partkey = p_partkey
> where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01'
> and n_name = 'CANADA'
> and p_name like 'forest%'
> group by l_partkey, l_suppkey
> )
> select
> s_name,
> s_address
> from
> v_partsupp
> inner join supplier on ps_suppkey = s_suppkey
> inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = l_suppkey
> where
> ps_availqty > sum_quantity
> group by
> s_name, s_address
> order by
> s_name
> {code}
> Maybe something wrong with the "where ... IN ..." clause?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (KYLIN-2407) TPC-H query 20, routing bug in lookup query and cube query
[
https://issues.apache.org/jira/browse/KYLIN-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952488#comment-15952488
]
liyang commented on KYLIN-2407:
---
Nice patch!! Thanks Kaige!!
> TPC-H query 20, routing bug in lookup query and cube query
> --
>
> Key: KYLIN-2407
> URL: https://issues.apache.org/jira/browse/KYLIN-2407
> Project: Kylin
> Issue Type: Bug
>Reporter: liyang
>Assignee: Kaige Liu
> Fix For: v2.0.0
>
> Attachments: KYLIN-2407.patch
>
>
> Below query returns no result.
> {code}
> with tmp3 as (
> select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey
> from v_lineitem
> inner join supplier on l_suppkey = s_suppkey
> inner join nation on s_nationkey = n_nationkey
> inner join part on l_partkey = p_partkey
> where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01'
> and n_name = 'CANADA'
> and p_name like 'forest%'
> group by l_partkey, l_suppkey
> ),
> tmp5 as (
> select
> ps_suppkey
> from
> v_partsupp inner join tmp3 on ps_partkey = l_partkey and ps_suppkey =
> l_suppkey
> where
> ps_availqty > sum_quantity
> )
> select
> s_name,
> s_address
> from
> supplier
> where
> s_suppkey IN (select ps_suppkey from tmp5)
> order by s_name
> {code}
> While another similar query returns correct result.
> {code}
> with tmp3 as (
> select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey
> from v_lineitem
> inner join supplier on l_suppkey = s_suppkey
> inner join nation on s_nationkey = n_nationkey
> inner join part on l_partkey = p_partkey
> where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01'
> and n_name = 'CANADA'
> and p_name like 'forest%'
> group by l_partkey, l_suppkey
> )
> select
> s_name,
> s_address
> from
> v_partsupp
> inner join supplier on ps_suppkey = s_suppkey
> inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = l_suppkey
> where
> ps_availqty > sum_quantity
> group by
> s_name, s_address
> order by
> s_name
> {code}
> Maybe something wrong with the "where ... IN ..." clause?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Resolved] (KYLIN-2407) TPC-H query 20, why this query returns no result?
[
https://issues.apache.org/jira/browse/KYLIN-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang resolved KYLIN-2407.
---
Resolution: Fixed
Fix Version/s: v2.0.0
> TPC-H query 20, why this query returns no result?
> -
>
> Key: KYLIN-2407
> URL: https://issues.apache.org/jira/browse/KYLIN-2407
> Project: Kylin
> Issue Type: Bug
>Reporter: liyang
>Assignee: Kaige Liu
> Fix For: v2.0.0
>
> Attachments: KYLIN-2407.patch
>
>
> Below query returns no result.
> {code}
> with tmp3 as (
> select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey
> from v_lineitem
> inner join supplier on l_suppkey = s_suppkey
> inner join nation on s_nationkey = n_nationkey
> inner join part on l_partkey = p_partkey
> where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01'
> and n_name = 'CANADA'
> and p_name like 'forest%'
> group by l_partkey, l_suppkey
> ),
> tmp5 as (
> select
> ps_suppkey
> from
> v_partsupp inner join tmp3 on ps_partkey = l_partkey and ps_suppkey =
> l_suppkey
> where
> ps_availqty > sum_quantity
> )
> select
> s_name,
> s_address
> from
> supplier
> where
> s_suppkey IN (select ps_suppkey from tmp5)
> order by s_name
> {code}
> While another similar query returns correct result.
> {code}
> with tmp3 as (
> select l_partkey, 0.5 * sum(l_quantity) as sum_quantity, l_suppkey
> from v_lineitem
> inner join supplier on l_suppkey = s_suppkey
> inner join nation on s_nationkey = n_nationkey
> inner join part on l_partkey = p_partkey
> where l_shipdate >= '1992-01-01' and l_shipdate <= '1995-01-01'
> and n_name = 'CANADA'
> and p_name like 'forest%'
> group by l_partkey, l_suppkey
> )
> select
> s_name,
> s_address
> from
> v_partsupp
> inner join supplier on ps_suppkey = s_suppkey
> inner join tmp3 on ps_partkey = l_partkey and ps_suppkey = l_suppkey
> where
> ps_availqty > sum_quantity
> group by
> s_name, s_address
> order by
> s_name
> {code}
> Maybe something wrong with the "where ... IN ..." clause?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Resolved] (KYLIN-2449) Rewrite should not run on OLAPAggregateRel if has no OLAPTable
[
https://issues.apache.org/jira/browse/KYLIN-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang resolved KYLIN-2449.
---
Resolution: Fixed
Fix Version/s: v2.0.0
> Rewrite should not run on OLAPAggregateRel if has no OLAPTable
> --
>
> Key: KYLIN-2449
> URL: https://issues.apache.org/jira/browse/KYLIN-2449
> Project: Kylin
> Issue Type: Bug
>Reporter: Kaige Liu
>Assignee: Kaige Liu
> Fix For: v2.0.0
>
> Attachments: KYLIN-2449.patch
>
>
> If a OLAPAggregateRel's context does not contain any OLAPTable, it's no need
> to rewrite column. Otherwise a NPE will be threw, for example:
> {code}
> Caused by: java.lang.NullPointerException
> at
> org.apache.kylin.query.relnode.OLAPAggregateRel.buildRewriteColumn(OLAPAggregateRel.java:217)
> at
> org.apache.kylin.query.relnode.OLAPAggregateRel.buildRewriteFieldsAndMetricsColumns(OLAPAggregateRel.java:340)
> at
> org.apache.kylin.query.relnode.OLAPAggregateRel.implementRewrite(OLAPAggregateRel.java:259)
> at
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158)
> at
> org.apache.kylin.query.relnode.OLAPSortRel.implementRewrite(OLAPSortRel.java:83)
> at
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158)
> at
> org.apache.kylin.query.relnode.OLAPLimitRel.implementRewrite(OLAPLimitRel.java:105)
> at
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158)
> at
> org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:94)
> at
> org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:108)
> at
> org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92)
> at
> org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1233)
> at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:303)
> at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:200)
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:761)
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:617)
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:587)
> at
> org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:215)
> at
> org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:594)
> at
> org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:615)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:148)
> ... 35 more
> {code}
> Test case:
> {code}
> SELECT
> t1.leaf_categ_id, COUNT(*) AS nums
> FROM
> (SELECT
> leaf_categ_id
> FROM
> test_kylin_fact
> WHERE
> lstg_format_name = 'ABIN') t1
> JOIN
> (SELECT
> leaf_categ_id
> FROM
> test_kylin_fact f
> INNER JOIN test_order o ON f.order_id = o.order_id
> WHERE
> buyer_id > 100) t2 ON t1.leaf_categ_id = t2.leaf_categ_id
> GROUP BY t1.leaf_categ_id
> ORDER BY t1.leaf_categ_id
> LIMIT 10
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (KYLIN-2449) Rewrite should not run on OLAPAggregateRel if has no OLAPTable
[
https://issues.apache.org/jira/browse/KYLIN-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952480#comment-15952480
]
liyang commented on KYLIN-2449:
---
Nice patch!! Thanks Kaige!
> Rewrite should not run on OLAPAggregateRel if has no OLAPTable
> --
>
> Key: KYLIN-2449
> URL: https://issues.apache.org/jira/browse/KYLIN-2449
> Project: Kylin
> Issue Type: Bug
>Reporter: Kaige Liu
>Assignee: Kaige Liu
> Fix For: v2.0.0
>
> Attachments: KYLIN-2449.patch
>
>
> If a OLAPAggregateRel's context does not contain any OLAPTable, it's no need
> to rewrite column. Otherwise a NPE will be threw, for example:
> {code}
> Caused by: java.lang.NullPointerException
> at
> org.apache.kylin.query.relnode.OLAPAggregateRel.buildRewriteColumn(OLAPAggregateRel.java:217)
> at
> org.apache.kylin.query.relnode.OLAPAggregateRel.buildRewriteFieldsAndMetricsColumns(OLAPAggregateRel.java:340)
> at
> org.apache.kylin.query.relnode.OLAPAggregateRel.implementRewrite(OLAPAggregateRel.java:259)
> at
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158)
> at
> org.apache.kylin.query.relnode.OLAPSortRel.implementRewrite(OLAPSortRel.java:83)
> at
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158)
> at
> org.apache.kylin.query.relnode.OLAPLimitRel.implementRewrite(OLAPLimitRel.java:105)
> at
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:158)
> at
> org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:94)
> at
> org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:108)
> at
> org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92)
> at
> org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1233)
> at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:303)
> at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:200)
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:761)
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:617)
> at
> org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:587)
> at
> org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:215)
> at
> org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:594)
> at
> org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:615)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:148)
> ... 35 more
> {code}
> Test case:
> {code}
> SELECT
> t1.leaf_categ_id, COUNT(*) AS nums
> FROM
> (SELECT
> leaf_categ_id
> FROM
> test_kylin_fact
> WHERE
> lstg_format_name = 'ABIN') t1
> JOIN
> (SELECT
> leaf_categ_id
> FROM
> test_kylin_fact f
> INNER JOIN test_order o ON f.order_id = o.order_id
> WHERE
> buyer_id > 100) t2 ON t1.leaf_categ_id = t2.leaf_categ_id
> GROUP BY t1.leaf_categ_id
> ORDER BY t1.leaf_categ_id
> LIMIT 10
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Closed] (KYLIN-2432) Couldn't select partition column in some old browser (such as Google Chrome 18.0.1025.162)
[ https://issues.apache.org/jira/browse/KYLIN-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luguosheng closed KYLIN-2432. - > Couldn't select partition column in some old browser (such as Google Chrome > 18.0.1025.162) > -- > > Key: KYLIN-2432 > URL: https://issues.apache.org/jira/browse/KYLIN-2432 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.0.0 >Reporter: luguosheng >Assignee: luguosheng > Fix For: v2.0.0 > > > Couldn't select partition column in some old browser (such as Google Chrome > 18.0.1025.162) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (KYLIN-2432) Couldn't select partition column in some old browser (such as Google Chrome 18.0.1025.162)
[ https://issues.apache.org/jira/browse/KYLIN-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luguosheng resolved KYLIN-2432. --- Resolution: Fixed > Couldn't select partition column in some old browser (such as Google Chrome > 18.0.1025.162) > -- > > Key: KYLIN-2432 > URL: https://issues.apache.org/jira/browse/KYLIN-2432 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.0.0 >Reporter: luguosheng >Assignee: luguosheng > Fix For: v2.0.0 > > > Couldn't select partition column in some old browser (such as Google Chrome > 18.0.1025.162) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (KYLIN-2516) a table field can not be used as both dimension and measure in kylin 2.0
[ https://issues.apache.org/jira/browse/KYLIN-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-2516. --- Resolution: Resolved Assignee: liyang (was: Dong Li) Fix Version/s: v2.0.0 This is not a problem and is as designed. The exception behavior may be too strong and we could downgrade the error to a warning or something. But the key point is clear, at model level, a column is either dimension or measure and cannot be both. > a table field can not be used as both dimension and measure in kylin 2.0 > > > Key: KYLIN-2516 > URL: https://issues.apache.org/jira/browse/KYLIN-2516 > Project: Kylin > Issue Type: Bug > Components: Job Engine, Spark Engine >Affects Versions: v2.0.0 >Reporter: zhou degao >Assignee: liyang > Fix For: v2.0.0 > > > 2017-03-22 13:23:12,834 ERROR [http-nio-7070-exec-5] > controller.BasicController:54 : > java.lang.IllegalStateException: > DEFAULT.GITLOG_VIEW_85272BCA_D742_4FCA_B9DC_0FDF561719B2.PROJECT_NAME cannot > be both dimension and metrics at the same time in DataModelDesc > [name=_2099598761_model] > at > org.apache.kylin.metadata.model.DataModelDesc.validate(DataModelDesc.java:468) > at > org.apache.kylin.metadata.model.DataModelDesc.init(DataModelDesc.java:302) > at > org.apache.kylin.metadata.MetadataManager.saveDataModelDesc(MetadataManager.java:601) > at > org.apache.kylin.metadata.MetadataManager.createDataModelDesc(MetadataManager.java:586) > at > org.apache.kylin.rest.service.ModelService.createModelDesc(ModelService.java:91) > at > org.apache.kylin.rest.service.ModelService$$FastClassBySpringCGLIB$$eb0205be.invoke() > at > org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) > at > org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:629) > at > org.apache.kylin.rest.service.ModelService$$EnhancerBySpringCGLIB$$ae15dc41.createModelDesc() > at > org.apache.kylin.rest.controller.ModelController.saveModelDesc(ModelController.java:107) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136) > at > org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82) > at > org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933) > at > org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867) > at > org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951) > at > org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:853) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:648) > at > org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) > at > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) > at >
