Re: [VOTE] Release apache-kylin-2.1.0 (RC2)

2017-08-16 Thread yu feng
+1(no binding)
build success
md5 verified
Best regards,

2017-08-15 23:57 GMT+08:00 Luke Han :

> +1 (binding)
>
> mvn test passed
> gpg/md5/sha1 verified
>
>
> Best Regards!
> -
>
> Luke Han
>
> On Tue, Aug 15, 2017 at 9:13 PM, 康凯森  wrote:
>
> > +1.
> >
> >
> > Thanks Shaofeng.
> >
> >
> > -- 原始邮件 --
> > 发件人: "ShaoFeng Shi";;
> > 发送时间: 2017年8月13日(星期天) 下午2:45
> > 收件人: "dev";
> >
> > 主题: [VOTE] Release apache-kylin-2.1.0 (RC2)
> >
> >
> >
> > Hi all,
> >
> > I have created a build for Apache Kylin 2.1.0, release candidate 2.
> >
> > Changes highlights:
> > KYLIN-2506 - Refactor global dictionary
> > KYLIN-2515 - Route unsupported query back to query its source directly
> > KYLIN-2579 KYLIN-2580  - Improvement on subqueries
> > KYLIN-2633 - Upgrade Spark to 2.1
> > KYLIN-2646 - Project level query authorization
> >
> > And more than 100 bug fixes and enhancements.
> >
> > Thanks to everyone who has contributed to this release. Here’s release
> > notes:
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> > projectId=12316121=12340443
> >
> > The commit to be voted upon:
> >
> > https://github.com/apache/kylin/commit/562dd173aaf6b398be8e053f896755
> > b3afe8137f
> >
> > Its hash is 562dd173aaf6b398be8e053f896755b3afe8137f.
> >
> > The artifacts to be voted on are located here:
> > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.1.0-rc2/
> >
> > The hashes of the artifacts are as follows:
> > apache-kylin-2.1.0-src.tar.gz.md5 44cab3240772dd1b2e717b48105b416c
> > apache-kylin-2.1.0-src.tar.gz.sha1 a3470589523cfa9046d70123d78059
> > b913f31b9f
> >
> > (The binary packages for HBase 1.x and CDH 5.7are also provided for
> > testing)
> >
> > A staged Maven repository is available for review at:
> > https://repository.apache.org/content/repositories/orgapachekylin-1043/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/shaofengshi.asc
> >
> > Please vote on releasing this package as Apache Kylin 2.1.0.
> >
> > The vote is open for the next 72 hours and passes if a majority of
> > at least three +1 PPMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Kylin 2.1.0
> > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > [ ] -1 Do not release this package because...
> >
> > Here is my vote:
> >
> > +1 (binding)
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> >
>


Subquery cann't work

2017-08-16 Thread apache_...@163.com
Hi,

There seems to be a problem with sql parsing engine? please  confirm

This Sql can work.

SELECT T8_0.*, T8_0.Ieceb82a4498247aeb911ba59f82148f0 - 
T8_1.Ieceb82a4498247aeb911ba59f82148f0 AS D81e0286e9b9c404cb7cb04c0b92cd7c2, 
T8_2.Ieceb82a4498247aeb911ba59f82148f0 AS Dcc3b3deff3c043e8834b70b6f41f8009
FROM (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) 
AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_0
JOIN KYLIN_CAL_DT ON T8_0.PART_DT = KYLIN_CAL_DT.CAL_DT
LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, 
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT
AND T8_0.SELLER_ID = T8_1.SELLER_ID
LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, 
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_2 ON T8_2.PART_DT = KYLIN_CAL_DT.MONTH_BEG_DT
AND T8_0.SELLER_ID = T8_2.SELLER_ID


but after  add a aggregation condition (boldface) ,it run error.


SELECT PART_DT, SUM(D81e0286e9b9c404cb7cb04c0b92cd7c2)
FROM (SELECT T8_0.*, T8_0.Ieceb82a4498247aeb911ba59f82148f0 - 
T8_1.Ieceb82a4498247aeb911ba59f82148f0 AS D81e0286e9b9c404cb7cb04c0b92cd7c2, 
T8_2.Ieceb82a4498247aeb911ba59f82148f0 AS Dcc3b3deff3c043e8834b70b6f41f8009
FROM (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) 
AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_0
JOIN KYLIN_CAL_DT ON T8_0.PART_DT = KYLIN_CAL_DT.CAL_DT
LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, 
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT
AND T8_0.SELLER_ID = T8_1.SELLER_ID
LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, 
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_2 ON T8_2.PART_DT = KYLIN_CAL_DT.MONTH_BEG_DT
AND T8_0.SELLER_ID = T8_2.SELLER_ID
)
GROUP BY PART_DT


error info:

Error while executing SQL "SELECT PART_DT, 
SUM(D81e0286e9b9c404cb7cb04c0b92cd7c2) FROM (SELECT T8_0.*, 
T8_0.Ieceb82a4498247aeb911ba59f82148f0 - T8_1.Ieceb82a4498247aeb911ba59f82148f0 
AS D81e0286e9b9c404cb7cb04c0b92cd7c2, T8_2.Ieceb82a4498247aeb911ba59f82148f0 AS 
Dcc3b3deff3c043e8834b70b6f41f8009 FROM (SELECT KYLIN_SALES.PART_DT, 
KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) AS 
Ieceb82a4498247aeb911ba59f82148f0 FROM KYLIN_SALES INNER JOIN KYLIN_CAL_DT ON 
KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT WHERE PART_DT IN ('2012-01-01', 
'2012-01-02', '2012-01-03') GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID 
) T8_0 JOIN KYLIN_CAL_DT ON T8_0.PART_DT = KYLIN_CAL_DT.CAL_DT LEFT JOIN 
(SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) AS 
Ieceb82a4498247aeb911ba59f82148f0 FROM KYLIN_SALES INNER JOIN KYLIN_CAL_DT ON 
KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT WHERE PART_DT IN ('2012-01-01', 
'2012-01-02', '2012-01-03') GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID 
) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT AND T8_0.SELLER_ID = 
T8_1.SELLER_ID LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, 
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0 FROM KYLIN_SALES 
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT WHERE 
PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03') GROUP BY 
KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID ) T8_2 ON T8_2.PART_DT = 
KYLIN_CAL_DT.MONTH_BEG_DT AND T8_0.SELLER_ID = T8_2.SELLER_ID ) GROUP BY 
PART_DT LIMIT 5": Can't find any realization. Please confirm with 
providers. SQL digest: fact table DEFAULT.KYLIN_CAL_DT,group by 
[DEFAULT.KYLIN_SALES.PART_DT],filter on [],with aggregates[FunctionDesc 
[expression=SUM, parameter=-($2, $9), returnType=null]].







apache_...@163.com


答复: [jira] [Commented] (KYLIN-1967) Dictionary rounding can cause IllegalArgumentException in GTScanRangePlanner

2017-08-16 Thread SHI Wei
Byebye

-邮件原件-
发件人: Zhong Yanghong (JIRA) [mailto:j...@apache.org] 
发送时间: 2017年8月17日 8:46
收件人: iss...@kylin.apache.org
主题: [jira] [Commented] (KYLIN-1967) Dictionary rounding can cause 
IllegalArgumentException in GTScanRangePlanner


[ 
https://issues.apache.org/jira/browse/KYLIN-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129706#comment-16129706
 ] 

Zhong Yanghong commented on KYLIN-1967:
---

If you use
{code}
scanRangePlanner = (GTScanRangePlanner) 
Class.forName(plannerName).getConstructor(CubeSegment.class, Cuboid.class, 
TupleFilter.class, Set.class, Set.class, Collection.class).newInstance(cubeSeg, 
cuboid, filter, dimensions, groups, metrics); {code} in {{CubeSegmentScanner}}, 
you need to throw the cause of the exception like {code} GTScanRangePlanner 
scanRangePlanner;
try {
scanRangePlanner = (GTScanRangePlanner) 
Class.forName(plannerName).getConstructor(CubeSegment.class, Cuboid.class, 
TupleFilter.class, Set.class, Set.class, Collection.class).newInstance(cubeSeg, 
cuboid, filter, dimensions, groups, metrics);
} catch (RuntimeException e) {
throw e;
} catch (Exception e) {
if (e.getCause() != null && e.getCause() instanceof 
RuntimeException) {
throw (RuntimeException) e.getCause();
}
throw new RuntimeException(e);
}
{code}
Otherwise, {{InvocationTargetException}} will be thrown instead of 
{{IllegalArgumentException}}.

> Dictionary rounding can cause IllegalArgumentException in 
> GTScanRangePlanner
> --
> --
>
> Key: KYLIN-1967
> URL: https://issues.apache.org/jira/browse/KYLIN-1967
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v1.5.4, v1.5.4.1
>Reporter: liyang
>Assignee: liyang
> Fix For: v1.6.0
>
>
> java.sql.SQLException: Error while executing SQL "select 
> dayno,enter_id,sum(down_times) from DW.F_EVT_MKT_DOWN_D  where  dayno = 
> '20160822'  group by dayno,enter_id LIMIT 5": 
> java.lang.reflect.InvocationTargetException
>   at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
>   at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
>   at 
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143)
>   at 
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186)
>   at 
> org.apache.kylin.rest.service.QueryService.execute(QueryService.java:364)
>   at 
> org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:276)
>   at 
> org.apache.kylin.rest.service.QueryService.query(QueryService.java:121)
>   at 
> org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke()
>   at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
>   at 
> org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618)
>   at 
> org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$baf0ca80.query()
>   at 
> org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192)
>   at 
> org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:606)
>   at 
> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
>   at 
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
>   at 
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
>   at 
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
>   at 
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
>   at 
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
>   at 
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
>   at 
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
>   at 
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
>   at 
> 

[jira] [Created] (KYLIN-2793) ODBC Driver - Bypass cert validation when connect to SSL service

2017-08-16 Thread Dong Li (JIRA)
Dong Li created KYLIN-2793:
--

 Summary: ODBC Driver - Bypass cert validation when connect to SSL 
service
 Key: KYLIN-2793
 URL: https://issues.apache.org/jira/browse/KYLIN-2793
 Project: Kylin
  Issue Type: Bug
  Components: Driver - ODBC
Affects Versions: v2.0.0
Reporter: Dong Li


Some users deploy kylin as internal service with self-signed SSL certification, 
which will cause connection failure when using ODBC Driver. We can bypass the 
cert validation in ODBC Driver when connecting kylin service.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)