答复: Kylin ODBC driver is removed from download page

[Na Zhai]

Hi, bajpais



Hope this can help you. 
https://stackoverflow.com/questions/55297185/where-can-download-apache-kylin-odbc-driver



发送自 Windows 10 版邮件应用




发件人: bajpais 
发送时间: Friday, May 31, 2019 12:42:01 PM
收件人: dev@kylin.apache.org
主题: Re: Kylin ODBC driver is removed from download page

Hi,
Any update when this driver will be made available?
I have a scenario where i need to connect it with Tableau.
Is there any repository where i can still access the ODBC version

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: date become [Ljava.lang.Object;

[Na Zhai]

Hi, Gods_Dusk



I can not reproduce your situation. Can you try to reproduce your situation 
with sample cube? What’s your Kylin version?





发送自 Windows 10 版邮件应用




发件人: Gods_Dusk <197795...@qq.com>
发送时间: Friday, May 31, 2019 10:07:23 AM
收件人: dev@kylin.apache.org
主题: date become [Ljava.lang.Object;

TB_DIMENSIONS is a look up table and I use
select RQ from TB_DIMENSIONS
in kylin, it returns


but in hive, it looks fine


in model
TBMENZHENFEIYONG.JIEZHANGRIQI = TB_DIMENSIONS.RQ
and TBMENZHENFEIYONG.JIEZHANGRIQI  also looks fine


--
Sent from: http://apache-kylin.74782.x6.nabble.com/

[jira] [Created] (KYLIN-4034) The table should not display in Insight page when the user has no access to the table

[Na Zhai (JIRA)]

Na Zhai created KYLIN-4034:
--

 Summary: The table should not display in Insight page when the 
user has no access to the table
 Key: KYLIN-4034
 URL: https://issues.apache.org/jira/browse/KYLIN-4034
 Project: Kylin
  Issue Type: Bug
Affects Versions: v2.6.2
Reporter: Na Zhai
Assignee: Na Zhai






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

答复: : Could not open client transport for any of the Server URI's in ZooKeeper: Unable to read HiveServer2 configs from ZooKeeper

[Na Zhai]

Hi, lianxin.



I do some search about this, hope this can help you.

https://blog.csdn.net/yangwy012210/article/details/53484965?locationNum=6=1





发送自 Windows 10 版邮件应用




发件人: 王廉鑫 
发送时间: Monday, May 20, 2019 11:19:15 AM
收件人: dev@kylin.apache.org
主题: : Could not open client transport for any of the Server URI's in ZooKeeper: 
Unable to read HiveServer2 configs from ZooKeeper

Hi,






 Kylin 2.5.2  On FusionInsight HD,when  click load table metadata from tree in 
web UI datasource,get error:




2019-05-20 11:15:58,350 INFO  [http-bio-7070-exec-5-EventThread] 
zookeeper.ClientCnxn:614 : EventThread shut down for session: 0xfb0ab634ba4f
2019-05-20 11:15:58,350 INFO  [http-bio-7070-exec-5] zookeeper.ZooKeeper:1325 : 
Session: 0xfb0ab634ba4f closed
2019-05-20 11:15:58,351 ERROR [http-bio-7070-exec-5] 
controller.TableController:190 : java.sql.SQLException: Could not open client 
transport for any of the Server URI's in ZooKeeper: Unable to read HiveServer2 
configs from ZooKeeper
java.lang.RuntimeException: java.sql.SQLException: Could not open client 
transport for any of the Server URI's in ZooKeeper: Unable to read HiveServer2 
configs from ZooKeeper
at 
org.apache.kylin.source.hive.BeelineHiveClient.init(BeelineHiveClient.java:76)
at 
org.apache.kylin.source.hive.BeelineHiveClient.(BeelineHiveClient.java:66)
at 
org.apache.kylin.source.hive.HiveClientFactory.getHiveClient(HiveClientFactory.java:29)
at 
org.apache.kylin.source.hive.HiveMetadataExplorer.(HiveMetadataExplorer.java:43)
at 
org.apache.kylin.source.hive.HiveSource.getSourceMetadataExplorer(HiveSource.java:41)
at 
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:276)
at 
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at 
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
at 
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
at 
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
at 
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
at 
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
at 
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
at 
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
at 
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
at 
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:624)
at 
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
at 
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
at 
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 

答复: [VOTE] Release apache-kylin-2.6.2 (RC1)

[Na Zhai]

+1

mvn test passed



发送自 Windows 10 版邮件应用




发件人: JiaTao Tao 
发送时间: Tuesday, May 14, 2019 10:16:16 AM
收件人: dev
主题: Re: [VOTE] Release apache-kylin-2.6.2 (RC1)

+1

--


Regards!

Aron Tao

ShaoFeng Shi  于2019年5月14日周二 上午1:10写道：

> Hi all,
>
> I have created a build for Apache Kylin 2.6.2, release candidate 1.
>
> Changes highlights:
> [KYLIN-3892] - Set cubing job priority
> [KYLIN-3839] - Storage clean up after refreshing or deleting a segment
> [KYLIN-3873] - Fix inappropriate use of memory in SparkFactDistinct.java
> [KYLIN-3905] - Enable shrunken dictionary default
> [KYLIN-3922] - Fail to update coprocessor when run DeployCoprocessorCLI
> [KYLIN-3936] - MR/Spark task will still run after the job is stopped.
>
>
> Thanks to everyone who has contributed to this release.
> Here’s release notes:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12345051
>
> The commit to being voted upon:
>
>
> https://github.com/apache/kylin/commit/c507ae29fa64bc7234efd6a002dcfe990969ad35
>
> Its hash is c507ae29fa64bc7234efd6a002dcfe990969ad35.
>
> The artifacts to be voted on are located here:
> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.2-rc1/
>
> The hash of the artifact is as follows:
> apache-kylin-2.6.2-source-release.zip.sha256
> db2ab59d3e66d635462e9c9ef49fd7ca29342f07ff4eea0730e52777287e2ebf
>
> A staged Maven repository is available for review at:
> https://repository.apache.org/content/repositories/orgapachekylin-1062/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/shaofengshi.asc
>
> Please vote on releasing this package as Apache Kylin 2.6.2.
>
> The vote is open for the next 72 hours and passes if a majority of
> at least three +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Kylin 2.6.2
> [ ]  0 I don't feel strongly about it, but I'm okay with the release
> [ ] -1 Do not release this package because...
>
>
> Here is my vote:
>
> +1 (binding)
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>

[jira] [Created] (KYLIN-3981) Auto Merge Job failed to execute on windows

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3981:
--

 Summary: Auto Merge Job failed to execute on windows
 Key: KYLIN-3981
 URL: https://issues.apache.org/jira/browse/KYLIN-3981
 Project: Kylin
  Issue Type: Bug
Affects Versions: v2.6.1
Reporter: Na Zhai
Assignee: Na Zhai
 Fix For: v2.6.2


Auto Merge Job failed to execute on windows. It will throw the following errors.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

答复: In Huawei FusionInsight HD C80, Safe Mode in Hadoop, when Cube run 17 Step,is wrong

[Na Zhai]

Hi, lianxin.



I do some search about this. Hope it can help you. 
https://blog.csdn.net/hellozhxy/article/details/84634310.

https://blog.csdn.net/u012944224/article/details/54630805.





发送自 Windows 10 版邮件应用




发件人: 王廉鑫 
发送时间: Wednesday, April 24, 2019 3:37:12 PM
收件人: dev@kylin.apache.org
主题: In Huawei FusionInsight HD C80, Safe Mode in Hadoop, when Cube run 17 
Step,is wrong

Hi,


   In Huawei FusionInsight HD C80, Safe Mode in Hadoop, when Cube run 17 
Step,is get error
   Kylin Version is 2.5.2


   pls help.



  ?�h�底�9�A@�横P VERSIONAPPLICATION_ACL( VIEW_APP metric
MODIFY_APP metric  APPLICATION_OWNER metric, 
*container_e11_1554361005737_0152_01_02? localization.log 0 stderr 0 stdout 
0 syslog 19942019-04-24 11:35:08,610 ERROR [main] 
org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread Thread[main,5,main] 
threw an Exception.
java.lang.IllegalArgumentException: Can't get Kerberos realm
at 
org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:65)
at 
org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:288)
at 
org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:273)
at 
org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:832)
at 
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:802)
at 
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:675)
at 
org.apache.hadoop.conf.Configuration$Resource.getRestrictParserDefault(Configuration.java:243)
at org.apache.hadoop.conf.Configuration$Resource.(Configuration.java:211)
at org.apache.hadoop.conf.Configuration$Resource.(Configuration.java:203)
at org.apache.hadoop.conf.Configuration.addResource(Configuration.java:851)
at org.apache.hadoop.mapred.JobConf.(JobConf.java:484)
at org.apache.hadoop.mapred.JobConf.(JobConf.java:475)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:75)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.apache.hadoop.security.authentication.util.KerberosUtil.getDefaultRealm(KerberosUtil.java:88)
at 
org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:63)
... 12 more
Caused by: KrbException: Cannot locate default realm
at sun.security.krb5.Config.getDefaultRealm(Config.java:1029)
... 18 more
, *container_e11_1554361005737_0152_01_03宇 stderr 0 stdout 0 syslog 
19942019-04-24 11:35:10,627 ERROR [main] 
org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread Thread[main,5,main] 
threw an Exception.
java.lang.IllegalArgumentException: Can't get Kerberos realm
at 
org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:65)
at 
org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:288)
at 
org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:273)
at 
org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:832)
at 
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:802)
at 
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:675)
at 
org.apache.hadoop.conf.Configuration$Resource.getRestrictParserDefault(Configuration.java:243)
at org.apache.hadoop.conf.Configuration$Resource.(Configuration.java:211)
at org.apache.hadoop.conf.Configuration$Resource.(Configuration.java:203)
at org.apache.hadoop.conf.Configuration.addResource(Configuration.java:851)
at org.apache.hadoop.mapred.JobConf.(JobConf.java:484)
at org.apache.hadoop.mapred.JobConf.(JobConf.java:475)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:75)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.apache.hadoop.security.authentication.util.KerberosUtil.getDefaultRealm(KerberosUtil.java:88)
at 
org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:63)
... 12 more
Caused by: KrbException: Cannot locate default realm
at sun.security.krb5.Config.getDefaultRealm(Config.java:1029)
... 18 more

 VERSION., 
*container_e11_1554361005737_0152_01_03none芏芏data:BCFile.indexnone?data:TFile.indexnone芴::data:TFile.metanone芷
 ?�h�底�9�A@�横P

答复: Re:Re: create new kylin project error

[Na Zhai]

Hi, minwenchao.



I recommend you to create a project by Web GUI. Then you may not meet these 
unnecessary problems. If you want to use the REST API, there is the page for 
reference: http://kylin.apache.org/docs24/howto/howto_use_restapi.html.



Finally, for the problem that you mentioned. I think there is an error in the 
parameter you passed in. You  can try this: curl -s -X POST -H "Authorization: 
Basic " -H "Content-Type: application/json" -d '{
"formerProjectName": "",
"projectDescData": 
"{\"name\":\"apipro1\",\"description\":\"\",\"override_kylin_properties\":{}}"
}' http://localhost:7070/kylin/api/projects



Best wishes!



发送自 Windows 10 版邮件应用




发件人: 前行 
发送时间: Tuesday, April 23, 2019 10:47:35 PM
收件人: dev
抄送: yongjie zhao
主题: Re:Re: create new kylin project error




curl -s -X POST -H "Authorization: Basic XXX" -H "Content-Type: 
application/json" -d 
'{"name":"need","description":"","override_kylin_properties":{}}' 
http://localhome:7070/kylin/api/projects








The following is the content of the forwarded email
From：yongjie zhao  
To：dev 
Date：2019-04-23 20:24:44
Subject：Re: create new kylin project error

what is you post BODY, HEADERS? need more information for help you.

On Tue, Apr 23, 2019 at 7:45 PM  wrote:

>
> hi：
>
> 当我调用api 接口去post提交 create new project 出现了异常，
>
>
> url XXX ：kylin/api/project
>
>
> 官方源码 版本2.4：
>
> @RequestMapping(value = "", method = { RequestMethod.POST }, produces = {
> "application/json" })
> @ResponseBody
> public ProjectInstance saveProject(@RequestBody ProjectRequest
> projectRequest) {
> ProjectInstance projectDesc = deserializeProjectDesc(projectRequest)
>
> 传入参数为project.json ，针对此问题无从下手，是否可以给出指导意见呢，谢谢
>
> errr_log：
> DEBUG [http-bio-7070-exec-4] controller.ProjectController:178 : Saving
> project null
> ERROR [http-bio-7070-exec-4] controller.ProjectController:181 : Failed to
> deal with the request.
> java.lang.NullPointerException
> at
> com.fasterxml.jackson.core.JsonFactory.createParser(JsonFactory.java:889)
> at
> com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2992)
> at org.apache.kylin.common.util.JsonUtil.readValue(JsonUtil.java:59)
> at
> org.apache.kylin.rest.controller.ProjectController.deserializeProjectDesc(ProjectController.java:179)
> at
> org.apache.kylin.rest.controller.ProjectController.saveProject(ProjectController.java:122)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
> at
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
> at
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
> at
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
> at
> org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
> at
> org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
> at
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
> at
> 

答复: cube设计维度16个,采用星型模型,结果一直卡在这个位置,怎么处理?

[Na Zhai]

Hi, gaofeng5096.

I can not see your pic, you can add it as the attachment. Can you provide more 
information? Such as Model.json, Cube.json and Kylin version.

发送自 Windows 10 版邮件应用


发件人: gaofeng5...@capinfo.com.cn 
发送时间: Tuesday, April 23, 2019 10:34:50 PM
收件人: dev
主题: cube设计维度16个,采用星型模型,结果一直卡在这个位置,怎么处理?
















您好,关于kylin在预处理的时候一直卡住,发现也没报错,这个是怎么回事?


[cid:_Foxmail.1@e2bfefc0-7c0a-e7f9-ab7d-581d86e4f56a]

gaofeng5...@capinfo.com.cn

答复: Re:RE: [VOTE] Release apache-kylin-3.0.0-alpha (RC1)

[Na Zhai]

+1



mvn test passed



发送自 Windows 10 版邮件应用




发件人: Ma Gang 
发送时间: Thursday, April 11, 2019 3:01:59 PM
收件人: dev@kylin.apache.org
主题: Re:RE: [VOTE] Release apache-kylin-3.0.0-alpha (RC1)

+1 bindingmvn test passed

At 2019-04-11 13:58:16, "李 栋"  wrote:
>+1 binding
>
>Mvn test passed
>
>Dong Li
>
>-Original Message-
>From: Billy Liu 
>Sent: Wednesday, April 10, 2019 10:19 PM
>To: dev 
>Subject: Re: [VOTE] Release apache-kylin-3.0.0-alpha (RC1)
>
>+1 binding
>
>mvn test passed
>
>my env:
>Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
>2018-06-18T02:33:14+08:00)
>Maven home: /usr/local/Cellar/maven/3.5.4 Java version: 1.8.0_91, vendor: 
>Oracle Corporation, runtime:
>/Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre
>Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: 
>"10.14.4", arch: "x86_64", family: "mac"
>
>
>[INFO] Apache Kylin 3.0.0-alpha ... SUCCESS [  2.760 
>s] [INFO] Apache Kylin - Core Common . SUCCESS [ 
>14.214 s] [INFO] Apache Kylin - Core Metadata ... SUCCESS 
>[01:00 min] [INFO] Apache Kylin - Core Dictionary . 
>SUCCESS [03:16 min] [INFO] Apache Kylin - Core Cube 
>... SUCCESS [01:03 min] [INFO] Apache Kylin - Core 
>Metrics  SUCCESS [  1.358 s] [INFO] Apache Kylin - 
>Core Job  SUCCESS [03:54 min] [INFO] Apache Kylin 
>- Core Storage  SUCCESS [  8.017 s] [INFO] Apache 
>Kylin - Stream Core . SUCCESS [09:37 min] [INFO] 
>Apache Kylin - MapReduce Engine  SUCCESS [ 18.366 s] 
>[INFO] Apache Kylin - Spark Engine  SUCCESS [ 19.162 
>s] [INFO] Apache Kylin - Hive Source . SUCCESS [  
>6.396 s] [INFO] Apache Kylin - DataSource SDK .. SUCCESS [ 
> 8.525 s] [INFO] Apache Kylin - Jdbc Source . SUCCESS 
>[ 14.874 s] [INFO] Apache Kylin - Kafka Source  
>SUCCESS [  5.571 s] [INFO] Apache Kylin - Cache 
>... SUCCESS [  6.779 s] [INFO] Apache Kylin - 
>HBase Storage ... SUCCESS [ 31.590 s] [INFO] Apache Kylin 
>- Query ... SUCCESS [ 10.393 s] [INFO] Apache 
>Kylin - Metrics Reporter Hive ... SUCCESS [  1.517 s] [INFO] 
>Apache Kylin - Metrics Reporter Kafka .. SUCCESS [  0.960 s] 
>[INFO] Apache Kylin - Stream Source Kafka . SUCCESS [  3.952 
>s] [INFO] Apache Kylin - Stream Coordinator .. SUCCESS [02:25 
>min] [INFO] Apache Kylin - Stream Receiver . SUCCESS [  
>5.616 s] [INFO] Apache Kylin - Stream Storage .. SUCCESS [ 
> 4.183 s] [INFO] Apache Kylin - REST Server Base  SUCCESS 
>[ 18.138 s] [INFO] Apache Kylin - REST Server . 
>SUCCESS [01:56 min] [INFO] Apache Kylin - JDBC Driver 
>. SUCCESS [  5.251 s] [INFO] Apache Kylin - Assembly 
> SUCCESS [  5.725 s] [INFO] Apache Kylin - Tool 
> SUCCESS [ 10.913 s] [INFO] Apache Kylin - 
>Tool Assembly ... SUCCESS [  0.715 s] [INFO] Apache Kylin 
>- Integration Test  SUCCESS [ 14.533 s] [INFO] Apache 
>Kylin - Tomcat Extension 3.0.0-alpha  SUCCESS [  0.927 s] [INFO] 
>
>[INFO] BUILD SUCCESS
>[INFO] 
>[INFO] Total time: 26:56 min
>[INFO] Finished at: 2019-04-10T22:08:24+08:00
>
>
>With Warm regards
>
>Billy Liu
>
>ShaoFeng Shi  于2019年4月7日周日 下午9:47写道：
>>
>> Hi all,
>>
>> I have created a build for Apache Kylin 3.0.0-alpha, release candidate 1.
>>
>> Changes highlights:
>> [KYLIN-3654] - Kylin Real-time Streaming [KYLIN-3795] - Submit Spark
>> jobs via Apache Livy [KYLIN-3716] - FastThreadLocal replaces
>> ThreadLocal [KYLIN-3867] - Enable JDBC to use key store & trust store
>> for https connection [KYLIN-3905] - Enable shrunken dictionary default
>> [KYLIN-3820] - Add a curator-based job scheduler [KYLIN-3839] -
>> Storage clean up after the refreshing and deleting a segment
>>
>> Thanks to everyone who has contributed to this release.
>> Here’s the release notes:
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316
>> 121=12345219
>>
>> The commit to being voted upon:
>>
>> https://github.com/apache/kylin/commit/8872e28de06b05b11a423f32ff62a5d
>> 00ed84813
>>
>> Its hash is 8872e28de06b05b11a423f32ff62a5d00ed84813.
>>
>> The artifacts to be voted on, including the source package and two
>> pre-compiled binary packages, are located here:
>> 

答复: can't pass step Build Cube In-Mem

[Na Zhai]

Hi, lk_hadoop.



Does Cube planner recommend too many cuboid? If so, it may cause OOM.





发送自 Windows 10 版邮件应用




发件人: lk_hadoop 
发送时间: Tuesday, April 9, 2019 9:21:59 AM
收件人: dev
主题: can't pass step Build Cube In-Mem

hi,all :
   I'm using kylin-2.6.1-cdh57, and the source row count is 500 million，I can 
success build cube .
   but when I use the cube planner , it has one step : Build Cube In-Mem for 
job :OPTIMIZE CUBE
   the config about the kylin_job_conf_inmem.xml is :

   
mapreduce.map.memory.mb
9216




mapreduce.map.java.opts
-Xmx8192m -XX:OnOutOfMemoryError='kill -9 %p'




mapreduce.job.is-mem-hungry
true



mapreduce.job.split.metainfo.maxsize
-1
The maximum permissible size of the split metainfo file.
The JobTracker won't attempt to read split metainfo files bigger 
than
the configured value. No limits if set to -1.




mapreduce.job.max.split.locations
2000
No description



mapreduce.task.io.sort.mb
200




finally the map job will be killed for OnOutOfMemoryError  , but when I 
giev more mem for map job , I will get another error :  
java.nio.BufferOverflowException

why kylin will run the job inmem ? how can I avoid it ?



2019-04-08


lk_hadoop

????: kylin????????????

[Na Zhai]

Hi,



You can do as this page http://kylin.apache.org/development/dev_env.html says.



Best wishes!



?? Windows 10 ??




??:  <136441...@qq.com>
: Wednesday, April 10, 2019 7:37:47 PM
??: dev
: kylin

kylin-2.6.0 windows
ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-compiler-plugin:3.5.1:compile (default-compile) 
on project kylin-engine-mr: Compilation failure -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
org.apache.maven.plugins:maven-compiler-plugin:3.7.0:compile (default-compile) 
on project kylin-engine-mr: Compilation failu
re
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:213)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject 
(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject 
(LifecycleModuleBuilder.java:81)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
 (SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute 
(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke 
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke 
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced 
(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch 
(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode 
(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main 
(Launcher.java:356)
Caused by: org.apache.maven.plugin.compiler.CompilationFailureException: 
Compilation failure

答复: Metadata misspelt as Matadata on website/home page

[Na Zhai]

Hi, Sandip Murmu.



Thanks for your feedback.



发送自 Windows 10 版邮件应用




发件人: Sandip Murmu 
发送时间: Wednesday, April 10, 2019 3:53:04 PM
收件人: dev@kylin.apache.org
主题: Metadata misspelt as Matadata on website/home page

Greetings !

I have been exploring Kylin to assess OLAP requirements for my project.
I believe the architecture diagram on the website/home page (
http://kylin.apache.org/) has 'Metadata' misspelt as 'Matadata'.

Best regards
Sandip Murmu
https://www.linkedin.com/in/sandipmurmu/

答复: Should I remove this check about compare the last and fetched

[Na Zhai]

Hi, yuzhang.

What’s the encoding of the column that you query? The original intention of the 
code that you mentioned is to find out the columns with inconsistent sequence 
before and after encoding.

发送自 Windows 10 版邮件应用


发件人: yuzhang 
发送时间: Tuesday, March 26, 2019 11:27:14 PM
收件人: dev@kylin.apache.org
抄送: dev@kylin.apache.org
主题: Re: Should I remove this check about compare the last and fetched

Sure, here is the code  at SortedIteratorMergerWithLimit.java:130. And the "Not 
sorted! last: XX fetched: XXX" exception may happen when query some 
table contain Chinese value(or messy code).
```

@Override
public E next() {
if (!nextFetched) {
throw new IllegalStateException("Should hasNext() before next()");
}

//TODO: remove this check when validated
if (last != null) {
if (comparator.compare(last, fetched) > 0)
throw new IllegalStateException("Not sorted! last: " + last + " 
fetched: " + fetched);
}

last = fetched;
nextFetched = false;

return fetched;
}

```

[http://mail-online.nosdn.127.net/sm1c0446ade9371d208d1e209c8bc0827f.jpg]
yuzhang

shifengdefan...@163.com

签名由 网易邮箱大师 定制
On 3/26/2019 23:08，elkan1788 
wrote：
I not sure can understand your question cleanly. Can you give more
information about it, just like with a good sample.  Also you can forward
the code what you found and think that is happened!

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: After starting kylin, Getting error while loading web UI

[Na Zhai]

Hi, rsanadhya.



Do you use the apache-kylin-2.6.1-bin-hadoop3.tar.gz?

You can refer to this page (http://kylin.apache.org/docs/install/index.html) 
for the configuration that Kylin supports.



It seems that you have a lack of the jar. Hope this can help you.

https://stackoverflow.com/questions/15787841/noclassdeffounderror-org-apache-commons-configuration-configurationexception.



发送自 Windows 10 版邮件应用




发件人: rsanad...@gmail.com 
发送时间: Friday, April 5, 2019 6:36:55 PM
收件人: dev@kylin.apache.org
主题: After starting kylin, Getting error while loading web UI

Hi ,
We have below services installed  in cluster--
HDFS 3.1
Hadoop 3.1
Hbase 2.0.2
Hortonworks HDP 3.1

When we install Apache Kylin 2.6.1 it got installed and Kylin got started
with below error.
We are not able to login through web UI, Does apache Kylin2.6.1 supports
above configuration?



Error-
2019-04-05 13:20:06,006 INFO  [localhost-startStop-1]
metrics.MetricsManager:136 : Kylin metrics monitor is not enabled
2019-04-05 13:20:06,066 WARN  [localhost-startStop-1]
support.XmlWebApplicationContext:551 : Exception encountered during context
initialization - cancelling refresh attempt:
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name
'org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerMapping':
Invocation of init method failed; nested exception is
java.lang.NoClassDefFoundError:
org/apache/commons/configuration/ConfigurationException
2019-04-05 13:20:06,071 ERROR [localhost-startStop-1]
context.ContextLoader:350 : Context initialization failed
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name
'org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerMapping':
Invocation of init method failed; nested exception is
java.lang.NoClassDefFoundError:
org/apache/commons/configuration/ConfigurationException
   at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1628)
   at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:555)
   at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483)
   at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
   at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
   at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
   at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

[jira] [Created] (KYLIN-3935) ZKUtil acquire the wrong Zookeeper Path on windows

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3935:
--

 Summary: ZKUtil acquire the wrong Zookeeper Path on windows
 Key: KYLIN-3935
 URL: https://issues.apache.org/jira/browse/KYLIN-3935
 Project: Kylin
  Issue Type: Bug
Affects Versions: v2.6.1
Reporter: Na Zhai
Assignee: Na Zhai
 Fix For: v2.6.2


In my windows env, when I run Kylin, Kylin service can't start. In class 
ZKUtil, I found Kylin use File(path).getCanonicalPath() to norm windows path, 
however this will get a path like ' C:\kylin\kylin_metadata'.For Zookeeper, the 
path must start with / character.

{color:#FF}return new File(path).toURI().getPath(){color} might be better!!!

Below is stackTrace:

: java.lang.RuntimeException: 
com.google.common.util.concurrent.UncheckedExecutionException: 
java.lang.RuntimeException: Fail to check or create znode for chRoot 
F:\kylin\kylin_metadata_idea due to 
 at org.apache.kylin.common.util.ZKUtil.getZookeeperClient(ZKUtil.java:137)
 at org.apache.kylin.common.util.ZKUtil.getZookeeperClient(ZKUtil.java:115)
 at 
org.apache.kylin.job.lock.zookeeper.ZookeeperDistributedLock$Factory.(ZookeeperDistributedLock.java:57)
 at 
org.apache.kylin.job.lock.zookeeper.ZookeeperDistributedLock$Factory.(ZookeeperDistributedLock.java:53)
 at 
org.apache.kylin.job.lock.zookeeper.ZookeeperJobLock.(ZookeeperJobLock.java:32)
 at 
org.apache.kylin.rest.service.JobService.afterPropertiesSet(JobService.java:132)
 at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1687)
 at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1624)
 ... 61 more
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: 
java.lang.RuntimeException: Fail to check or create znode for chRoot 
F:\kylin\kylin_metadata_idea due to 
 at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2263)
 at com.google.common.cache.LocalCache.get(LocalCache.java:4000)
 at 
com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4789)
 at org.apache.kylin.common.util.ZKUtil.getZookeeperClient(ZKUtil.java:123)
 ... 68 more



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

答复: Build buildSupportsSnappy Error When Doing Integration Testing

[Na Zhai]

Hi, 林琰文.



What’s your Hadoop version? 2.x and 3.x may have a different configuration. I 
do some search about this problem. Hope this can help you. 
http://www.aboutyun.com/thread-23759-1-1.html.





发送自 Windows 10 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>应用




发件人: 林琰文 
发送时间: Friday, March 22, 2019 10:47:07 AM
收件人: dev@kylin.apache.org
主题: Re: Build buildSupportsSnappy Error When Doing Integration Testing

Hi Na Zhai,

Thank you for your replying!

Actually I've checked this link previously but it did not work. When I
checked the log output from YARN MapReduce Job container I found that the
*LD_LIBRARY_PATH* was not set correctly and MapReduce log still showed it
could not load native hadoop library. However, I did specify the*
LD_LIBRARY_PATH=/usr/hdp/3.0.1.0-187/hadoop/lib/native* in
*mapreduce.admin.user.env
*in* mapred-site.xml*. So It was quite weird. My hacked way to tackle this
problem is to add
*-Djava.library.path="${java.library.path}:/usr/hdp/${hdp.version}/hadoop/lib/native
*option in the *mapreduce.admin.map.child.java.opts* in *mapred-site.xml*.
So I don't know why adding *LD_LIBRARY_PATH to the mapreduce.admin.user.env
in mapred-site.xml* does not work*. *Do you have any idea on this?

Thanks again!

Best,
Yanwen Lin

On Thu, Mar 21, 2019 at 10:44 PM Na Zhai  wrote:

> Hi, 林琰文.
>
>
>
> You should add native dependencies. Hope this can help you.
>
>
> https://stackoverflow.com/questions/22150417/hadoop-mapreduce-java-lang-unsatisfiedlinkerror-org-apache-hadoop-util-nativec
> .
>
>
>
>
>
> 发送自 Windows 10 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>应用
>
>
>
> 
> 发件人: 林琰文 
> 发送时间: Tuesday, March 19, 2019 1:04:51 AM
> 收件人: dev@kylin.apache.org
> 主题: Build buildSupportsSnappy Error When Doing Integration Testing
>
> Hi all,
> I am currently running integration test. However, I met the following
> error. Could you please share some suggestions on this?
> *1. Command*:
> mvn verify -fae -Dhdp.version=3.0.1.0-187 -P sandbox
> *2. Error message from Yarn Container Attempt:*
>
> 2019-03-18 16:43:25,583 INFO [main] org.apache.kylin.engine.mr
> .KylinMapper:
> Accepting Mapper Key with ordinal: 1
>
> 2019-03-18 16:43:25,583 INFO [main] org.apache.kylin.engine.mr
> .KylinMapper:
> Do map, available memory: 322m
>
> 2019-03-18 16:43:25,596 INFO [main] org.apache.kylin.common.KylinConfig:
> Creating new manager instance of class
> org.apache.kylin.cube.cuboid.CuboidManager
>
> 2019-03-18 16:43:25,599 INFO [main]
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output
> Committer Algorithm version is 1
>
> 2019-03-18 16:43:25,599 INFO [main]
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:
> FileOutputCommitter skip cleanup _temporary folders under output
> directory:false, ignore cleanup failures: false
>
> 2019-03-18 16:43:25,795 ERROR [main] org.apache.kylin.engine.mr
> .KylinMapper:
>
> java.lang.UnsatisfiedLinkError:
> org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
>
>  at org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native
> Method)
>
>  at
>
> org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63
> )
>
>  at
>
> org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:136
> )
>
>  at
> org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150
> )
>
>  at
> org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:168
> )
>
>  at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:1304)
>
>  at org.apache.hadoop.io
> .SequenceFile$Writer.(SequenceFile.java:1192)
>
>  at org.apache.hadoop.io.SequenceFile$BlockCompressWriter
> .(SequenceFile.java:1552)
>
>  at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:289)
>
>  at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:542)
>
>  at
>
> org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat.getSequenceWriter(SequenceFileOutputFormat.java:64)
>
>  at
>
> org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat.getRecordWriter(SequenceFileOutputFormat.java:75)
>
>  at
>
> org.apache.hadoop.mapreduce.lib.output.LazyOutputFormat$LazyRecordWriter.write(LazyOutputFormat.java:113)
>
>  at
>
> org.apache.hadoop.mapreduce.lib.output.MultipleOutputs.write(MultipleOutputs.java:468)
>
>  at
> org.apache.kylin.engine.mr
> .steps.FilterRecommendCuboidDataMapper.doMap(FilterRecommendCuboidDataMapper.java:85
> )
>
>  at
> org.apache.kylin.engine.mr
> .steps.FilterRecommendCuboidDataMapper.doMap(FilterRecommendCuboi

答复: [Discussion]Does 'UNION ALL' support query on two fact table ?

[Na Zhai]

Hi, yuzhang.



There is one fact table in Cube A and one fact table in Cube B. I think “union 
all” supports query on these two fact tables.





发送自 Windows 10 版邮件应用




发件人: yuzhang 
发送时间: Tuesday, March 19, 2019 8:29:26 PM
收件人: dev@kylin.apache.org; u...@kylin.apache.org
主题: [Discussion]Does 'UNION ALL' support query on two fact table ?

Hi dear all:
Simple question as mail title desc.


Best regards
yuzhang


| |
yuzhang
|
|
shifengdefan...@163.com
|
签名由网易邮箱大师定制

答复: Build buildSupportsSnappy Error When Doing Integration Testing

[Na Zhai]

Hi, 林琰文.



You should add native dependencies. Hope this can help you.

https://stackoverflow.com/questions/22150417/hadoop-mapreduce-java-lang-unsatisfiedlinkerror-org-apache-hadoop-util-nativec.





发送自 Windows 10 版邮件应用




发件人: 林琰文 
发送时间: Tuesday, March 19, 2019 1:04:51 AM
收件人: dev@kylin.apache.org
主题: Build buildSupportsSnappy Error When Doing Integration Testing

Hi all,
I am currently running integration test. However, I met the following
error. Could you please share some suggestions on this?
*1. Command*:
mvn verify -fae -Dhdp.version=3.0.1.0-187 -P sandbox
*2. Error message from Yarn Container Attempt:*

2019-03-18 16:43:25,583 INFO [main] org.apache.kylin.engine.mr.KylinMapper:
Accepting Mapper Key with ordinal: 1

2019-03-18 16:43:25,583 INFO [main] org.apache.kylin.engine.mr.KylinMapper:
Do map, available memory: 322m

2019-03-18 16:43:25,596 INFO [main] org.apache.kylin.common.KylinConfig:
Creating new manager instance of class
org.apache.kylin.cube.cuboid.CuboidManager

2019-03-18 16:43:25,599 INFO [main]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output
Committer Algorithm version is 1

2019-03-18 16:43:25,599 INFO [main]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:
FileOutputCommitter skip cleanup _temporary folders under output
directory:false, ignore cleanup failures: false

2019-03-18 16:43:25,795 ERROR [main] org.apache.kylin.engine.mr.KylinMapper:

java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z

 at org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native
Method)

 at
org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63
)

 at
org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:136
)

 at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150
)

 at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:168
)

 at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:1304)

 at org.apache.hadoop.io.SequenceFile$Writer.(SequenceFile.java:1192)

 at org.apache.hadoop.io.SequenceFile$BlockCompressWriter
.(SequenceFile.java:1552)

 at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:289)

 at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:542)

 at
org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat.getSequenceWriter(SequenceFileOutputFormat.java:64)

 at
org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat.getRecordWriter(SequenceFileOutputFormat.java:75)

 at
org.apache.hadoop.mapreduce.lib.output.LazyOutputFormat$LazyRecordWriter.write(LazyOutputFormat.java:113)

 at
org.apache.hadoop.mapreduce.lib.output.MultipleOutputs.write(MultipleOutputs.java:468)

 at
org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataMapper.doMap(FilterRecommendCuboidDataMapper.java:85
)

 at
org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataMapper.doMap(FilterRecommendCuboidDataMapper.java:44
)

 at org.apache.kylin.engine.mr.KylinMapper.map(KylinMapper.java:77)

 at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)

 at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)

 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)

 at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)

 at java.security.AccessController.doPrivileged(Native Method)

 at javax.security.auth.Subject.doAs(Subject.java:422)

 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)

 at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

2019-03-18 16:43:25,797 INFO [main] org.apache.kylin.engine.mr.KylinMapper:
Do cleanup, available memory: 318m

2019-03-18 16:43:25,813 INFO [main] org.apache.kylin.engine.mr.KylinMapper:
Total rows: 1

2019-03-18 16:43:25,813 ERROR [main] org.apache.hadoop.mapred.YarnChild:
Error running child : java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z

 at org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native
Method)

 at
org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63
)

 at
org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:136
)

 at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150
)

 at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:168
)

 at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:1304)

 at org.apache.hadoop.io.SequenceFile$Writer.(SequenceFile.java:1192)

 at org.apache.hadoop.io.SequenceFile$BlockCompressWriter
.(SequenceFile.java:1552)

 at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:289)

 at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:542)

 at

答复: Kylin Support Spark 1.6 version when start supporting spark 2.6

[Na Zhai]

Hi, rsanadhya.



What’s your Kylin version? In Kylin v2.6, it has supported Spark v2.3.2. Please 
refer to this issue: https://issues.apache.org/jira/browse/KYLIN-3272. And Why 
you want to use Spark v2.6?



发送自 Windows 10 版邮件应用




发件人: rsanad...@gmail.com 
发送时间: Tuesday, March 19, 2019 2:27:19 PM
收件人: dev@kylin.apache.org
主题: Kylin Support Spark 1.6 version when start supporting spark 2.6

HI ALl,

Wanted to check Currently Kylin supports Spark 1.6 version which is older
and latest Spark 2.6 is available . When will Kylin start supporting Spark
2.6 ?

Thanks,
Rahul

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: [Discussion] Enable shrunken dictionary by default

[Na Zhai]

+1



发送自 Windows 10 版邮件应用




发件人: Billy Liu 
发送时间: Monday, March 18, 2019 11:50:49 AM
收件人: dev
抄送: Xiaoxiang Yu
主题: Re: [Discussion] Enable shrunken dictionary by default

22 hours to 5 minutes, incredible progress.
+1

With Warm regards

Billy Liu

ShaoFeng Shi  于2019年3月18日周一 上午2:59写道：
>
> +1.
>
> Thanks to Xiaoxiang for raising this; Kylin has some advanced but hidden
> feature. As the function becomes stable, we should enable them by default
> to benefit all users.
>
> Please also raise similar discussion if you wish to enable some good
> features.
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>
>
>
>
> Zhong, Yanghong  于2019年3月18日周一 上午10:39写道：
>
> > +1.
> >
> > Best regards,
> > Yanghong Zhong
> >
> > On 2019/3/18, 10:27 AM, "Xiaoxiang Yu"  wrote:
> >
> > Dear all,
> > I suggest enable "kylin.dictionary.shrunken-from-global-enabled" by
> > default(it is disabled by default), because I found enable it will speed up
> > cube build process when cube have count distinct(bitmap) on a large
> > cardinality column. This feature is contributed in KYLIN-3491.
> >
> > When using count distinct(bitmap) measure on a large cardinality
> > column(this require global dictionary), build base cuboid step need
> > frequent cache swap so it cannot finished within a reasonable period.
> > KYLIN-3491 add a new step to build separated dictionary for each InputSplit
> > before BuildBaseCuboid step. So mapper of BuildBaseCuboid step only has to
> > fetch a smaller dictionary for itself(without unused value), instead of a
> > larger global dictionary. It will reduce cache swap and make
> > BuildBaseCuboid step run as quick as possible.
> >
> > In my test env, my hadoop cluster is a CDH cluster with 56 vcore and
> > 110GB Memory. I create a model with a fact table (153326740 rows) and three
> > dimension tables, there are three count distinct(bitmap) measure which the
> > largest cardinality of single column is 55200325. With ShrunkenDict
> > disabled, the BuildBaseCuboid cannot completed in 22 hours. Comparatively,
> > with ShrunkenDict enabled, build process completed in a reasonable
> > duration(Extra Dictionary cost 5 minutes, Build Base Cuboid costs 5
> > minutes).
> >
> >
> > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fuser-images.githubusercontent.com%2F14030549%2F54363305-ad25e200-46a5-11e9-8bc7-fe2c385c0278.pngdata=02%7C01%7Cyangzhong%40ebay.com%7C5f549f14059d4731d7a808d6ab4954ef%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636884728786178583sdata=KuUcbcerY42oG4J11G1jlEcIs4v%2BPPVt40B9G9fqa80%3Dreserved=0
> >
> > If you want know more, please check
> > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FKYLIN-3491data=02%7C01%7Cyangzhong%40ebay.com%7C5f549f14059d4731d7a808d6ab4954ef%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636884728786178583sdata=T1P1rCA1munwUedC0PC4qttqbFqiDkda%2FZ%2BgqgkQn%2BE%3Dreserved=0.
> > If you have any suggestion, please let me know.
> >
> > 
> > Best wishes,
> > Xiaoxiang Yu
> >
> >
> >
> >

答复: How kylin store data in Hbase ?

[Na Zhai]

Hi, rsanadhya.



Can you provide more informations? Have you set “Mandatory Dimensions”, 
“Hierarchy Dimensions” or “Joint Dimensions”?



发送自 Windows 10 版邮件应用




发件人: rsanad...@gmail.com 
发送时间: Thursday, March 14, 2019 7:29:48 PM
收件人: dev@kylin.apache.org
主题: How kylin store data in Hbase ?

HI All, i Just wanted to understand How kylin Store data in Hbase ?

Eg. I have 1 fact - having 3 column (Dim1.A,Dim2.B,C cal) 2 Dims- Dim 1
(A,Desc), Dim2 (B,Desc) i have 4 distinct records in facts and same 4
records properly exits in Dim1 and Dim2. Kindly help me to understand how
many combination this will create in Hbase ? Any leads will be great help !

Thanks, Rahul S

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: no mapreduce.tar.gz available for kylin to build cube

[Na Zhai]

Hi, 叩龙.

You should find mapreduce.tar.gz in your hdp env and put it to the 
hdfs://s1.hdp.com:8020/app/hw-base/hdp/apps/3.0.1.0-187/mapreduce/ directory.

发送自 Windows 10 版邮件应用


发件人: 叩 龙 
发送时间: Friday, March 15, 2019 12:14:58 PM
收件人: dev@kylin.apache.org
主题: no mapreduce.tar.gz available for kylin to build cube

hi Team，

I use below :
HDP 3.0.1
Apache-Kylin-2.6.0-bin-hadoop3

while trying to build cube from kylin, I got below error. I checked that path, 
we don’t have mapreduce but only tez. Could you please advise how to make it 
forward? thanks

[cid:Image449.png@1697f8d33c71c2]




Error while building cube:

java.io.FileNotFoundException: File does not exist: 
hdfs://s1.hdp.com:8020/app/hw-base/hdp/apps/3.0.1.0-187/mapreduce/mapreduce.tar.gz
at org.apache.hadoop.fs.Hdfs.getFileStatus(Hdfs.java:145)
at 
org.apache.hadoop.fs.AbstractFileSystem.resolvePath(AbstractFileSystem.java:488)
at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2292)
at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2288)
at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)

[cid:Image442.png@1697f89cd191bb]

发自 Windows 邮件

答复: /app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: too many arguments

[Na Zhai]

Hi, 叩 龙.



Can you start Kylin and query with sample Cube successfully? If so, I think it 
is does not matter.



发送自 Windows 10 版邮件应用




发件人: 叩 龙 
发送时间: Friday, March 15, 2019 1:36:10 PM
收件人: dev@kylin.apache.org
主题: /app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: 
[: too many arguments

hi Team，

does subjected error matter while starting up kylin?

kylin 2.6.0 & HDP 3.0

[root@s4 bin]# ./kylin.sh start
Retrieving hadoop conf dir...
KYLIN_HOME is set to /app/apache-kylin-2.6.0-bin-hadoop3
Retrieving hive dependency...
/app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: 
too many arguments
Retrieving hbase dependency...
Retrieving hadoop conf dir...
Retrieving kafka dependency...
Retrieving Spark dependency...
Start to check whether we need to migrate acl tables
Retrieving hive dependency...
/app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: 
too many arguments
Retrieving hbase dependency...
Retrieving hadoop conf dir...
Retrieving kafka dependency...
Retrieving Spark dependency...
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in 
[jar:file:/app/apache-kylin-2.6.0-bin-hadoop3/tool/kylin-tool-2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in 
[jar:file:/usr/hdp/3.0.1.0-187/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-15 13:35:03,549 INFO  [main] common.KylinConfig:101 : Loading 
kylin-defaults.properties from 
file:/app/apache-kylin-2.6.0-bin-hadoop3/tool/kylin-tool-2.6.0.jar!/kylin-defaults.properties
2019-03-15 13:35:03,572 DEBUG [main] common.KylinConfig:328 : KYLIN_CONF 
property was not set, will seek KYLIN_HOME env variable
2019-03-15 13:35:03,576 INFO  [main] common.KylinConfig:136 : Initialized a new 
KylinConfig from getInstanceFromEnv : 957465255
2019-03-15 13:35:03,644 INFO  [main] persistence.ResourceStore:88 : Using 
metadata url kylin_metadata@hbase for resource 
store


发自 Windows 邮件

答复: cannot get HiveTableMeta

[Na Zhai]

Hi, jaycechou.



Can you make sure the table ‘hxb_db.tbl_customer’ exists?



发送自 Windows 10 版邮件应用




发件人: jaycechou <813032...@qq.com>
发送时间: Wednesday, March 13, 2019 3:06:27 PM
收件人: dev@kylin.apache.org
主题: cannot get HiveTableMeta

现在用的hadoop2.7.5，hbase 1.4.1，hive 2.3.4 ,kylin 2.5.0,现在kylin
同步hive中的表，但是找不到元数据 ,日志中报如下错：
019-03-13 14:54:46,376 ERROR [http-bio-7070-exec-9]
controller.TableController:125 : Failed to load Hive Table
java.lang.RuntimeException: cannot get HiveTableMeta
at
org.apache.kylin.source.hive.HiveMetadataExplorer.loadTableMetadata(HiveMetadataExplorer.java:64)
at
org.apache.kylin.rest.service.TableService.extractHiveTableMeta(TableService.java:202)
at
org.apache.kylin.rest.service.TableService.loadHiveTablesToProject(TableService.java:129)
at
org.apache.kylin.rest.controller.TableController.loadHiveTables(TableController.java:109)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at

????: hadoop3??????kylin2.6.1??spark????cube??????????spark??????????state running,????????10%????????????????????????

[Na Zhai]

Hi, 

Does you use the 
apache-kylin-2.6.1-bin-hadoop3.tar.gz?
 If not, I recommend you to use this jar. If you have already used this jar, 
you can check the log of yarn of spark jobhistory. It may be caused by your 
unreasonable configuration of Spark. I can not see your pic, you can add it as 
the attachment. And I also can not see your attachment. Have you uploaded it?

?? Windows 10 ??


??:  <3513797...@qq.com>
: Friday, March 8, 2019 7:42:35 PM
??: dev
: hadoop3??kylin2.6.1??sparkcube??spark??state 
running,10%

Hi,
??
hadoop3.1.2
kylin:2.6.1

#3 step ?? Extract Fact Table Distinct Columns)

[cid:2F27FAD3@C2F83023.2B55825C.png]


kylin.log ??~??
??:
2019-03-08 11:15:08,660 INFO  [Scheduler 190936888 Job 
edba142b-b9ec-2379-89f6-2a34511d0425-177] spark.SparkExecutable:262 : cmd: 
export HADOOP_CONF_DIR=/home/apache/hbase/conf && 
/home/apache/kylin/spark/bin/spark-submit --class 
org.apache.kylin.common.util.SparkEntry  --conf spark.executor.instances=40  
--conf spark.yarn.archive=hdfs://master:9820/kylin/spark/spark-libs.jar  --conf 
spark.network.timeout=600  --conf spark.yarn.queue=default  --conf 
spark.history.fs.logDirectory=hdfs:///kylin/spark-history  --conf 
spark.io.compression.codec=org.apache.spark.io.SnappyCompressionCodec  --conf 
spark.dynamicAllocation.enabled=true  --conf spark.master=yarn  --conf 
spark.storage.memoryFraction=0.5  --conf 
spark.dynamicAllocation.executorIdleTimeout=300  --conf 
spark.hadoop.yarn.timeline-service.enabled=false  --conf 
spark.executor.memory=4G  --conf spark.eventLog.enabled=true  --conf 
spark.eventLog.dir=hdfs:///kylin/spark-history  --conf 
spark.dynamicAllocation.minExecutors=1  --conf spark.executor.cores=2  --conf 
spark.yarn.executor.memoryOverhead=1024  --conf spark.hadoop.dfs.replication=2  
--conf spark.dynamicAllocation.maxExecutors=1000  --conf 
spark.executor.memoryOverhead=1024  --conf spark.driver.memory=2G  --conf 
spark.driver.memoryOverhead=256  --conf spark.submit.deployMode=cluster  --conf 
spark.shuffle.service.enabled=true --jars 
/home/apache/kylin/lib/kylin-job-2.6.1.jar 
/home/apache/kylin/lib/kylin-job-2.6.1.jar -className 
org.apache.kylin.engine.spark.SparkFactDistinct -counterOutput 
hdfs://kylincluster/kylin/kylin_metadata/kylin-edba142b-b9ec-2379-89f6-2a34511d0425/spark_cube_low/counter
 -statisticssamplingpercent 100 -cubename spark_cube_low -hiveTable 
default.kylin_intermediate_spark_cube_low_63876e8b_97c8_074d_0356_3f779a6ca1b6 
-output 
hdfs://kylincluster/kylin/kylin_metadata/kylin-edba142b-b9ec-2379-89f6-2a34511d0425/spark_cube_low/fact_distinct_columns
 -input 
hdfs://kylincluster/kylin/kylin_metadata/kylin-edba142b-b9ec-2379-89f6-2a34511d0425/kylin_intermediate_spark_cube_low_63876e8b_97c8_074d_0356_3f779a6ca1b6
 -segmentId 63876e8b-97c8-074d-0356-3f779a6ca1b6 -metaUrl 
kylin_metadata@hdfs,path=hdfs://kylincluster/kylin/kylin_metadata/kylin-edba142b-b9ec-2379-89f6-2a34511d0425/spark_cube_low/metadata
2019-03-08 11:15:09,423 INFO  [pool-16-thread-1] spark.SparkExecutable:38 : 
2019-03-08 11:15:09 WARN  SparkConf:66 - The configuration key 
'spark.yarn.executor.memoryOverhead' has been deprecated as of Spark 2.3 and 
may be removed in the future. Please use the new key 
'spark.executor.memoryOverhead' instead.
2019-03-08 11:15:10,478 INFO  [pool-16-thread-1] spark.SparkExecutable:38 : 
2019-03-08 11:15:10 INFO  Client:54 - Requesting a new application from cluster 
with 2 NodeManagers
2019-03-08 11:15:10,541 INFO  [pool-16-thread-1] spark.SparkExecutable:38 : 
2019-03-08 11:15:10 INFO  Client:54 - Verifying our application has not 
requested more than the maximum memory capability of the cluster (8000 MB per 
container)
2019-03-08 11:15:10,542 INFO  [pool-16-thread-1] spark.SparkExecutable:38 : 
2019-03-08 11:15:10 INFO  Client:54 - Will allocate AM container, with 2304 MB 
memory including 256 MB overhead
2019-03-08 11:15:10,542 INFO  [pool-16-thread-1] spark.SparkExecutable:38 : 
2019-03-08 11:15:10 INFO  Client:54 - Setting up container launch context for 
our AM
2019-03-08 11:15:10,544 INFO  [pool-16-thread-1] spark.SparkExecutable:38 : 
2019-03-08 11:15:10 INFO  Client:54 - Setting up the launch environment for our 
AM container
2019-03-08 11:15:10,552 INFO  [pool-16-thread-1] spark.SparkExecutable:38 : 
2019-03-08 11:15:10 INFO  Client:54 - Preparing resources for our AM container
2019-03-08 11:15:11,553 INFO  [pool-16-thread-1] spark.SparkExecutable:38 : 
2019-03-08 11:15:11 INFO  Client:54 - Uploading resource 
hdfs://master:9820/kylin/spark/spark-libs.jar -> 
hdfs://kylincluster/user/root/.sparkStaging/application_1552042715496_0010/spark-libs.jar
2019-03-08 11:15:13,978 INFO  

答复: Why GROUP BY can't get the right result in the following situation?

[Na Zhai]

Hi, nokkon



What’s your Kylin version? Can you provide the log of the query and the 
definition of Cube/Model?





发送自 Windows 10 版邮件应用




发件人: nokkon1314@ 
发送时间: Monday, March 4, 2019 11:28:25 AM
收件人: dev@kylin.apache.org
主题: Why GROUP BY can't get the right result in the following situation?

Expression:
select YEAR(ORDERDATE) AS "calc(1692598041)(0)" from orders2
Results:
 calc(1692598041)(0)
2013
2013
2014
2015
2015

But ,when I add the GROUP BY clause:
select YEAR(ORDERDATE) AS "calc(1692598041)(0)" from orders2 GROUP BY 
(YEAR(ORDERDATE))
Results:
 calc(1692598041)(0)
 2013

I don’t know why there just return one record.

Do you have any suggestions?

答复: Segments are not able to merge or delete them in 1.6.0 version

[Na Zhai]

Hi, naveencholeti.



Is that you want to delete the segment that builds failing? If so, discard the 
job and the segment will be deleted.



If you want to delete the segment completely. Before deleting the segments, I 
advise you to back up the metadata. You can use the command to back up your 
metadata, please refer to 
http://kylin.apache.org/docs/howto/howto_backup_metadata.html.

Then you should find the json file of Cube instance. And delete the segment 
info in the json file. Finally, restore the metadata.



发送自 Windows 10 版邮件应用




发件人: naveencholeti 
发送时间: Friday, March 1, 2019 3:09:02 PM
收件人: dev@kylin.apache.org
主题: Segments are not able to merge or delete them in 1.6.0 version

We see a lot of segments are generated for the cubes and few of them are not
merged and keep on increasing. Can you please let us know how to handle
these segments. We also not able to delete them.
We are using KYLIN 1.6.0 version.

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: got exception when start kylin

[Na Zhai]

Hi, chenyang



Have you modified any configuration of Tomcat?



发送自 Windows 10 版邮件应用




发件人: chenyang 
发送时间: Friday, February 22, 2019 4:30:20 PM
收件人: dev@kylin.apache.org
主题: got exception when start kylin

may someone help me to solve this WARN：
｀｀｀
org.apache.catalina.LifecycleException: Failed to initialize component
[Connector[org.apache.coyote.http11.Http11Protocol-7443]]
at
org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:112)
at
org.apache.catalina.core.StandardService.initInternal(StandardService.java:552)
at
org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:107)
at
org.apache.catalina.core.StandardServer.initInternal(StandardServer.java:875)
at
org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:107)
at org.apache.catalina.startup.Catalina.load(Catalina.java:632)
at org.apache.catalina.startup.Catalina.start(Catalina.java:669)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:353)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:493)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:313)
at org.apache.hadoop.util.RunJar.main(RunJar.java:227)
Caused by: org.apache.catalina.LifecycleException: Protocol handler
initialization failed
at
org.apache.catalina.connector.Connector.initInternal(Connector.java:995)
at
org.apache.catalina.util.LifecycleBase.init(LifecycleBase.java:107)
... 18 more
Caused by: java.lang.IllegalArgumentException:
/home/deployer/apache-kylin-2.5.2-bin-cdh60/tomcat/conf/.keystore (No such
file or directory)
at
org.apache.tomcat.util.net.AbstractJsseEndpoint.createSSLContext(AbstractJsseEndpoint.java:115)
at
org.apache.tomcat.util.net.AbstractJsseEndpoint.initialiseSsl(AbstractJsseEndpoint.java:86)
at org.apache.tomcat.util.net.NioEndpoint.bind(NioEndpoint.java:244)
at
org.apache.tomcat.util.net.AbstractEndpoint.init(AbstractEndpoint.java:1087)
at
org.apache.tomcat.util.net.AbstractJsseEndpoint.init(AbstractJsseEndpoint.java:265)
at
org.apache.coyote.AbstractProtocol.init(AbstractProtocol.java:581)
at
org.apache.coyote.http11.AbstractHttp11Protocol.init(AbstractHttp11Protocol.java:68)
at
org.apache.catalina.connector.Connector.initInternal(Connector.java:993)
... 19 more
Caused by: java.io.FileNotFoundException:
/home/deployer/apache-kylin-2.5.2-bin-cdh60/tomcat/conf/.keystore (No such
file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.(FileInputStream.java:138)
at java.io.FileInputStream.(FileInputStream.java:93)
at
sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at
sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at
org.apache.tomcat.util.file.ConfigFileLoader.getInputStream(ConfigFileLoader.java:89)
at
org.apache.tomcat.util.net.SSLUtilBase.getStore(SSLUtilBase.java:140)
at
org.apache.tomcat.util.net.SSLHostConfigCertificate.getCertificateKeystore(SSLHostConfigCertificate.java:204)
at
org.apache.tomcat.util.net.jsse.JSSEUtil.getKeyManagers(JSSEUtil.java:184)
at
org.apache.tomcat.util.net.AbstractJsseEndpoint.createSSLContext(AbstractJsseEndpoint.java:113)
... 26 more
｀｀｀

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

[jira] [Created] (KYLIN-3818) After Cube disabled, merge cube job still running

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3818:
--

 Summary: After Cube disabled, merge cube job still running
 Key: KYLIN-3818
 URL: https://issues.apache.org/jira/browse/KYLIN-3818
 Project: Kylin
  Issue Type: Bug
Affects Versions: v2.6.0
Reporter: Na Zhai
Assignee: Na Zhai


There is a merge cube job with an error status, then I discard the job, then I 
disable the cube, but the merge cube job still running.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3817) Duration in Cube building is negative number

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3817:
--

 Summary: Duration in Cube building is negative number
 Key: KYLIN-3817
 URL: https://issues.apache.org/jira/browse/KYLIN-3817
 Project: Kylin
  Issue Type: Bug
Affects Versions: v2.6.0
Reporter: Na Zhai
Assignee: Na Zhai
 Attachments: Duration error.png

After building the cube for a few minutes, click the Refresh button and the 
duration of the job becomes negative. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

答复: [kylin] left join怎样join is null记录

[Na Zhai]

Hi, chen

I can not see your picture, you can try to add these in the attachment. Does it 
have any error message? Maybe you can try to change null to another word, like 
“unknown”.

Best wishes!

发送自 Windows 10 版邮件应用


发件人: chen snowlake 
发送时间: Thursday, February 14, 2019 6:07:01 PM
收件人: dev@kylin.apache.org
主题: [kylin] left join怎样join is null记录

HI：
大家好，在join的时候，我的联合的条件数据中存在is null记录，他们不能join起来
请问kylin是怎么写这样的查询？ 不胜感激
比如
[cid:image003.png@01D4C490.0483D3B0]

… left Join … on ((a.region = a0.region) or (a.region is null and a0.region is 
null )) 这样的条件并不能将 nul行join起来

[cid:image006.png@01D4C490.0483D3B0]
SnowLake
Email：che...@outlook.com

答复: spark.yarn.executor.memoryOverhead' has been deprecated problem

[Na Zhai]

Hi, yang

I can not see your picture, you can try to add these in the attachment. And if 
you want to find out why the Spark task failed, go to check the Yarn resource 
manager or Spark history server. And if you have resolved this problem, welcome 
to share to the community.

Best wishes!

发送自 Windows 10 版邮件应用


发件人: yang xiao 
发送时间: Tuesday, February 12, 2019 10:17:48 AM
收件人: dev@kylin.apache.org
主题: spark.yarn.executor.memoryOverhead' has been deprecated problem

Hi all,


Building cube encounter an error is about spark.yarn.executor.memoryOverhead 
parameter.

[image.png]

Kylin version is 2.6.0
Spark version is 2.3.x

I have already changed the corresponding parameter in 
/usr/local/apache-kylin-2.6.0-bin/conf/kylin.properties and restart the kylin 
,but it seems that the metadata in kylin system page do not affect by this 
change.

[image.png]
[image.png]

Does anyone knows how to solve this problem or gives some hints?

答复: 查询结果为0

[Na Zhai]

Hi，廉立伟.



What’s your Kylin version? There is an issue about Chinese characters: 
https://issues.apache.org/jira/browse/KYLIN-3705. If your Kylin version is 
lower than 2.5.2, I advise you to upgrade to the latest Kylin version.



Here are some tips for getting more useful info: check the “Here are some tips 
for you when encountering problems with Kylin” in this page 
http://kylin.apache.org/docs/gettingstarted/faq.html



Best wishes!



发送自 Windows 10 版邮件应用




发件人: 廉立伟 
发送时间: Monday, February 11, 2019 5:18:45 PM
收件人: dev@kylin.apache.org
主题: 查询结果为0

你好
select

 count(*)

 from HUOBI_GLOBAL.HUOBI_YUNYING_DW_KYLIN_USER_INDEX_DAILY

where HUOBI_YUNYING_DW_KYLIN_USER_INDEX_DAILY.EXCHANGE_NAME = 'b11'
我这样查询有结果
但是where条件中为中文结果为0，这个怎么解决呢
select

 count(*)

 from HUOBI_GLOBAL.HUOBI_YUNYING_DW_KYLIN_USER_INDEX_DAILY

where HUOBI_YUNYING_DW_KYLIN_USER_INDEX_DAILY.EXCHANGE_NAME = '中国'

结果为0

????: kylin ????merge ????

[Na Zhai]

Hi, .

   You are right. In Kylin2.2.0, there is an issue. Please check 
https://issues.apache.org/jira/browse/KYLIN-3165. If you want to use the 
feature of the auto merge, you can upgrade to 2.3.0 or the latest version.



?? Windows 10 ??




??:  <1059790...@qq.com>
: Thursday, January 31, 2019 11:56:46 AM
??: dev
: kylin merge 

??
 kylinmerge??
??merge
public void updateOnNewSegmentReady(String cubeName) {
final KylinConfig kylinConfig = KylinConfig.getInstanceFromEnv();
String serverMode = kylinConfig.getServerMode();
if (Constant.SERVER_MODE_JOB.equals(serverMode.toLowerCase())
|| Constant.SERVER_MODE_ALL.equals(serverMode.toLowerCase())) {
CubeInstance cube = getCubeManager().getCube(cubeName);
if (cube != null) {
CubeSegment seg = cube.getLatestBuiltSegment();
if (seg != null && seg.getStatus() == SegmentStatusEnum.READY) {
keepCubeRetention(cubeName);
mergeCubeSegment(cubeName);
}
}
}
}



private void mergeCubeSegment(String cubeName) {
CubeInstance cube = getCubeManager().getCube(cubeName);
if (!cube.needAutoMerge())
return;


synchronized (CubeService.class) {
try {
cube = getCubeManager().getCube(cubeName);
SegmentRange offsets = cube.autoMergeCubeSegments();
if (offsets != null) {
CubeSegment newSeg = getCubeManager().mergeSegments(cube, 
null, offsets, 
true);//??cube??merge??cubecube??
logger.debug("Will submit merge job on " + newSeg);
DefaultChainedExecutable job = 
EngineFactory.createBatchMergeJob(newSeg, "SYSTEM");
getExecutableManager().addJob(job);
} else {
logger.debug("Not ready for merge on cube " + cubeName);
}
} catch (IOException e) {
logger.error("Failed to auto merge cube " + cubeName, e);
}
}
}



public CubeSegment mergeSegments(CubeInstance cube, TSRange tsRange, 
SegmentRange segRange, boolean force)
throws IOException {
if (cube.getSegments().isEmpty())
throw new IllegalArgumentException("Cube " + cube + " has no 
segments");


checkInputRanges(tsRange, segRange);
checkBuildingSegment(cube);
checkCubeIsPartitioned(cube);


if (cube.getSegments().getFirstSegment().isOffsetCube()) {
// offset cube, merge by date range?
if (segRange == null && tsRange != null) {
Pair pair = 
cube.getSegments(SegmentStatusEnum.READY)
.findMergeOffsetsByDateRange(tsRange, Long.MAX_VALUE);
if (pair == null)
throw new IllegalArgumentException("Find no segments to 
merge by " + tsRange + " for cube " + cube);
segRange = new 
SegmentRange(pair.getFirst().getSegRange().start, 
pair.getSecond().getSegRange().end);
}
tsRange = null;
Preconditions.checkArgument(segRange != null);
} else {
segRange = null;
Preconditions.checkArgument(tsRange != null);//
}



kylin2.2.x

[jira] [Created] (KYLIN-3805) Add documentation about the purpose of each HDFS directory

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3805:
--

 Summary: Add documentation about the purpose of each HDFS directory
 Key: KYLIN-3805
 URL: https://issues.apache.org/jira/browse/KYLIN-3805
 Project: Kylin
  Issue Type: Improvement
  Components: Documentation
Reporter: Na Zhai
Assignee: Na Zhai


Kylin is lack of docs about the purpose of each HDFS directory.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

????: kylin ??????????merge??????????

[Na Zhai]

Hi, wanglin.

   What??s your Kylin version? There is an issue about auto merge: 
https://issues.apache.org/jira/browse/KYLIN-3718.

But I think your error is not related to that issue. It is may be caused by the 
deletion of cube_statistics directory.



?? Windows 10 ??




??:  <1059790...@qq.com>
: Monday, January 28, 2019 10:23:37 AM
??: dev
: kylin ??merge??

??
  ??kylin ??cube728
kylin 
??cube


??#2 Step Name: Merge Cuboid Statistics Duration:  
0.01 mins Waiting:  0 seconds
??java.lang.NullPointerException
at 
org.apache.kylin.engine.mr.steps.MergeStatisticsStep.doWork(MergeStatisticsStep.java:80)
  at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)
  at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:144)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
  at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
  at java.lang.Thread.run(Thread.java:745)

答复: hadoop的hdfs写入策略为可用空间，有人用过吗

[Na Zhai]

Hi, yunyao.

   I have not used, I do some research about it, 
http://www.dataguru.cn/article-13325-1.html,  
https://my.oschina.net/xiaozhublog/blog/786788. Why do you want to use 
available space? If you want to gain more useful info, you’d better explain the 
intent for asking a question.

   Best Wishes!





发送自 Windows 10 版邮件应用




发件人: 黄云尧 
发送时间: Tuesday, January 22, 2019 5:59:02 PM
收件人: dev@kylin.apache.org
主题: hadoop的hdfs写入策略为可用空间，有人用过吗

????: 2.6.0 Build cube failed by #4 Build Dimension Dictionary

[Na Zhai]

Hi, ??.
   I can not see your pic, you can try to add this in the attachment.
   Best wishes!

?? Windows 10 ??


??: ?? <137287...@qq.com>
: Monday, January 21, 2019 11:32:38 AM
??: dev
: 2.6.0 Build cube failed by #4 Build Dimension Dictionary

Hi all~
The reason for using the new version is the need to complete the construction 
of high cardinal global dictionary.
But it was doesn't work.


data: [numFiles=6, numRows=5835351, totalSize=118588431, rawDataSize=448219626]

two count(disinct) column cardinality
[cid:5762EBCD@9699A634.563D455C]
[cid:7E8A1645@0E723654.563D455C]

kylin.log
[cid:F24120F8@21E73540.563D455C]


gc.log
[cid:B25FE6C2@054B8E1D.563D455C]

#4 Step Name: Build Dimension Dictionary
[cid:268D4D51@2744944E.563D455C]


My env:
 kylin 2.6.0

config:
kylin.engine.spark.rdd-partition-cut-mb = 32
kylin.storage.hbase.region-cut-gb = 1

jvm:
export KYLIN_JVM_SETTINGS="-Xms10240M -Xmx20480M -Xss1024K -XX:MaxPermSize=512M 
-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps 
-Xloggc:$KYLIN_HOME/logs/kylin.gc.$$ -XX:+UseGCLogFileRotation 
-XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M"




Aron-Chung

[jira] [Created] (KYLIN-3781) Can not start Kylin in Idea on Windows

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3781:
--

 Summary: Can not start Kylin in Idea on Windows
 Key: KYLIN-3781
 URL: https://issues.apache.org/jira/browse/KYLIN-3781
 Project: Kylin
  Issue Type: Bug
 Environment: Windows
Reporter: Na Zhai
Assignee: Chao Long


After merge pr of issue https://issues.apache.org/jira/browse/KYLIN-3734, I get 
an error about ZookeeperDistributedLock when starting Kylin in Idea.

After check code, I find that "return new File(path).getCanonicalPath();" in 
ZookeeperDistributedLock.java  add the drive letter of my operating system. It 
will make zookeeper not get the lock. My environment is Windows.

Error message:
Caused by: java.lang.IllegalStateException: Error while 6260@NaZhai-PC trying 
to lock F:\kylin\kylin_metadata_idea\job_engine\global_job_engine_lock
at 
org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:153)
at 
org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:170)
at 
org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lockJobEngine(ZookeeperDistributedLock.java:316)
at 
org.apache.kylin.storage.hbase.util.ZookeeperJobLock.lockJobEngine(ZookeeperJobLock.java:81)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler.init(DefaultScheduler.java:152)
at 
org.apache.kylin.rest.service.JobService.afterPropertiesSet(JobService.java:126)
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1687)
at 
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1624)
... 61 more
Caused by: java.lang.IllegalArgumentException: Path must start with / character
at org.apache.curator.utils.PathUtils.validatePath(PathUtils.java:54)
at org.apache.curator.utils.PathUtils.validatePath(PathUtils.java:37)
at org.apache.curator.utils.ZKPaths.fixForNamespace(ZKPaths.java:63)
at 
org.apache.curator.framework.imps.NamespaceImpl.fixForNamespace(NamespaceImpl.java:82)
at 
org.apache.curator.framework.imps.CuratorFrameworkImpl.fixForNamespace(CuratorFrameworkImpl.java:579)
at 
org.apache.curator.framework.imps.CreateBuilderImpl.forPath(CreateBuilderImpl.java:434)
at 
org.apache.curator.framework.imps.CreateBuilderImpl.forPath(CreateBuilderImpl.java:44)
at 
org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:149)
... 68 more



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

答复: ERROR context.ContextLoader:350 : Context initialization failed

[Na Zhai]

Hi, Jock.

   Do you follow the instructions on this page? 
http://kylin.apache.org/development/dev_env.html. And I find “ClusterId read in 
ZooKeeper is null” in the log that you provide, so I think the environment for 
you developing has the problem.



发送自 Windows 10 版邮件应用




发件人: Jock 
发送时间: Wednesday, January 16, 2019 5:17:39 PM
收件人: dev@kylin.apache.org
主题: ERROR context.ContextLoader:350 : Context initialization failed

Hello,


I am getting following error when I try to run the source code of  kylin 2.3 in 
IntelliJ IDEA. I have no idea  about it. Could you give some suggests about it?


Really appreciated.


2019-01-16 16:34:01,778 INFO  [main] common.KylinConfig:378 : Setting sandbox 
env, KYLIN_CONF=/home/hadoop/Desktop/kylin-2.3.x 
(2)/server/../examples/test_case_data/sandbox
2019-01-16 16:34:01,801 INFO  [main] util.ClassUtil:40 : Adding path 
/home/hadoop/Desktop/kylin-2.3.x (2)/server/../examples/test_case_data/sandbox 
to class path
2019-01-16 16:34:01,807 INFO  [main] common.KylinConfig:319 : Loading 
kylin-defaults.properties from 
/home/hadoop/Desktop/kylin-2.3.x%20(2)/core-common/target/classes/kylin-defaults.properties
2019-01-16 16:34:01,891 INFO  [main] common.KylinConfig:274 : Use 
KYLIN_CONF=/home/hadoop/Desktop/kylin-2.3.x 
(2)/server/../examples/test_case_data/sandbox
2019-01-16 16:34:01,896 INFO  [main] common.KylinConfig:99 : Initialized a new 
KylinConfig from getInstanceFromEnv : 1308927845
2019-01-16 16:34:01,897 INFO  [main] common.KylinConfigBase:1074 : override 
kylin.engine.mr.job-jar to /home/hadoop/Desktop/kylin-2.3.x 
(2)/server/../assembly/target/kylin-assembly-2.3.2-SNAPSHOT-job.jar
2019-01-16 16:34:01,901 INFO  [main] common.KylinConfigBase:919 : override 
kylin.storage.hbase.coprocessor-local-jar to /home/hadoop/Desktop/kylin-2.3.x 
(2)/server/../storage-hbase/target/kylin-storage-hbase-2.3.2-SNAPSHOT-coprocessor.jar
一月 16, 2019 4:34:03 下午 org.apache.catalina.core.AprLifecycleListener 
lifecycleEvent
信息: The APR based Apache Tomcat Native library which allows optimal performance 
in production environments was not found on the java.library.path: 
/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
一月 16, 2019 4:34:05 下午 org.apache.coyote.AbstractProtocol init
信息: Initializing ProtocolHandler ["http-bio-7070"]
一月 16, 2019 4:34:05 下午 org.apache.catalina.core.StandardService startInternal
信息: Starting service Tomcat
一月 16, 2019 4:34:05 下午 org.apache.catalina.core.StandardEngine startInternal
信息: Starting Servlet Engine: Apache Tomcat/7.0.85
一月 16, 2019 4:34:06 下午 org.apache.catalina.startup.ContextConfig 
getDefaultWebXmlFragment
信息: No global web.xml found
一月 16, 2019 4:34:33 下午 org.apache.catalina.startup.TldConfig execute
信息: At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug 
logging for this logger for a complete list of JARs that were scanned but no 
TLDs were found in them. Skipping unneeded JARs during scanning can improve 
startup time and JSP compilation time.
一月 16, 2019 4:34:33 下午 org.apache.catalina.core.ApplicationContext log
信息: No Spring WebApplicationInitializer types detected on classpath
一月 16, 2019 4:34:33 下午 org.apache.catalina.core.ApplicationContext log
信息: Initializing Spring root WebApplicationContext
2019-01-16 16:34:36,912 DEBUG [localhost-startStop-1] 
security.PasswordPlaceholderConfigurer:174 : Loading properties file from 
InputStream resource [resource loaded through InputStream]
2019-01-16 16:34:38,213 INFO  [localhost-startStop-1] 
metrics.MetricsManager:135 : Kylin metrics monitor is not enabled!!!
2019-01-16 16:34:39,843 INFO  [localhost-startStop-1] 
init.InitialTaskManager:38 : Kylin service is starting.
2019-01-16 16:34:40,114 INFO  [localhost-startStop-1] 
persistence.ResourceStore:86 : Using metadata url kylin_metadata@hbase for 
resource store
2019-01-16 16:34:40,753 WARN  [localhost-startStop-1] util.NativeCodeLoader:62 
: Unable to load native-hadoop library for your platform... using builtin-java 
classes where applicable
2019-01-16 16:34:42,391 WARN  [localhost-startStop-1] 
shortcircuit.DomainSocketFactory:117 : The short-circuit local reads feature 
cannot be used because libhadoop cannot be loaded.
2019-01-16 16:34:42,583 DEBUG [localhost-startStop-1] hbase.HBaseConnection:181 
: Using the working dir FS for HBase: hdfs://localhost:8020
2019-01-16 16:34:42,586 INFO  [localhost-startStop-1] hbase.HBaseConnection:258 
: connection is null or closed, creating a new one
2019-01-16 16:34:42,907 INFO  [localhost-startStop-1] 
zookeeper.RecoverableZooKeeper:121 : Process identifier=hconnection-0x125fd6ae 
connecting to ZooKeeper ensemble=localhost:2181
2019-01-16 16:34:42,931 INFO  [localhost-startStop-1] zookeeper.ZooKeeper:100 : 
Client environment:zookeeper.version=3.4.8--1, built on 02/06/2016 03:18 GMT
2019-01-16 16:34:42,932 INFO  [localhost-startStop-1] zookeeper.ZooKeeper:100 : 
Client 

答复: Quicksight integration with apache kylin

[Na Zhai]

Hi, venkateshd.

   If you do successfully. Welcome to write an article about this to the 
community.



   Best wishes!



发送自 Windows 10 版邮件应用




发件人: venkateshd 
发送时间: Saturday, January 12, 2019 8:36:58 AM
收件人: dev@kylin.apache.org
主题: Quicksight integration with apache kylin

Did anyone tried integrating Apache Kylin with AWS QuickSight successfully.
If so can you post us some information regarding the same. As such there is
no third party library available for making this integration possible.

If someone developed a package for integrating these two components please
let me know

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

[jira] [Created] (KYLIN-3766) Add docs for Query SQL Function and Data Type

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3766:
--

 Summary: Add docs for Query SQL Function and Data Type
 Key: KYLIN-3766
 URL: https://issues.apache.org/jira/browse/KYLIN-3766
 Project: Kylin
  Issue Type: Improvement
  Components: Documentation
Reporter: Na Zhai
Assignee: Na Zhai


Kylin is lack of docs for SQL Function and data type that Kylin supported.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

????: hive Exception Storage schema reading not supported

[Na Zhai]

Hi, .
   It may be your env has the problem, your hive configuration is not 
right. We recommend you to try out Kylin or develop it using the integrated 
sandbox, such as HDP 
sandbox, and make sure it 
has at least 10 GB of memory. When configuring a sandbox, we recommend that you 
use the Bridged Adapter model instead of the NAT model.

   Best wishes!

?? Windows 10 ??


??:  <3513797...@qq.com>
: Wednesday, January 2, 2019 12:28:19 PM
??: dev
: hive Exception Storage schema reading not supported


env:
ubuntu 16.04
apache-kylin-2.5.2-bin-hadoop3
hive:3.1.1
hbase:2.1.1
zookeeper:3.4.12

kylin can start, but  can not load table , error arise??
[cid:C2ED1DD0@5A5C947E.E33D2C5C]
There are some errors in "logs/kylin.out":
2019-01-02 01:03:50,169 ERROR [http-nio-7070-exec-6] 
controller.TableController:125 : Failed to load Hive Table
java.lang.RuntimeException: cannot get HiveTableMeta
at 
org.apache.kylin.source.hive.HiveMetadataExplorer.loadTableMetadata(HiveMetadataExplorer.java:64)
at 
org.apache.kylin.rest.service.TableService.extractHiveTableMeta(TableService.java:202)
at 
org.apache.kylin.rest.service.TableService.loadHiveTablesToProject(TableService.java:129)
at 
org.apache.kylin.rest.controller.TableController.loadHiveTables(TableController.java:109)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at 
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
at 
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
at 
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
at 
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
at 
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
at 
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
at 
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
at 
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
at 
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:661)
at 
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
at 
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
at 
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 

答复: kylin(2.6.0-SNAPSHOT) Integration Test Problem

[Na Zhai]

Hi, 杨钰覃.
   Next time when you want to send an email to dev@kylin.apache.org, you 
should subscribe first, or your email will not be seen in the community. You 
can refer to this page to subscribe to community  
http://kylin.apache.org/community/.
   For your question, you can try to run DebugTomcat and use GUI to see 
which job failed, and then check the error message.

发送自 Windows 10 版邮件应用


发件人: 杨钰覃 
发送时间: Saturday, December 29, 2018 1:28:38 PM
收件人: dev@kylin.apache.org
抄送: 胡备
主题: kylin(2.6.0-SNAPSHOT) Integration Test Problem


Hi,I meet some problems during Integration Test. My environment : 
kylin2.6.0+hdp2.4.0.0-169+Apache Maven 3.6.0+jdk1.8.0_191.

In FastBuildMode, I have passed the "BuildCubeWithEngine" test,but failed 
"BuildCubeWithStream".So I blocked the "BuildCubeWithEngine" in the pom.xml of 
kylin-it directory. However,Integration Test (only deal with the 
"BuildCubeWithStream") continued for 18 seconds. I redirected the terminal Info 
into a file named "yyt_error2.txt".

Here is part of the Info:


zkConnectionStrsandbox.hortonworks.com/kylin/streaming/554a44be-edbe-1d36-a6c9-1e75bc840342
Kafka 0:6667 dir:WrappedArray(/tmp/e54f572e-c6a5-8cc6-2e59-89b06c59f772)
[ERROR] Command execution failed.
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit 
value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal 
(DefaultExecutor.java:404)
at org.apache.commons.exec.DefaultExecutor.execute 
(DefaultExecutor.java:166)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:804)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:751)
at org.codehaus.mojo.exec.ExecMojo.execute (ExecMojo.java:313)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo 
(DefaultBuildPluginManager.java:137)
...

[INFO] Apache Kylin - Tool Assembly ... SUCCESS [  2.479 s]
[INFO] Apache Kylin - Integration Test  FAILURE [ 18.661 s]
[INFO] Apache Kylin - Tomcat Extension  SUCCESS [  0.686 s]
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time:  09:29 min
[INFO] Finished at: 2018-12-29T02:07:23Z
[INFO] 
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:exec 
(build_cube_with_stream) on project kylin-it: Command execution failed.: 
Process exited with an error: 1 (Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
org.codehaus.mojo:exec-maven-plugin:1.6.0:exec (build_cube_with_stream) on 
project kylin-it: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:215)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:156)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute 
(MojoExecutor.java:148)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject 
(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject 
(LifecycleModuleBuilder.java:81)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
 (SingleThreadedBuilder.java:56)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute 
(LifecycleStarter.java:128)​
...

I appreciate your wise reply very much.




#/**本邮件及其附件含有小米公司的保密信息，仅限于发送给上面地址中列出的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本邮件！
 This e-mail and its attachments contain confidential information from XIAOMI, 
which is intended only for the person or entity whose address is listed above. 
Any use of the information contained herein in any way (including, but not 
limited to, total or partial disclosure, reproduction, or dissemination) by 
persons other than the intended recipient(s) is prohibited. If you receive this 
e-mail in error, please notify the sender by phone or email immediately and 
delete it!**/#

答复: 答复: Kylin2.5 - org.apache.catalina.LifecycleException: Failed to start component

[Na Zhai]

Hi, CookieNats.



   Have you run the bin/sample.sh? In this script, "engine_type" and 
"storage_type" will be set. If it does not work, it may be your env has the 
problem. You can modify the script or modify the kylin_sales_cube.json as the 
article saying. That is a good way. After you run Kylin in the right way. You 
can change the "engine_type" in Model -> Cube Designer -> Advanced Setting page.



   Best wishes!



发送自 Windows 10 版邮件应用




发件人: CookieNats 
发送时间: Wednesday, December 26, 2018 5:41:04 PM
收件人: dev@kylin.apache.org
主题: Re: 答复: Kylin2.5 - org.apache.catalina.LifecycleException: Failed to start 
component

Hi kylin-dev,


在您的指导下经过一段时间摸索和尝试我本地的kylin已经启动起来，导入sample例子，不过遇到一个问题，例子中kylin_sales_cube.json里有一个环境变量导致load
cube的时候介些json出错，所以麻烦告知一下这个参数应该在哪里设置，并在在网上看到里相同问题：https://blog.csdn.net/u010429286/article/details/72722597，不过他是使用修改json的方式解决的。

"engine_type" : %default_engine_type%,
"storage_type" : %default_storage_type%

感谢kylin团队的支持

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: show the kylin sql for timeout

[Na Zhai]

Hi, yunyao.

   Is that you mean you want to see the phenomenon of SQL query timeout? 
Why do you want to do that? Or you just want to know the value of timeout?



发送自 Windows 10 版邮件应用




发件人: 黄云尧 
发送时间: Monday, December 24, 2018 4:52:05 PM
收件人: dev@kylin.apache.org
主题: show the kylin sql for timeout

I want to demo the appearance when a sql for timeout in kylin query , someone 
has a good idea?

答复: Kylin2.5 - org.apache.catalina.LifecycleException: Failed to start component

[Na Zhai]

Hi, CookieNats.

   From your log, I see the “localhost/127.0.0.1:2181. Will not attempt to 
authenticate using SASL

(unknown error)” error. Maybe you can check the health of zookeeper. I do some 
search for this, hope this can help you. 
https://blog.csdn.net/qq642159746/article/details/51455672. And If you are not 
in production env, you can try to delete the metadata being used under the 
/kylin dir in zookeeper, Kylin metadata table in HBase.



发送自 Windows 10 版邮件应用




发件人: CookieNats 
发送时间: Monday, December 24, 2018 5:06:17 PM
收件人: dev@kylin.apache.org
主题: Re: Kylin2.5 - org.apache.catalina.LifecycleException: Failed to start 
component

Thanks for you Reply, I changed to  apache-kylin-2.5.2-bin-hadoop3.tar.gz,
but get new Error about Hbase, please view this and give some suggestion,
thx!!

mac-os
hadoop-3.1.1
hive-3.1.1
hbase-2.0.0
zookeeper-3.4.12


2018-12-24 16:53:59,242 INFO  [ReadOnlyZKClient-localhost:2181@0x40bffbca]
zookeeper.ZooKeeper:438 : Initiating client connection,
connectString=localhost:2181 sessionTimeout=9
watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$10/785622181@582b1856
2018-12-24 16:53:59,280 INFO
[ReadOnlyZKClient-localhost:2181@0x40bffbca-SendThread(localhost:2181)]
zookeeper.ClientCnxn:1032 : Opening socket connection to server
localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL
(unknown error)
2018-12-24 16:53:59,332 INFO
[ReadOnlyZKClient-localhost:2181@0x40bffbca-SendThread(localhost:2181)]
zookeeper.ClientCnxn:876 : Socket connection established to
localhost/127.0.0.1:2181, initiating session
2018-12-24 16:53:59,346 INFO
[ReadOnlyZKClient-localhost:2181@0x40bffbca-SendThread(localhost:2181)]
zookeeper.ClientCnxn:1299 : Session establishment complete on server
localhost/127.0.0.1:2181, sessionid = 0x10003c0762b0031, negotiated timeout
= 4
Exception in thread "main" java.lang.IllegalArgumentException: Failed to
find metadata store by url: kylin_metadata@hbase
at
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98)
at
org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110)
at
org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98)
at
org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92)
... 3 more
Caused by: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException:
org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column
family table does not exist in region hbase:meta,,1.1588230740 in table
'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 =>
'|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'},
{NAME => 'info', BLOOMFILTER => 'NONE', VERSIONS => '10', IN_MEMORY =>
'true', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL =>
'FOREVER', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', MIN_VERSIONS
=> '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}
at
org.apache.hadoop.hbase.regionserver.HRegion.checkFamily(HRegion.java:7889)
at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6893)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2079)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33766)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2205)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
at java.lang.Thread.run(Thread.java:748)

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:100)
at

答复: which cube is response for query when 2 models has different filters in 1 datasource table?

[Na Zhai]

Hi, yiwang.

If multiple cubes contain the same table, Kylin will do the following thing.

first, Kylin will choose the cube that contains all the dimensions in your SQL.

second, if there are still more than one cubes, Kylin will choose the cube that 
has less cost(it depends on the dimension, measure and inner join number).



发送自 Windows 10 版邮件应用




发件人: yiwang <756470...@qq.com>
发送时间: Friday, December 21, 2018 2:29:16 PM
收件人: dev@kylin.apache.org
主题: which cube is response for query when 2 models has different filters in 1 
datasource table?

Hello kylin team；
for example,
I created 2 Models using sample table: "KYLIN_SALES".
Model: Test1 has filter seller_id=1994, Test2 has filter
seller_id=1998
then I built 2 cubes for each model,
get a valid table for query: KYLIN_SALES

when i execute sql: select SELLER_ID,count(*) from KYLIN_SALES group by
SELLER_ID
all records returned are seller_id=1994

which makes confused is one table contains multiple models and cubes,
how is kylin to determine which model or cube should  response for query?
especially the same filter has different values like above what i said.

Thanks
Yi



--
Sent from: http://apache-kylin.74782.x6.nabble.com/

????: about kylin-2.5.1 Unsupported data type array

[Na Zhai]

Hi, .
You can check this Jira https://issues.apache.org/jira/browse/KYLIN-3731 for 
tracking the solution or the answer.

?? Windows 10 ??


??:  <1291686...@qq.com>
: Thursday, December 20, 2018 10:45:46 AM
??: dev
: about kylin-2.5.1 Unsupported data type array

dear??
 as kylin was recently upgraded from 2.3 to 2.5.1, its data type of array 
metadata was found to be unsupported and the following exception occurred
"java. lang. IllegalArgumentException: Unsupported data type array", are in 
kylin2.3 hive data storage array before running this type is no problem, there 
is the lead in building a cube when the third step is as follows
"org. apache. kylin. engine. mr. Exception. MapReduceException: no counters for 
the job", could you tell me how to solve the problem without changing data 
structure situation now?
please  look up the  attachment??

[cid:DB9FA94F@F18BBB57.5A021B5C]


---
best   wish??
thank your??

答复: Kylin2.5 - org.apache.catalina.LifecycleException: Failed to start component

[Na Zhai]

Hi, CookieNats.

   You can download the apache-kylin-2.5.2-bin-hadoop3.tar.gz from this 
page http://kylin.apache.org/download/. This binary package is for Hadoop 3.1 + 
HBase 2.0. You can try this one.



发送自 Windows 10 版邮件应用




发件人: CookieNats 
发送时间: Friday, December 21, 2018 9:14:56 PM
收件人: dev@kylin.apache.org
主题: Kylin2.5 - org.apache.catalina.LifecycleException: Failed to start component

env:
mac-os:
hadoop-3.1.1
hive-3.1.1
hbase-1.2.8

Failed to start component
Please help me,thanks a lot.



十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol pause
信息: Pausing ProtocolHandler ["http-bio-7070"]
十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol pause
信息: Pausing ProtocolHandler ["http-bio-7443"]
十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol pause
信息: Pausing ProtocolHandler ["ajp-bio-9009"]
十二月 21, 2018 8:20:35 下午 org.apache.catalina.core.StandardService
stopInternal
信息: Stopping service Catalina
十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol stop
信息: Stopping ProtocolHandler ["http-bio-7070"]
十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol stop
信息: Stopping ProtocolHandler ["http-bio-7443"]
十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol stop
信息: Stopping ProtocolHandler ["ajp-bio-9009"]
十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol destroy
信息: Destroying ProtocolHandler ["http-bio-7070"]
十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol destroy
信息: Destroying ProtocolHandler ["http-bio-7443"]
十二月 21, 2018 8:20:35 下午 org.apache.coyote.AbstractProtocol destroy
信息: Destroying ProtocolHandler ["ajp-bio-9009"]
十二月 21, 2018 8:22:17 下午 org.apache.catalina.core.AprLifecycleListener
lifecycleEvent
信息: The APR based Apache Tomcat Native library which allows optimal
performance in production environments was not found on the
java.library.path:
/Users/xm365/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.:/usr/local/Cellar/hbase/1.2.8/libexec/lib/native/Mac_OS_X-x86_64-64
十二月 21, 2018 8:22:18 下午 org.apache.coyote.AbstractProtocol init
信息: Initializing ProtocolHandler ["http-bio-7070"]
十二月 21, 2018 8:22:18 下午 org.apache.coyote.AbstractProtocol init
信息: Initializing ProtocolHandler ["http-bio-7443"]
十二月 21, 2018 8:22:18 下午 org.apache.coyote.AbstractProtocol init
信息: Initializing ProtocolHandler ["ajp-bio-9009"]
十二月 21, 2018 8:22:18 下午 org.apache.catalina.startup.Catalina load
信息: Initialization processed in 1224 ms
十二月 21, 2018 8:22:18 下午 org.apache.catalina.core.StandardService
startInternal
信息: Starting service Catalina
十二月 21, 2018 8:22:18 下午 org.apache.catalina.core.StandardEngine
startInternal
信息: Starting Servlet Engine: Apache Tomcat/7.0.91
十二月 21, 2018 8:22:18 下午 org.apache.catalina.startup.HostConfig deployWAR
信息: Deploying web application archive
/Users/xm365/dev/apache-kylin-2.5.2-bin-hbase1x/tomcat/webapps/kylin.war
十二月 21, 2018 8:22:19 下午 org.apache.catalina.core.ContainerBase
addChildInternal
严重: ContainerBase.addChild: start:
org.apache.catalina.LifecycleException: Failed to start component
[StandardEngine[Catalina].StandardHost[localhost].StandardContext[/kylin]]
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:162)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:1018)
at 
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:994)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652)
at 
org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1127)
at
org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:2021)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoSuchMethodError:
org.apache.tomcat.JarScanner.scan(Lorg/apache/tomcat/JarScanType;Ljavax/servlet/ServletContext;Lorg/apache/tomcat/JarScannerCallback;)V
at org.apache.jasper.servlet.TldScanner.scanJars(TldScanner.java:262)
at org.apache.jasper.servlet.TldScanner.scan(TldScanner.java:106)
at
org.apache.jasper.servlet.JasperInitializer.onStartup(JasperInitializer.java:103)
at
org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5669)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:145)
... 10 more

十二月 21, 2018 8:22:19 下午 org.apache.catalina.startup.HostConfig deployWAR
严重: Error deploying web application archive
/Users/xm365/dev/apache-kylin-2.5.2-bin-hbase1x/tomcat/webapps/kylin.war

答复: can I use Dimensions and measures on the same property

[Na Zhai]

Hi, wanghonglin.

If you mean when you choose the property in dimension, it can not be chosen in 
the measure in a model, it is right. But it does not prevent query. You can set 
all properties in dimension, then you can also query any properties as the 
measure. But if you do not choose it as the measure. It may influences query 
performance and causes Cube to inflate. So I do not advice you do that.

Why you use Dimensions and measures on the same property? And your situation is 
rare, can you provide the scene that you want to use Kylin? Then according to 
your scene, maybe can give you more suggestion.



发送自 Windows 10 版邮件应用




发件人: wanghonglin 
发送时间: Wednesday, December 19, 2018 11:39:51 AM
收件人: dev@kylin.apache.org
主题: can I use Dimensions and measures on the same property

when I create models, i want use Dimensions and measures on the same 
property，it’s fail

i use kylin v2.5.1

is kylin not support or I method is wrong

thx

答复: use single quote in sql ,how to escape

[Na Zhai]

Hi, yunyao.

What’s your Kylin version?  Hope this can help you, 
https://issues.apache.org/jira/browse/KYLIN-3700.



发送自 Windows 10 版邮件应用




发件人: 黄云尧 
发送时间: Wednesday, December 19, 2018 4:14:21 PM
收件人: dev@kylin.apache.org
主题: use single quote in sql ,how to escape

the sql : select * from buzz_info where title like '%hello i' am 
kangkan%'


but it is a worry grammar,how to escape by use single quote.


I am looking forward to your reply

????: kylin2.5.1 join ?????????? ????null ??????????????????

[Na Zhai]

Hi,

You can check https://issues.apache.org/jira/browse/KYLIN-3712 for the answer.



?? Windows 10 ??




??: 174962541 <174962...@qq.com>
: Friday, December 7, 2018 12:12:41 PM
??: dev
: kylin2.5.1 join ?? null ??

??
select KYLIN_SALES.PART_DT, sum(KYLIN_SALES.PRICE) from KYLIN_SALES inner join 
KYLIN_ACCOUNT as TT on KYLIN_SALES.BUYER_ID = TT.ACCOUNT_ID where 
TT.ACCOUNT_COUNTRY = 'US' group by KYLIN_SALES.PART_DT
??cdh 6.0.1
  sum(KYLIN_SALES.PRICE) null
??joinnull

答复: 回复： [DISCUSS] Stop inserting git diffs to JIRA ticket

[Na Zhai]

+1



发送自 Windows 10 版邮件应用




发件人: Chao Long 
发送时间: Monday, December 3, 2018 10:48:48 AM
收件人: dev
主题: 回复： [DISCUSS] Stop inserting git diffs to JIRA ticket

+1


--
Best Regards,
Chao Long







-- 原始邮件 --
发件人: "Yichen Zhou";
发送时间: 2018年12月3日(星期一) 上午10:25
收件人: "dev";

主题: Re: [DISCUSS] Stop inserting git diffs to JIRA ticket



+1

Regards,
Yichen

On Mon, Dec 3, 2018 at 10:00 AM Zhong, Yanghong 
wrote:

> +1.
>
> Best regards,
> Yanghong Zhong
>
> On 12/3/18, 9:59 AM, "Billy Liu"  wrote:
>
> +1.
>
> With Warm regards
>
> Billy Liu
>
> ShaoFeng Shi  于2018年12月3日周一 上午9:46写道：
> >
> > Hello Kylin developers,
> >
> > After we enable the git box for Kylin code repository, when there is
> a PR
> > merged, the "ASF Github Bot" will insert the git diff to the
> associated
> > JIRA. We noticed this function will make the JIRA very long when the
> code
> > change is big. Besides, when cherry-picking the change to another
> branch,
> > it will append again. This makes it is too hard for a human to read
> the
> > JIRA, the important message may be overlooked.
> >
> > A typical sample is this:
> >
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FKYLIN-3187data=02%7C01%7Cyangzhong%40ebay.com%7C18f5152fce4841b09ebe08d658c2f778%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636793991734125047sdata=nVN71DWTfDcfnVUABdyIvJWJMqyJkUajlOdgxBTN3VA%3Dreserved=0
> >
> > My proposal is, stopping sync the code change from GitHub to JIRA;
> Only
> > keep necessary notifications like "A PR is created/closed" etc. For
> the
> > code change, people should go to GitHub code history, not JIRA.
> >
> > Please express your ideas; If no objection in the next couple of
> days, we
> > will raise a change request to the infrastructure team.
> >
> > Thanks for your input!
> >
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> > Apache Kylin PMC
> > Work email: shaofeng@kyligence.io
> > Kyligence Inc:
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkyligence.io%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7C18f5152fce4841b09ebe08d658c2f778%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636793991734125047sdata=u2IdyQRH82jqdN7m3KPM4hRzkXGDdMxWvilw3u%2FzqPs%3Dreserved=0
> >
> > Apache Kylin FAQ:
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.htmldata=02%7C01%7Cyangzhong%40ebay.com%7C18f5152fce4841b09ebe08d658c2f778%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636793991734125047sdata=ugb4KeubkMASYJxJx0MfKRqO%2FPlJheClZ7rKUTDAZxw%3Dreserved=0
> > Join Kylin user mail group: user-subscr...@kylin.apache.org
> > Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>
>
>

????: ??????[VOTE] Release apache-kylin-2.5.2 (RC2)

[Na Zhai]

+1

mvn test passed



?? Windows 10 ??




??: Chao Long 
: Saturday, December 1, 2018 9:16:50 AM
??: dev
: ??[VOTE] Release apache-kylin-2.5.2 (RC2)

+1
mvn test passed


-
Chao Long



--  --
??: "ShaoFeng Shi";
: 2018??11??30??(??) 9:57
??: "dev";

: [VOTE] Release apache-kylin-2.5.2 (RC2)



Hi all,

I have created a build for Apache Kylin 2.5.2, release candidate 2.

Changes:
[KYLIN-3187] - JDK APIs using the default locale, time zone or character
set should be avoided
[KYLIN-3636] - Wrong "storage_type" in CubeDesc causing cube building error
[KYLIN-3666] - Mege cube step 2: Update dictionary throws
IllegalStateException
[KYLIN-3672] - Performance is poor when multiple queries occur in a short
period
[KYLIN-3676] - Update to custom calcite and remove the "atopcalcite"
[KYLIN-3678] - CacheStateChecker may remove a cache file that under a
building
[KYLIN-3683] - Package org.apache.commons.lang3 not exists
[KYLIN-3689] - When the startTime is equal to the endTime in build request,
the segment will build all data.
[KYLIN-3693] - TopN, Count distinct incorrect in Spark engine
[KYLIN-3705] - Segment Pruner mis-functions when the source data has
Chinese characters
Thanks to everyone who has contributed to this release.

Here are release notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12344466

The commit to being voted upon:

https://github.com/apache/kylin/commit/0e519d859e217fbfadd534313376e532d2c647fa

Its hash is 0e519d859e217fbfadd534313376e532d2c647fa.

The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.5.2-rc2/

The hashe of the artifact is as follows:
apache-kylin-2.5.2-source-release.zip.sha256
fca5688cf64442ea595e07c2a4a4b2b549836d268ce8f10f3d559f05c22b61d0

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1058/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/shaofengshi.asc

Please vote on releasing this package as Apache Kylin 2.5.2.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PPMC votes are cast.

[ ] +1 Release this package as Apache Kylin 2.5.2
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)

Best regards,

Shaofeng Shi ??
Apache Kylin PMC
Work email: shaofeng@kyligence.io
Kyligence Inc: https://kyligence.io/

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org

答复: 答复: Filter return error when using " = " for Integer column type

[Na Zhai]

Hi, yiwang.

The type of BUYER_ID is bigint. I think the sql should be “select BUYER_ID from 
KYLIN_SALES where BUYER_ID = 1002 group by BUYER_ID”. In attach is the 
result that I run the sql.

[cid:image002.png@01D47C39.971D0AB0].



发送自 Windows 10 版邮件应用






发件人: yiwang <756470...@qq.com>
发送时间: Wednesday, November 14, 2018 4:27:07 PM
收件人: dev@kylin.apache.org
主题: Re: 答复: Filter return error when using " = " for Integer column type

hello,

I followed your guide and modified sql  to
"select BUYER_ID from KYLIN_SALES where BUYER_ID = '1002' group by
BUYER_ID"

got the similar error.

Error while compiling generated Java code: org.apache.calcite.DataContext
root; public org.apache.calcite.linq4j.Enumerable bind(final
org.apache.calcite.DataContext root0) { root = root0; final
org.apache.calcite.linq4j.Enumerable _inputEnumerable =
((org.apache.kylin.query.schema.OLAPTable)
root.getRootSchema().getSubSchema("DEFAULT").getTable("KYLIN_SALES")).executeOLAPQuery(root,
0); final org.apache.calcite.linq4j.AbstractEnumerable child = new
org.apache.calcite.linq4j.AbstractEnumerable(){ public
org.apache.calcite.linq4j.Enumerator enumerator() { return new
org.apache.calcite.linq4j.Enumerator(){ public final
org.apache.calcite.linq4j.Enumerator inputEnumerator =
_inputEnumerable.enumerator(); public void reset() {
inputEnumerator.reset(); } public boolean moveNext() { while
(inputEnumerator.moveNext()) { final Long inp7_ = (Long) ((Object[])
inputEnumerator.current())[7]; if (inp7_ != null && inp7_.longValue() ==
"1002") { return true; } } return false; } public void close() {
inputEnumerator.close(); } public Object current() { return (Long)
((Object[]) inputEnumerator.current())[7]; } }; } }; return
child.distinct().take(5); } public Class getElementType() { return
java.lang.Long.class; } while executing SQL: "select BUYER_ID from
KYLIN_SALES where BUYER_ID = '1002' group by BUYER_ID LIMIT 5"

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: Filter return error when using " = " for Integer column type

[Na Zhai]

Hi, yiwang

Hope this can help you. http://kylin.apache.org/docs/gettingstarted/faq.html.

In this page, you can search “select *” for the answer.



发送自 Windows 10 版邮件应用




发件人: yiwang <756470...@qq.com>
发送时间: Wednesday, November 14, 2018 2:41:48 PM
收件人: dev@kylin.apache.org
主题: Filter return error when using " = " for Integer column type

Hello Kylin Team,

In sample cube, data type of BUYER_ID is Integer.
 select * from KYLIN_SALES where "BUYER_ID" = '1002'
this query works  in db,but failed in kylin, Error detail as below.

Error while compiling generated Java code: org.apache.calcite.DataContext
root; public org.apache.calcite.linq4j.Enumerable bind(final
org.apache.calcite.DataContext root0) { root = root0; final
org.apache.calcite.linq4j.Enumerable _inputEnumerable =
((org.apache.kylin.query.schema.OLAPTable)
root.getRootSchema().getSubSchema("DEFAULT").getTable("KYLIN_SALES")).executeOLAPQuery(root,
0); final org.apache.calcite.linq4j.AbstractEnumerable child = new
org.apache.calcite.linq4j.AbstractEnumerable(){ public
org.apache.calcite.linq4j.Enumerator enumerator() { return new
org.apache.calcite.linq4j.Enumerator(){ public final
org.apache.calcite.linq4j.Enumerator inputEnumerator =
_inputEnumerable.enumerator(); public void reset() {
inputEnumerator.reset(); } public boolean moveNext() { while
(inputEnumerator.moveNext()) { final Long inp7_ = (Long) ((Object[])
inputEnumerator.current())[7]; if (inp7_ != null && inp7_.longValue() ==
"1002") { return true; } } return false; } public void close() {
inputEnumerator.close(); } public Object current() { final Object[] current
= (Object[]) inputEnumerator.current(); return new Object[] { current[0],
current[1], current[2], current[3], current[4], current[5], current[6],
current[7], current[8], current[9]}; } }; } }; return child.take(5); }
public Class getElementType() { return java.lang.Object[].class; } while
executing SQL: "select * from KYLIN_SALES where "BUYER_ID" = '1002'
LIMIT 5"

Thanks
Yi

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: [VOTE] Release apache-kylin-2.5.1 (RC1)

[Na Zhai]

+1

mvn test passed





发送自 Windows 10 版邮件应用




发件人: Cheng Wang 
发送时间: Friday, November 2, 2018 3:29:12 PM
收件人: dev@kylin.apache.org
主题: Re: [VOTE] Release apache-kylin-2.5.1 (RC1)

+1 (binding)




Best Regards,
Cheng

On 11/2/18, 2:09 PM, "ShaoFeng Shi"  wrote:

>Hi all,
>
>I have created a build for Apache Kylin 2.5.1, release candidate 1.
>
>Changes highlights:
>
>[KYLIN-3531] - Login failed with case-insensitive username
>[KYLIN-3604] - Can't build cube with spark in HBase standalone mode
>[KYLIN-3613] - Kylin with Standalone HBase Cluster could not find the main
>cluster namespace at "Create HTable" step
>[KYLIN-3634] - When the filter column has null value may cause incorrect
>query result
>[KYLIN-3635] - Percentile calculation on Spark engine is wrong
>[KYLIN-3644] - NumberFormatExcetion on null values when building cube with
>Spark
>[KYLIN-3599] - Bulk Add Measures
>
>Thanks to everyone who has contributed to this release.
>Here’s release notes:
>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12344108
>
>The commit to be voted upon:
>
>https://github.com/apache/kylin/commit/24e2452309a450ec4ef62339b003343eabe23016
>
>Its hash is 24e2452309a450ec4ef62339b003343eabe23016.
>
>The artifacts to be voted on are located here:
>https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.5.1-rc1/
>
>The hashe of the artifact is as follows:
>apache-kylin-2.5.1-source-release.zip.sha256
>21db5dab4d3900a49237b9083b5d270c8471d1882a5427cddf1cc74873df42f2
>
>A staged Maven repository is available for review at:
>https://repository.apache.org/content/repositories/orgapachekylin-1056/
>
>Release artifacts are signed with the following key:
>https://people.apache.org/keys/committer/shaofengshi.asc
>
>Please vote on releasing this package as Apache Kylin 2.5.1.
>
>The vote is open for the next 72 hours and passes if a majority of
>at least three +1 PPMC votes are cast.
>
>[ ] +1 Release this package as Apache Kylin 2.5.1
>[ ]  0 I don't feel strongly about it, but I'm okay with the release
>[ ] -1 Do not release this package because...
>
>
>Here is my vote:
>
>+1 (binding)
>
>--
>Best regards,
>
>Shaofeng Shi 史少锋

答复: APACHE KYLIN - Detect bad query

[Na Zhai]

Hi,
Do you think that Kylin has too many output logs?  In Kylin, 
BadQueryDetector will check bad query every 60 seconds(default). It cannot be 
closed. You can change the interval time of detecting by changing 
kylin.query.timeout-seconds-coefficient and kylin.query.timeout-seconds.

Best wishes!

发送自 Windows 10 版邮件应用

发件人: awaisaj...@gmail.com
发送时间: 2018年10月30日 22:31
收件人: dev@kylin.apache.org
主题: APACHE KYLIN - Detect bad query

I am setting up Apache kylin , i configured all setting now i am and kylin is
connected to hive tables. when i make cube then it show bad query detected
and below logs continue all day.What could be the possible reason behind it
as there is no error showing in log file

*Logs are below and these line continue to generate in loop*

2018-10-30 18:55:45,614 INFO [BadQueryDetector] service.BadQueryDetector:147
: Detect bad query. 2018-10-30 18:55:50,243 INFO [FetcherRunner
1260543956-60] threadpool.DefaultFetcherRunner:96 : Job Fetcher: 1 should
running, 2 actual running, 0 stopped, 0 ready, 3 already succeed, 0 error, 0
discarded, 0 others 2018-10-30 18:56:20,240 INFO [FetcherRunner
1260543956-60] threadpool.DefaultFetcherRunner:96 : Job Fetcher: 1 should
running, 2 actual running, 0 stopped, 0 ready, 3 already succeed, 0 error, 0
discarded, 0 others

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

答复: MapReduceException: Counter 0

[Na Zhai]

Hi, liuzhixin,
What’s your Kylin version? Which step does this mistake take place?

发送自 Windows 10 版邮件应用


发件人: liuzhixin 
发送时间: Monday, October 22, 2018 6:44:49 PM
收件人: dev@kylin.apache.org
抄送: 335960...@qq.com
主题: MapReduceException: Counter 0

Hello kylin team: what’s wrong with the Counter 0? Thank you.

[cid:BE51FFB2-59A0-4820-9AE3-04C821247027]
#
Best wishes!

答复: api to build cube

[Na Zhai]

Hi, koulong

You are right. It is related to the partition that you choose in model. If you 
do not choose the partition, the start and end time will not need.

I hope this can help you. 
http://kylin.apache.org/docs/howto/howto_build_cube_with_restapi.html



发送自 Windows 10 版邮件应用




发件人: 叩 龙 
发送时间: Monday, October 15, 2018 10:18:44 PM
收件人: kylin dev
主题: api to build cube

hi team,

i am trying to build cube. from the kylin web page, i can see some of the cubes 
reqiure start and end time but some not. what is the different between them? 
does it related to partition？
also according to the rest api kylin provided, which api shall i use if the 
cube doesnt require starttime and endtime at all?


Thanks,
Sent from phone

[jira] [Created] (KYLIN-3628) The wrong result when a query with one lookup table

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3628:
--

 Summary: The wrong result when a query with one lookup table
 Key: KYLIN-3628
 URL: https://issues.apache.org/jira/browse/KYLIN-3628
 Project: Kylin
  Issue Type: Improvement
Reporter: Na Zhai
Assignee: Na Zhai
 Fix For: v2.6.0


Two cubes use the same lookup table, and then the lookup table data in Hive 
changes. One of Kylin's cubes builds the new data, and the other doesn't. When 
Kylin queries the lookup table, the data gets confused.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

答复: 回复： [DISCUSS] Not sending Github PR notifications to dev@kylin

[Na Zhai]

+1



发送自 Windows 10 版邮件应用




发件人: Chao Long 
发送时间: Thursday, October 4, 2018 8:11:06 PM
收件人: dev
主题: 回复： [DISCUSS] Not sending Github PR notifications to dev@kylin

+1




-- 原始邮件 --
发件人: "Xiaoxiang Yu";
发送时间: 2018年10月4日(星期四) 晚上7:56
收件人: "dev@kylin.apache.org";

主题: Re: [DISCUSS] Not sending Github PR notifications to dev@kylin



+1

Xiaoxiang Yu
xiaoxiang...@kyligence.io


On [DATE], "[NAME]" <[ADDRESS]> wrote:

Hello, Kylin dev subscribers,

Recently I received several complaints saying that there are many emails
sent to the "dev@kylin.apache.org" from the github.com pull request since
we enabled the Gitbox service for Kylin.

Today most patches and code reviews are performed on GitHub. Each pull
request action (even add a comment) will emit an email to dev@kylin,
instead of the individual contributor or reviewer; This generates many
spams and causes the emails from people are left in the basket.

Now I plan to change the Gitbox email notifications rule: removing 
dev@kylin,
use author and reviewer instead, as follows:


*For Github issues, please notify iss...@kylin.apache.org
 ;For Github PR, please notify the author,
reviewer and iss...@kylin.apache.org *

The related JIRA to Apache Infra is
https://issues.apache.org/jira/browse/INFRA-17073

Please +1 if you agree with the new rule, or -1 if you want to keep as
today. If no objection, we will move on with the new rule.

--
Best regards,

Shaofeng Shi 史少锋

答复: [VOTE] Release apache-kylin-2.5.0 (RC2)

[Na Zhai]

+1

mvn test passed



发送自 Windows 10 版邮件应用




发件人: 李 栋 
发送时间: Friday, September 14, 2018 2:28:05 PM
收件人: dev@kylin.apache.org
主题: RE: [VOTE] Release apache-kylin-2.5.0 (RC2)

+1 binding

mvn test passed

Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 
2018-06-17T18:33:14Z)
Maven home: /opt/apache-maven-3.5.4
Java version: 1.8.0_161, vendor: Oracle Corporation, runtime: 
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-3.b14.el6_9.x86_64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-573.18.1.el6.x86_64", arch: "amd64", family: 
"unix"

Thanks,
Dong Li


-Original Message-
From: Luke Han 
Sent: Friday, September 14, 2018 11:53 AM
To: dev 
Subject: Re: [VOTE] Release apache-kylin-2.5.0 (RC2)

+1 binding

maven test passed

Best Regards!
-

Luke Han


On Thu, Sep 13, 2018 at 11:22 AM Zhong, Yanghong  wrote:

> mvn clean test, passed
>
> +1 binding
>
> My environment:
> Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
> 2018-06-18T02:33:14+08:00)
> Maven home: /Users/yangzhong/Software/apache-maven-3.5.4
> Java version: 1.8.0_66, vendor: Oracle Corporation, runtime:
> /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x",
> version: "10.11.6", arch: "x86_64", family: "mac"
>
> Best regards,
> Yanghong Zhong
>
> On 9/13/18, 1:53 PM, "ShaoFeng Shi"  wrote:
>
> Hi all,
>
> I have created a build for Apache Kylin 2.5.0, release candidate 2. The
> difference between RC1 and RC2 is just changing the scala-maven-plugin
> version from 3.4.2 to 3.4.1.
>
> Changes highlights:
>
> [KYLIN-2565] - Support Hadoop 3.0
> [KYLIN-3033] - Support HBase 2.0
> [KYLIN-2998] - Kill spark app when cube job was discarded
> [KYLIN-3370] - Enhanced segment pruning
> [KYLIN-3488] - Support MySQL as Kylin metadata storage
> [KYLIN-3418] - User interface for Hybrid model
> [KYLIN-3419] - Upgrade to Java 8
> [KYLIN-3421] - Improve job scheduler fetch performance
> [KYLIN-3427] - Convert to HFile in Spark
> [KYLIN-3441] - Merge cube segments in Spark
> [KYLIN-3442] - Fact distinct columns in Spark
> [KYLIN-3453] - Improve cube size estimation for TOPN, COUNT DISTINCT
> [KYLIN-3457] - Distribute by multi columns if not set distribute column
> [KYLIN-3471] - Merge dictionary and statistics on Yarn
> [KYLIN-3480] - Change the conformance of calcite from default to
> lenient
> [KYLIN-3491] - Improve the cube building process when using global
> dictionary
> [KYLIN-3521] - Enable Cube Planner by default
>
> Thanks to everyone who has contributed to this release.
> Here are release notes:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissue
> s.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3FprojectId%3D12316121
> %26version%3D12343540data=02%7C01%7Cyangzhong%40ebay.com%7Ca764ee
> fe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%
> 7C636724148150769018sdata=jfiVgq93KvjoHS3vPOvQ0zwNKvQ0zra%2BLSA3U
> XETTFs%3Dreserved=0
>
> The commit to being voted upon:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithu
> b.com%2Fapache%2Fkylin%2Fcommit%2F158f8768debe99746c66e516e4596707a476
> d7d6data=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d
> 6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769
> 018sdata=KEswnV3B6xlNosSIjKs7%2BVj1pX0DkucFbtapf63PPTQ%3Dres
> erved=0
>
> Its hash is 158f8768debe99746c66e516e4596707a476d7d6.
>
> The artifacts to be voted on are located here:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.
> apache.org%2Frepos%2Fdist%2Fdev%2Fkylin%2Fapache-kylin-2.5.0-rc2%2F
> p;data=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a
> 24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018
> ;sdata=MYMl8ARJfGgj9HLijudmnXrBmzrhG9cq3mkB64t9Eeg%3Dreserved=0
>
> The hashes of the artifacts are as follows:
> apache-kylin-2.5.0-source-release.zip.sha256
> 7035bf753b0e3de86f1cd663ff3b44381be5452a44de6cc1089cabf73da6bee4
>
> A staged Maven repository is available for review at:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepos
> itory.apache.org%2Fcontent%2Frepositories%2Forgapachekylin-1055%2F
> ;data=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a2
> 4%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018
> sdata=a8V2REf8TmWEEGK67aar65ZGwgSlpDW70nnW5vIdexQ%3Dreserved=0
>
> Release artifacts are signed with the following key:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpeopl
> e.apache.org%2Fkeys%2Fcommitter%2Fshaofengshi.ascdata=02%7C01%7Cy
> angzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff99284
> 

[jira] [Created] (KYLIN-3533) Can not save hybrid

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3533:
--

 Summary: Can not save hybrid
 Key: KYLIN-3533
 URL: https://issues.apache.org/jira/browse/KYLIN-3533
 Project: Kylin
  Issue Type: Bug
Reporter: Na Zhai
Assignee: Chao Long


Steps:
 # create hybrid with 3 cube, cube A's status is disable(not build), cube B and 
C are ready(build successful without segment overlap)
 # click submit
 # build cube A, the partition date is early than cube B and C
 # add cube D(not build) to hybrid, click submit

hybrid can not save and error message will pop up



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3532) Inconsistent results of the query

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3532:
--

 Summary: Inconsistent results of the query
 Key: KYLIN-3532
 URL: https://issues.apache.org/jira/browse/KYLIN-3532
 Project: Kylin
  Issue Type: Bug
  Components: Query Engine
Reporter: Na Zhai


When I query with sql "select count(*) from KYLIN_CATEGORY_GROUPINGS where 
KYLIN_CATEGORY_GROUPINGS.KYLIN_GROUPINGS_CRE_DATE > DATE '2012-09-02'". The 
query result shows 0 which is correct. When I query with sql "select count(*) 
from KYLIN_CATEGORY_GROUPINGS where 
KYLIN_CATEGORY_GROUPINGS.KYLIN_GROUPINGS_CRE_DATE < DATE '2012-09-02'". The 
query result shows 0 which is wrong. It should be 14. When I query with sql 
"select count(*) from KYLIN_CATEGORY_GROUPINGS where 
KYLIN_CATEGORY_GROUPINGS.KYLIN_GROUPINGS_CRE_DATE > DATE '2010-09-02'". The 
query result shows 14 which is correct.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3530) All cubes disabled but table still can be seen in Insight page

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3530:
--

 Summary: All cubes disabled but table still can be seen in Insight 
page
 Key: KYLIN-3530
 URL: https://issues.apache.org/jira/browse/KYLIN-3530
 Project: Kylin
  Issue Type: Bug
Reporter: Na Zhai


When I disable all cubes with table KYLIN_SALES，KYLIN_SALES still can be seen 
in Insight page



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3529) Prompt not friendly

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3529:
--

 Summary: Prompt not friendly
 Key: KYLIN-3529
 URL: https://issues.apache.org/jira/browse/KYLIN-3529
 Project: Kylin
  Issue Type: Bug
  Components: Web 
Reporter: Na Zhai


 *Scene 1：*When I create a hybrid with duplicate name, then I click submit, the 
error message "error execute org.apache.kylin.rest.job.HybridCubeCLI" will pop 
up.
 
*Scene 2：*When I create a hybrid with duplicate date/time cube, then I click 
submit, the error message "error execute 
org.apache.kylin.rest.job.HybridCubeCLI" will pop up.
 
I think the error message should be more friendly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3528) No details page for hybrid

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3528:
--

 Summary: No details page for hybrid
 Key: KYLIN-3528
 URL: https://issues.apache.org/jira/browse/KYLIN-3528
 Project: Kylin
  Issue Type: Improvement
  Components: Web 
Reporter: Na Zhai


When I click hybrid name, there is no detail page for that hybrid.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3526) No check for hybrid name with special character

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3526:
--

 Summary: No check for hybrid name with special character
 Key: KYLIN-3526
 URL: https://issues.apache.org/jira/browse/KYLIN-3526
 Project: Kylin
  Issue Type: Improvement
  Components: Web 
Reporter: Na Zhai
 Attachments: 名称没做限制.png

When create hybrid，there is no check for hybrid name with special character. 
Such as !@&.

Hybrid can be created successfully with name like hy!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3498) Chinese translation of community, development, blog docs

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3498:
--

 Summary: Chinese translation of community, development, blog docs
 Key: KYLIN-3498
 URL: https://issues.apache.org/jira/browse/KYLIN-3498
 Project: Kylin
  Issue Type: Improvement
  Components: Documentation
Reporter: Na Zhai
Assignee: Na Zhai


There are many active Chinese users in Kylin community, a Chinese translation 
of community, development, blog docs will be very helpful to Kylin newbies and 
experienced Kylin users as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-3477) Spark job size wasn't displayed when submit deployMode is cluster

[Na Zhai (JIRA)]

Na Zhai created KYLIN-3477:
--

 Summary: Spark job size wasn't displayed when submit deployMode is 
cluster
 Key: KYLIN-3477
 URL: https://issues.apache.org/jira/browse/KYLIN-3477
 Project: Kylin
  Issue Type: Bug
  Components: Spark Engine
Reporter: Na Zhai


When "spark.submit.deployMode=cluster", the Yarn job size can't be printed in 
console, Kylin can't get that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)