[ANNOUNCE] New Committer: Jiatao Tao

2019-06-12 Thread ShaoFeng Shi
regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: AppendTrieDictionary can't retrieve value from id

2019-06-12 Thread ShaoFeng Shi
coding. Please remove it from the dimension in this cube, and build again. And if you need it as a dimension, create another cube. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kyli

Re: Row Level Security and Column Level security on Kylin

2019-06-11 Thread ShaoFeng Shi
Today Kylin's ACL is at table level, we think this is good enough (for 99% scenarios). Row and column level control is one of the enterprise features. Kyligence's Kylin distribution has that feature out of box, but it is not open. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng

Re: 请问怎么退订邮件

2019-06-10 Thread ShaoFeng Shi
Hello, Please send an empty email to dev-unsubscr...@kylin.apache.org, then it will reply to confirm with you. Just reply that email to confirm the unsubscription. The process for u...@kylin.apache.org mailing list is the same, just replace "dev" with "user". Best regard

Re: ask about kylin 3.0 Go-Live Date

2019-06-10 Thread ShaoFeng Shi
/docs30/ Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org Bryan Liu (CN) 于

[New blog] Kylin upgrade from 2.4.1 to 2.6.1

2019-06-10 Thread ShaoFeng Shi
with the newer version. Hope this article can help you to upgrade smoothly. Here is the blog link: https://kylin.apache.org/blog/2019/05/29/kylin-2.4.1-to-2.6.1/ Thanks again for Iñigo's contribution! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https

[ANNOUNCE] Gang Ma joins the Apache Kylin PMC

2019-06-02 Thread ShaoFeng Shi
Regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: Need More info to use KYLIN

2019-06-01 Thread ShaoFeng Shi
Hello Imran, What's the "different approach", could you please elaborate? Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org

Re: Fixes for SonarQube issues

2019-05-30 Thread ShaoFeng Shi
on SonarCloud might be out of dated. We can try again to see whether the environment problem is fixed or not. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr

Plan to host the first "Kylin Data Summit" event

2019-05-30 Thread ShaoFeng Shi
and InfoQ China - *When is the event* 12th, July. - *How many attendees are expected* 500 expected attendees. - *How much PMC involvement is there already* Some Apache Kylin’s PMC members are involved in the organization of Kylin Data Summit, such as Billy Liu, Yang Li, Shaofeng Shi. S

Re: Maven repository URL could not be accessed (http://repository.kyligence.io:8081/repository/maven-public/)

2019-05-28 Thread ShaoFeng Shi
Hello Sam, Our engineer will change the service port to a default port. But this may not happen quickly because they are busy before the end of June. Thank you for the feedback! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https

Re: spark.yarn.executor.memoryOverhead' has been deprecated problem

2019-05-28 Thread ShaoFeng Shi
ending until someone manually accept it. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr

Re: 使用left join查询时报错

2019-05-28 Thread ShaoFeng Shi
Define another cube with inner join. Kylin will automatically match the join type in query with the cube/model definition. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail

Re: Maven repository URL could not be accessed (http://repository.kyligence.io:8081/repository/maven-public/)

2019-05-21 Thread ShaoFeng Shi
Hello Sam, I'm checking it; While, there might be some restrictions for us to provide service on the 80/443 port. Maybe I can send you the mirror files, and then you can expand it to your local maven repository, as a temporary solution. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email

[Announce] Apache Kylin 2.6.2 released

2019-05-19 Thread ShaoFeng Shi
to the 2.6.2 release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs

[RESULT][VOTE] Release apache-kylin-2.6.2 (RC1)

2019-05-17 Thread ShaoFeng Shi
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Dong Li Kaisen Kang Billy Liu 7 non-binding +1s: Chunen Ni Jiatao Tao Temple Zhou Na Zhai Xiaoxiang Yu Chao Long Jianhua Peng No 0s or -1s

[VOTE] Release apache-kylin-2.6.2 (RC1)

2019-05-13 Thread ShaoFeng Shi
this package as Apache Kylin 2.6.2 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https

[jira] [Created] (KYLIN-3999) Enable dynamic column by default

2019-05-10 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3999: --- Summary: Enable dynamic column by default Key: KYLIN-3999 URL: https://issues.apache.org/jira/browse/KYLIN-3999 Project: Kylin Issue Type: Improvement

Re: Cartesian Join not supported

2019-05-09 Thread ShaoFeng Shi
Hi Nithya, The fact table and lookup table need be joined explicitly. That means, the sql need be: select bla, bla FROM FACT inner join PRODUCT on FACT.fk = PRODUCT.pk group by x, y Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https

Re: [DISCUSSION] Don't need to purge existing segment of cube to add new measures in Kylin

2019-04-26 Thread ShaoFeng Shi
Hi Yuzhang, Please open a JIRA for this enhancement; If it can be implemented in an elegant way, that will be great! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group

Re: cube设计维度16个,采用星型模型,结果一直卡在这个位置,怎么处理?

2019-04-25 Thread ShaoFeng Shi
the slowest one. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org Na Zhai

Re: [DISCUSSION] Don't need to purge existing segment of cube to add new measures in Kylin

2019-04-21 Thread ShaoFeng Shi
your idea on "the measures of the analysis system can be decoupled from the materialized view(cube) and have their own management system"? Have you got a rough design on it? Thank you! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: http

Re: Re: Deploy Apache Kylin with Standalone HBase Cluster

2019-04-18 Thread ShaoFeng Shi
thanks for the sharing; Is the beeline + "zookeeper discoverer model" also okay finally? Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: u

[New blog] "Real-time Streaming Design in Apache Kylin"

2019-04-17 Thread ShaoFeng Shi
, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org

[Announce] Apache Kylin 3.0.0-alpha released

2019-04-16 Thread ShaoFeng Shi
contributed to the 3.0.0-alpha release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https

Re: [ANNOUNCE] Kaisen Kang joins the Apache Kylin PMC

2019-04-15 Thread ShaoFeng Shi
Congratulations, Kaisen! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: Re:RE: [VOTE] Release apache-kylin-3.0.0-alpha (RC1)

2019-04-13 Thread ShaoFeng Shi
min [INFO] Finished at: 2019-04-14T10:41:04+08:00 Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group:

[RESULT][VOTE] Release apache-kylin-3.0.0-alpha (RC1)

2019-04-11 Thread ShaoFeng Shi
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows: 3 binding +1s: Shaofeng Shi Billy Liu Dong Li 1 non-binding +1s: Gang Ma No 0s or -1s. Therefore I am delighted to announce that the proposal to release Apache-Kylin-3.0.0

Apache Kylin Meetup @Beijing, April 13, 2019

2019-04-10 Thread ShaoFeng Shi
West Street, Haidian District, Beijing Language: Chinese Fee: Free! There are some seats left, so if you can come, please register here: https://www.huodongxing.com/event/7484371439700. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https

[VOTE] Release apache-kylin-3.0.0-alpha (RC1)

2019-04-07 Thread ShaoFeng Shi
east three +1 PMC votes are cast. [ ] +1 Release this package as Apache Kylin 3.0.0-alpha [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shao

Re: [DISCUSS] Kylin 3.0 alpha and beta release before GA

2019-03-28 Thread ShaoFeng Shi
Hi Vino, thank you for raising this. The Flink cubing engine is also a good candidate feature; Except the performance vs spark, we're also expecting to see if it can help the streaming processing. Welcome the discussion on this. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng

Re: 通过ODBC获取所有可用的表和表元数据

2019-03-27 Thread ShaoFeng Shi
Less people know how to debug ODBC; I'm afraid no help can give to you. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin

Re: [DISCUSS] Kylin 3.0 alpha and beta release before GA

2019-03-26 Thread ShaoFeng Shi
Just now, we merged the real-time implementation into the master branch. Some PRs were held in the past days for this merge; We will resume the PR merge soon. Thanks for your support! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https

[DISCUSS] Kylin 3.0 alpha and beta release before GA

2019-03-24 Thread ShaoFeng Shi
teady pace; Usually, 1 version every 1-2 months, depends on the severity of the reported issues. We warmly welcome the community users to join the 3.0 alpha and beta. Please share your comments here. Thank you for the support to Apache Kylin! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email

Re: Kylin ODBC driver is removed from download page

2019-03-23 Thread ShaoFeng Shi
-party. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org ShaoFeng Shi 于2019年3

Re: Kylin Support Spark 1.6 version when start supporting spark 2.6

2019-03-21 Thread ShaoFeng Shi
The latest spark release is v2.4; Kylin is using spark v2.3.2 now; so far there is no plan to upgrade. If you find newer version Spark has advantages, please share with the community, thanks! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https

Re: Hbase table is always empty when build with spark

2019-03-19 Thread ShaoFeng Shi
Hi Alex, Could you please report a JIRA to Kylin? or send a Pull request if you already have a hot-fix. Thank you! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group

[RESULT][VOTE] Release apache-kylin-2.6.1 binary packages

2019-03-18 Thread ShaoFeng Shi
Thanks to everyone who has verified the binary packages. The tally is as follows. 3 binding +1s: Shaofeng Shi Billy Liu Yang Li 1 non-binding +1s: Jianhua Peng No 0s or -1s. Therefore I am delighted to announce that the proposal to release Apache-Kylin-2.6.1 binary package has passed. Best

Re: [VOTE] Release apache-kylin-2.6.1 binary packages

2019-03-18 Thread ShaoFeng Shi
Thanks to Billy, Yang, Jianhua for the verification! I will send out the result soon. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org

Re: 答复: How kylin store data in Hbase ?

2019-03-18 Thread ShaoFeng Shi
Hi Rahul, Please check this slide, I made for last year's HBaseCon; Page 16/17 introduces how Kylin store cube in HBase; https://www.slideshare.net/ShiShaoFeng1/apache-kylin-on-hbase-extreme-olap-engine-for-big-data Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org

Re: [Discussion] Enable shrunken dictionary by default

2019-03-17 Thread ShaoFeng Shi
+1. Thanks to Xiaoxiang for raising this; Kylin has some advanced but hidden feature. As the function becomes stable, we should enable them by default to benefit all users. Please also raise similar discussion if you wish to enable some good features. Best regards, Shaofeng Shi 史少锋 Apache

[jira] [Created] (KYLIN-3878) NPE to run sonar analysis

2019-03-15 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3878: --- Summary: NPE to run sonar analysis Key: KYLIN-3878 URL: https://issues.apache.org/jira/browse/KYLIN-3878 Project: Kylin Issue Type: Test Components

[VOTE] Release apache-kylin-2.6.1 binary packages

2019-03-15 Thread ShaoFeng Shi
that are prohibited from distribution (category X). Here is my vote: +1 (binding) Thank you! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org

Apache Kylin binary package temporarily removed from download page

2019-03-15 Thread ShaoFeng Shi
it during this period, you can download the source release and then compile from source by following the related document. Thanks for your patience! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html

Re: kylin内存溢出问题

2019-03-13 Thread ShaoFeng Shi
it on the FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Besides, analyze the memory dump is also recommended. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group

Kylin ODBC driver is removed from download page

2019-03-11 Thread ShaoFeng Shi
that. The PMC will discuss the follow-up actions, but there is no ETA for when it can be recovered. If you still need the ODBC driver, you can try to compile it from the source code ("odbc" folder in Kylin source release). On behalf of Apache Kylin PMC Best regards, Shaofeng Shi 史少锋 Apache Kylin

[jira] [Created] (KYLIN-3862) Check the binary packages

2019-03-09 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3862: --- Summary: Check the binary packages Key: KYLIN-3862 URL: https://issues.apache.org/jira/browse/KYLIN-3862 Project: Kylin Issue Type: Task Reporter

[jira] [Created] (KYLIN-3863) Check the binary packages

2019-03-09 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3863: --- Summary: Check the binary packages Key: KYLIN-3863 URL: https://issues.apache.org/jira/browse/KYLIN-3863 Project: Kylin Issue Type: Task Reporter

Re: [Discuss] Won't ship Spark binary in Kylin binary anymore

2019-03-09 Thread ShaoFeng Shi
Thanks, guys; I have updated the installation guide for this change: https://kylin.apache.org/docs/install/index.html Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group

[Announce] Apache Kylin 2.6.1 released

2019-03-08 Thread ShaoFeng Shi
to the 2.6.1 release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs

[Discuss] Won't ship Spark binary in Kylin binary anymore

2019-03-07 Thread ShaoFeng Shi
are not impacted. Just share your comments if any. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev

[RESULT][VOTE] Release apache-kylin-2.6.1 (RC1)

2019-03-07 Thread ShaoFeng Shi
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Luke Han Billy Liu Yanghong Zhong 8 non-binding +1s: Temple Zhou Chao Long Jiatao Tao Xiaoxiang Yu Zhengshuai Peng Rongchuan Jin Chunen Ni Yichen Zhou

Re: [VOTE] Release apache-kylin-2.6.1 (RC1)

2019-03-07 Thread ShaoFeng Shi
Thanks, guys; the vote has lasted more than 72 hours, I will send out the summary soon. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin

Re: kylin内存溢出问题

2019-03-05 Thread ShaoFeng Shi
g jstack to analysis the thread information; 4) check your cube definition to see whether there is some UHC dimension and the dictionary encoding was used for that. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apa

[VOTE] Release apache-kylin-2.6.1 (RC1)

2019-03-04 Thread ShaoFeng Shi
: +1 (binding) Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group

[New Doc] Enable distributed cache for Kylin v2.6

2019-03-01 Thread ShaoFeng Shi
welcomed. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail g

Re: I wonder about the qualifier assignment within an column family for measures

2019-02-24 Thread ShaoFeng Shi
columns if you think that is better. Please share us with your findings, if it does benefit the performance. Thank you! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs

Re: got exception when start kylin

2019-02-24 Thread ShaoFeng Shi
Please try to check more logs, both in /logs and tomcat/logs. I remember some users also encountered the "/tomcat/conf/.keystore (No such file or directory)" error before, but this was not the root cause. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@ky

Re: can not open kylin web ui

2019-02-24 Thread ShaoFeng Shi
Remember to add the "/kylin" context on the URL, sometimes people may forget: http://hostname:7070/kylin Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gett

Re: Hbase table is always empty when build with spark

2019-02-24 Thread ShaoFeng Shi
Hello Alex, Interesting; We didn't observe such an issue. Can you confirm your hive table has the data, instead of an input error? Does the problem get solved after setting "mapreduce.job.outputformat.class"? Thanks for the feedback! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC

[jira] [Created] (KYLIN-3826) MergeCuboidJob only uploads necessary segment's dictionary

2019-02-23 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3826: --- Summary: MergeCuboidJob only uploads necessary segment's dictionary Key: KYLIN-3826 URL: https://issues.apache.org/jira/browse/KYLIN-3826 Project: Kylin Issue

[jira] [Created] (KYLIN-3825) Add ACL Rest APIs to document

2019-02-22 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3825: --- Summary: Add ACL Rest APIs to document Key: KYLIN-3825 URL: https://issues.apache.org/jira/browse/KYLIN-3825 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-3823) Release v2.6.1

2019-02-22 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3823: --- Summary: Release v2.6.1 Key: KYLIN-3823 URL: https://issues.apache.org/jira/browse/KYLIN-3823 Project: Kylin Issue Type: Task Reporter: Shaofeng

Re: Re: [Discuss] Moving toward Apache Kylin 3.0

2019-02-19 Thread ShaoFeng Shi
Thanks for the feedbacks; Since there was no objection on this, the version on the current master branch has been updated to 3.0.0-SNAPSHOT. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https

Re: Kylin go to hdfs to find jar file

2019-02-19 Thread ShaoFeng Shi
Did you configure to use HDFS as the defaultFS in core-site.xml? Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user

Apache Kylin Meetup @Shanghai, 23 Feb 2019

2019-02-18 Thread ShaoFeng Shi
://www.huodongxing.com/event/4476570217900 Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org

Re: [kylin] left join怎样join is null记录

2019-02-18 Thread ShaoFeng Shi
Can you use some value (like "unknown") to represent NULL ? NULL is not equal to anything, including NULL: https://stackoverflow.com/questions/1843451/why-does-null-null-evaluate-to-false-in-sql-server Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@ky

Re: Unexpected behavior when joinning streaming table and hive table

2019-02-13 Thread ShaoFeng Shi
, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr

Re: Kylin exist same segement

2019-02-10 Thread ShaoFeng Shi
t; or "all" nodes in this cluster? Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org

Re: 答复: kylin 手动合并(merge)报错问题

2019-02-10 Thread ShaoFeng Shi
regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr

Re: kylin 自动merge 问题

2019-02-10 Thread ShaoFeng Shi
Hi Lin, Could you please describe the problem you found in detail? Thanks! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail

[New Document] Kylin SQL reference

2019-01-30 Thread ShaoFeng Shi
://kylin.apache.org/docs/tutorial/sql_reference.html Chinese: https://kylin.apache.org/cn/docs/tutorial/sql_reference.html Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs

[jira] [Created] (KYLIN-3795) Submit Spark jobs via Apache Livy

2019-01-29 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3795: --- Summary: Submit Spark jobs via Apache Livy Key: KYLIN-3795 URL: https://issues.apache.org/jira/browse/KYLIN-3795 Project: Kylin Issue Type: New Feature

[jira] [Created] (KYLIN-3796) MongoDB as data source

2019-01-29 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3796: --- Summary: MongoDB as data source Key: KYLIN-3796 URL: https://issues.apache.org/jira/browse/KYLIN-3796 Project: Kylin Issue Type: New Feature

[jira] [Created] (KYLIN-3793) org.apache.kylin.source.kafka.util.KafkaSampleProducer exit after generating 1 message

2019-01-28 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3793: --- Summary: org.apache.kylin.source.kafka.util.KafkaSampleProducer exit after generating 1 message Key: KYLIN-3793 URL: https://issues.apache.org/jira/browse/KYLIN-3793

[Discuss] Moving toward Apache Kylin 3.0

2019-01-22 Thread ShaoFeng Shi
l be 3.0. The current 2.6 will be maintained until 3.x is ready for production use. Your comments, ideas, and suggestions are welcomed! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.

Re: ERROR context.ContextLoader:350 : Context initialization failed

2019-01-21 Thread ShaoFeng Shi
aking sure this host is valid in your machine. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apach

Re: v2.6.0 download for Hadoop 3.1.1 / Hbase 2

2019-01-18 Thread ShaoFeng Shi
The download page has been updated with Kylin 2.6 for Hadoop 3 packages, please check: https://kylin.apache.org/download/ Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs

Re: A Survey on The Usage of Sonar Cloud

2019-01-17 Thread ShaoFeng Shi
Hello Edna, I have finished the survey, with my email shaofeng...@apache.org; I appreciate you and SonarCloud 's support to open source community! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https

New tech blog: Introducing Kylin JDBC data source SDK

2019-01-17 Thread ShaoFeng Shi
Hello, There is a new tech blog from Youcheng Zhang and Dong Li on the new feature "Data source SDK" in Kylin 2.6: https://kylin.apache.org/blog/2019/01/16/introduce-data-source-sdk-v2.6.0/ Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyl

New tech blog: How cisco team improved Kylin's throughput by five times

2019-01-16 Thread ShaoFeng Shi
-improved-apache-kylins-high-concurrent-throughput-by-5x/ Chinese version: http://kyligence.io/zh/2019/01/07/how-cisco-big-data-team-increased-kylin-throughput-five-times/ Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache

Re: v2.6.0 download for Hadoop 3.1.1 / Hbase 2

2019-01-16 Thread ShaoFeng Shi
...@kylin.apache.org, and then confirm on the reply email). Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr

Re: Quicksight integration with apache kylin

2019-01-14 Thread ShaoFeng Shi
I don't have AWS Quicksight experience; Does it support generic JDBC connector? If still unclear, maybe you can try AWS's channel. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https

Re: Kylin 2.6.0 fails to build cube with spark

2019-01-11 Thread ShaoFeng Shi
/lib/hbase-hadoop-compat-1.4.2.jar,/usr/lib/hbase/lib/htrace-core-3.1.0-incubating.jar,/usr/lib/hbase/lib/metrics-core-2.2.0.jar,/usr/lib/hbase/lib/hbase-hadoop-compat-1.4.2.jar,/usr/lib/hbase/lib/hbase-hadoop2-compat-1.4.2.jar, Did you add other jars? Best regards, Shaofeng Shi 史少锋 Apache Kylin

Re: Kylin 2.6.0 fails to build cube with spark

2019-01-11 Thread ShaoFeng Shi
) at org.apache.spark.internal.io.SparkHadoopWriter$$anonfun$4.apply(SparkHadoopWriter.scala:127) at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1415) Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin

Re: [VOTE] Release apache-kylin-2.6.0 (RC1)

2019-01-09 Thread ShaoFeng Shi
Checked the source package, the signature, and the sha256 hash; Mvn package and test are all successful with jdk 1.8.0_111 on Mac; +1 (binding) Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https

Redash v6 adds Kylin as data source

2019-01-07 Thread ShaoFeng Shi
Hi Kylin user, Redash v6 just announced the new data source support of Apache Kylin; Please check this post: https://blog.redash.io/just-in-time-for-christmas-redash-v6-70cb23dfbbf3 Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https

Re: 请问可以设置多台机器同时构建cube吗?

2019-01-07 Thread ShaoFeng Shi
Please check "Enable multiple job engines" in https://kylin.apache.org/docs/install/advance_settings.html Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gett

Re: Increment Upload in Kylin

2019-01-06 Thread ShaoFeng Shi
Sounds like a multiple-level partitioning scenario? Time/date is the one partition, another dimension is the second level partition. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https

Re: 你好,我在构建cube的时候清理h ive垃圾出现问题,在追踪源码后发现问题。

2019-01-03 Thread ShaoFeng Shi
? Thank you! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev

Re: Fw: Please share a public maven setting.xml configuration

2019-01-02 Thread ShaoFeng Shi
yes, please go ahead. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev

Re: Re: Kylin will not delete old hbase table when refresh the segment

2019-01-02 Thread ShaoFeng Shi
JIRA is created as below; anyone who wants to contribute can leave a comment under it, then I will change the assignee to you: https://issues.apache.org/jira/browse/KYLIN-3753 Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https

[jira] [Created] (KYLIN-3753) Delete old hbase table when refresh the segment

2019-01-02 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3753: --- Summary: Delete old hbase table when refresh the segment Key: KYLIN-3753 URL: https://issues.apache.org/jira/browse/KYLIN-3753 Project: Kylin Issue Type

Re: Re: Evaluate Kylin on Parquet

2019-01-01 Thread ShaoFeng Shi
Hi Yang, The real-time streaming feature is also under review and testing now. I think when they (new storage and real-time) are ready to be merged, we can propose to jump the version to 3.0. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc

Re: Re: Evaluate Kylin on Parquet

2018-12-29 Thread ShaoFeng Shi
Thanks very much for Yiming and Jiatao's comments, they're very valueable. There are many improvements can do for this new storage. We welcome all kinds of contribution and would like to improve it together with the community in the year of 2019! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC

Re: Fw: Please share a public maven setting.xml configuration

2018-12-29 Thread ShaoFeng Shi
I have no customization in maven setting, but I have a local proxy server: export http_proxy=http://127.0.0.1:1087; export https_proxy=http://127.0.0.1:1087; Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin

Re: Kylin real-time streaming is ready on realtime-streaming branch

2018-12-28 Thread ShaoFeng Shi
Create new component "Real-time Streaming" in JIRA, please use this for the real-time related issues. The old "Streaming" component is renamed to "NRT Streaming". Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc:

Re: Kylin2.5.2服务搭建趟坑集锦,有遇得相同问题的朋友请放心食用

2018-12-28 Thread ShaoFeng Shi
No problem, welcome to try Kylin! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join

Re: Kylin2.5.2服务搭建趟坑集锦,有遇得相同问题的朋友请放心食用

2018-12-27 Thread ShaoFeng Shi
start with Kylin? - To get a quick start, you can run Kylin in a Hadoop sandbox VM or in the cloud, for example, start a small AWS EMR or Azure HDInsight cluster and then install Kylin in one of the nodes. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io

Re: Kylin real-time streaming is ready on realtime-streaming branch

2018-12-25 Thread ShaoFeng Shi
Thanks for the information. I'm trying to catch up. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Work email: shaofeng@kyligence.io Kyligence Inc: https://kyligence.io/ Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr

<    1   2   3   4   5   6   7   8   9   10   >