Re: [VOTE] Release apache-kylin-4.0.4 (RC1)

[George Ni]

+1 (binding)

ShaoFeng Shi  于2024年1月22日周一 11:33写道：

> +1 (binding)
>
> I checked:
>  - the source package contains the NOTICE, LICENSE and DEPENDENCIES
>  - all source files have Apache License 2.0 as header
>  - no binary file included in the source release
>  - the source package is signed by PMC member liy...@apache.org
>  - the SHA256 hash is correct
>  - 'mvn clean package - DskipTests' success with Java8 and maven 3.9.6
>
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC member,
> Apache Incubator PMC member,
> Email: shaofeng...@apache.org
>
>
>
>
>
>
> Li Yang  于2024年1月21日周日 00:13写道：
>
> > Hi all,
> >
> > I have created a build for Apache Kylin 4.0.4, release candidate 1. This
> is
> > a very small release aiming to upgrade the versions of dependent
> components
> > mainly.
> >
> > Changes highlights:
> >
> >- Bump commons-fileupload from 1.3.3 to 1.5
> >- Bump tomcat-catalina from 8.5.78 to 8.5.86
> >- Bump spring-core from 5.2.22.RELEASE to 5.2.23.RELEASE
> >- Bump scala minor version from 2.12.10 to 2.12.13
> >- And a few other bug fixes
> >
> > Thanks to everyone who has contributed to this release.
> >
> > Apart from the above changes, there are no new features or improvements
> in
> > this proposed release.
> >
> > The commit to being voted upon:
> >
> >
> https://github.com/apache/kylin/commit/37f63b8c22a557bb7f17df370aae9cf2ae640a18
> >
> > The artifacts to be voted on, including the source package and the binary
> > packages are located here:
> > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-4.0.4-rc1/
> >
> > The hash of the artifacts are as the following
> > - apache-kylin-4.0.4-source-release.zip.sha256:
> > 21b338aae14a71357650b35f473381cf325a9781adf1f6c9954cae9b4027cfe2
> > - apache-kylin-4.0.4-bin-spark3.tar.gz.sha256:
> > 77abb6a1174dd7dd63c747c95cbb1da9838c48c0c9dc4c7c35e36933ebb2636e
> >
> > A staged Maven repository is available for review at:
> > https://repository.apache.org/content/repositories/orgapachekylin-1113
> >
> > Release artifacts are signed with my key:
> > - Fingerprint: CF48 8F24 2BBC 3A88 5DB7  C6DF 685F 5B5D D254 DE89
> > - Public source 1: https://people.apache.org/keys/committer/liyang.asc
> > - Public source 2:
> >
> >
> https://keys.openpgp.org/vks/v1/by-fingerprint/CF488F242BBC3A885DB7C6DF685F5B5DD254DE89
> >
> > Please vote on releasing this package as Apache Kylin 4.0.4.
> >
> > The vote is open for the next 72 hours and passes if a majority of at
> least
> > three +1 PMC votes are cast.
> >
> >
> > [ ] +1 Release this package as Apache Kylin 3.0.2
> > [ ] 0 I don't feel strongly about it, but I'm okay with the release
> > [ ] -1 Do not release this package because...
> >
> > Here is my vote:
> > +1 (binding)
> >
> > Best regards,
> > Li Yang
> >
>


-- 

-

Best regards,



Ni Chunen / George

Re: [Draft][Report] Kylin board report - Nov 2023

[George Ni]

LGTM.

ShaoFeng Shi  于2023年11月3日周五 15:12写道：

> Hello all,This is the draft report to the ASF board, please help to review
> and provide feedback before Nov 6. Thank you!## Description:
> The mission of Apache Kylin is the creation and maintenance of software
> related
> to a distributed and scalable OLAP engine.
>
> ## Project Status:
> Current project status: Ongoing Issues for the board: There are no issues
> requiring board attention.
>
> ## Membership Data:
> Apache Kylin was founded 2015-11-18 (8 years ago)
> There are currently 48 committers and 23 PMC members in this project.
> The Committer-to-PMC ratio is roughly 2:1.
>
> Community changes, past quarter:
>
>- No new PMC members. Last addition was Xiaoxiang Yu on 2020-10-08.
>- Qian Xia was added as committer on 2023-08-16
>
>
> ## Project Activity:
> Recent releases:
> 5.0.0-beta was released on 2023-08-30.
> 5.0.0-alpha was released on 2023-04-26.
> 4.0.3 was released on 2022-12-23.
>
> Contributors are working on the release of 5.0.0 and 4.0.4.
> Plan to release 4.0.4 in Nov 2023;
> Plan to release 5.0.0 in Dec 2023
>
> ## Community Health:
> Less time spent on the community as we're busy on our full-time job.
>
> dev@kylin.apache.org had a 32% decrease in traffic in the past quarter (97
> emails compared to 141)
> iss...@kylin.apache.org had a 63% decrease in traffic in the past quarter
> (310 emails compared to 836)
> u...@kylin.apache.org had a 126% increase in traffic in the past quarter
> (34 emails compared to 15)
> 22 issues opened in JIRA, past quarter (-84% change)
> 63 issues closed in JIRA, past quarter (-43% change)
> 75 commits in the past quarter (-63% change)
> 17 code contributors in the past quarter (-43% change)
> 11 PRs opened on GitHub, past quarter (-56% change)
> 13 PRs closed on GitHub, past quarter (-31% change)
>
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-5.0.0-beta (RC1)

[George Ni]

+1 (binding)

ShaoFeng Shi  于2023年8月24日周四 22:08写道：

> +1 (binding)
>
> I checked the source package:
> - the sha256 hash is correct;
> - it was signed by PMC xiaoxiang.yu;
> - it includes the LICENSE and NOTICE file;
> - compiles success with maven 3.6.3 and java 1.8.0_161 on macOS 11.4;
> - test success with the command "bash dev-support/unit_testing.sh"
>
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>
>
>
>
> Xiaoxiang Yu  于2023年8月23日周三 18:23写道：
>
> > - Basic function included data load and query tested on my Hadoop
> > cluster(3.2.1) and succeeded.
> > - UT passed on my macbook using "bash dev-support/unit_testing.sh".
> (build
> > time costs 20 minutes and test time costs 1 hour)
> > - sha256 and gpg check succeed.
> >
> >
> > 
> > With warm regard
> > Xiaoxiang Yu
> >
> >
> >
> > On Wed, Aug 23, 2023 at 6:06 PM Xiaoxiang Yu  wrote:
> >
> > > Hi all,
> > >
> > >
> > > I have created a build for Apache Kylin 5.0.0-beta, release candidate
> 1.
> > >
> > >
> > > Changes highlights:
> > >
> > >
> > > [KYLIN-5465] - kylin5 Embedded Dashboard for Query and Job
> > > [KYLIN-5521] - JoinsGraph optimization: Query SQL association order
> > change
> > > causes the model to fail to hit
> > > [KYLIN-5491] - Partial Log Governance
> > > [KYLIN-5523] - Kylin5 supports using computable columns as Join Key and
> > > partition columns
> > > [KYLIN-5544] - Provides Spark DDL & DML execution capability in GUI
> > > [KYLIN-5564] - Introduce Bloom Filter to optimize data scanning based
> on
> > > Spark
> > > [KYLIN-5651] - supports obtaining table comment from Hive
> > > [KYLIN-5634] - Support query executor expansion and contraction
> > > [KYLIN-5550] - Auto load table when importing models
> > > [KYLIN-5681] - SCD2 can not work
> > > [KYLIN-5567] - Make ke-external module obey the open source specs
> > >
> > >
> > >
> > >
> > > Thanks to everyone who has contributed to this release.
> > > Here’s release notes:
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12352635
> > >
> > >
> > > The commit to be voted upon:
> > >
> > >
> >
> https://github.com/apache/kylin/commit/8c281e70708a1d89f35dfe4a29dba584d986add3
> > >
> > >
> > > Its hash is 8c281e70708a1d89f35dfe4a29dba584d986add3.
> > >
> > >
> > > The artifacts to be voted on are located here:
> > >
> >
> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-5.0.0-beta-rc1/
> > >
> > >
> > > The hash of the artifact is as follows:
> > > apache-kylin-5.0.0-beta-source-release.zip.sha256
> > > 2c81edd8269773baed4ee3243be6464bedecd33174a4dbd2169b8fbc1a31f053
> > >
> > >
> > > apache-kylin-5.0.0-beta-bin.tar.gz.sha256
> > > 106a43580a70699d41a1769efe3ce5e4e1c93e5b2aa13421ee4cafb30e9f5880
> > >
> > >
> > > A staged Maven repository is available for review at:
> > >
> https://repository.apache.org/content/repositories/orgapachekylin-/
> > >
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/xxyu.asc
> > >
> > >
> > > Please vote on releasing this package as Apache Kylin 5.0.0-beta.
> > >
> > >
> > > The vote is open for the next 72 hours and passes if a majority of
> > > at least three +1 PMC votes are cast.
> > >
> > >
> > > [ ] +1 Release this package as Apache Kylin 5.0.0-beta
> > > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > > [ ] -1 Do not release this package because…
> > >
> > >
> > > Here is my vote:
> > >
> > >
> > > +1 (binding)
> > >
> > > --
> > >
> > > Best wishes to you !
> > > From ：Xiaoxiang Yu
> >
>


-- 

-

Best regards,



Ni Chunen / George

Re: [Announce] New committer: Qian Xia(lauraxia)

[George Ni]

Congratulations!


Xiaoxiang Yu  于2023年8月16日周三 11:30写道：

> The Project Management Committee (PMC) for Apache Kylin
> has invited Qian Xia(lauraxia) to become a committer and we are pleased to
> announce that she have accepted.
>
> Being a committer enables easier contribution to the
> project since there is no need to go via the patch
> submission process. This should enable better productivity.
> --
> Best wishes to you !
> From ：Xiaoxiang Yu



-- 

-

Best regards,



Ni Chunen / George

Re: [Draft][Report] Kylin board report - Aug 2023

[George Ni]

Typo:  "Contributors are worked" should be " Contributors are working"

ShaoFeng Shi  于2023年8月7日周一 10:15写道：

> Hello Kylin developers,
>
> Below is the draft report to the ASF board, please help to review and
> provide feedback before Aug 9. Thank you!
>
> ## Description:
> The mission of Apache Kylin is the creation and maintenance of software
> related
> to a distributed and scalable OLAP engine
>
> ## Project Status:
> Current project status: Ongoing
> Issues for the board: There are no issues requiring board attention.
>
>
> ## Membership Data:
> Apache Kylin was founded 2015-11-18 (8 years ago)
> There are currently 47 committers and 23 PMC members in this project.
> The Committer-to-PMC ratio is roughly 2:1.
>
> Community changes, past quarter:
> - No new PMC members. Last addition was Xiaoxiang Yu on 2020-10-08.
> - No new committers. Last addition was Tengting Xu on 2022-11-29.
>
> ## Project Activity:
> 5.0.0-alpha was released on 2023-04-26.
> 4.0.3 was released on 2022-12-23.
> 4.0.2 was released on 2022-10-10.
> Contributors are worked on the next release of Kylin 5.
>
>
> ## Community Health:
> - Xiaoxiang Yu will attend the CommunityOverCode Asia in Beijing in
> 2023-08-20
> - Invitation of a new committer candidate be discussed in private list
> - Plan to release 5.0.0-beta in 2023-08
>
> dev@kylin.apache.org had a 27% decrease in traffic in the past quarter
> (154 emails compared to 211)
> u...@kylin.apache.org had a 240% increase in traffic in the past quarter
> (34 emails compared to 10)
> 140 issues opened in JIRA, past quarter (15% increase)
> 111 issues closed in JIRA, past quarter (-19% change)
> 203 commits in the past quarter (-21% change)
> 30 code contributors in the past quarter (-11% change)
> 23 PRs opened on GitHub, past quarter (-36% change)
> 17 PRs closed on GitHub, past quarter (-46% change)
>
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-5.0.0-alpha (RC3)

[George Ni]

+1 (binding)

ShaoFeng Shi  于2023年4月23日周日 22:12写道：

> +1 (binding)
>
> I checked:
> - LICENSE, NOTICE, README.md are included;
> - All source file has the right header; No binary file included;
> - "mvn clean package -DskipTests" success on Mac with JDK 1.8;
> - Run "dev-support/unit_testing.sh" successfully in docker
> "apachekylin/release-machine";
> - Signature is by Xiaoxiang Yu;
> - SHA256 is correct;
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>
>
>
>
> Xiaoxiang Yu  于2023年4月23日周日 10:49写道：
>
> > Hi all,
> >
> > I have created a build for Apache Kylin 5.0.0-alpha, release candidate 3.
> >
> > Changes highlights:
> >
> > [KYLIN-5216] - Upgrade metadata and engine : Kylin 5.0
> > [KYLIN-5397] - Support sum_lc function
> > [KYLIN-5387] - Index planner phase 1 for kylin 5
> > [KYLIN-5443] - Optimize the ER diagram of the model list page
> > [KYLIN-5459] - Partial Log Governance
> > [KYLIN-5374] - Provides Spark DDL & DML execution capability in GUI
> > [KYLIN-5309] - Propose more flexible runtime join scenarios for Kylin
> > [KYLIN-5297] - Add Kylin5 Jdbc module
> > [KYLIN-5390] - Build tasks support segment coverage
> > [KYLIN-5417] - streaming custom data parser
> > [KYLIN-5235] - Add doc for How to write document
> > [KYLIN-5236] - Add doc for how to contribute
> > [KYLIN-5249] - Add node status notification on web ui
> > [KYLIN-5256] - Add a cache for the system property get by the optional
> > config in KylinConfigBase
> > [KYLIN-5274] - Improve performance of getSubstitutor
> > [KYLIN-5361] - suggest set email content from hard code to configurable
> > files
> >
> >
> > Thanks to everyone who has contributed to this release.
> >
> > Here are the release notes:
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12352155
> >
> > The commit to being voted upon:
> >
> >
> https://github.com/apache/kylin/commit/4aef5cbce3313d40851470a42bff3b5a6827f609
> > Its hash is 4aef5cbce3313d40851470a42bff3b5a6827f609.
> >
> > The artifacts to be voted on, including the source package and one
> > pre-compiled binary package are located here:
> >
> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-5.0.0-alpha-rc3/
> >
> > The hash of the artifacts are as follows:
> > apache-kylin-5.0.0-alpha-source-release.zip.sha256
> > 0bafc66e9e9facdb10bdb0433cc47d69e3434b0801dc8b47b28dcbece65092d9
> >
> > apache-kylin-5.0.0-alpha-bin.tar.gz.sha256
> > 6b778ac63c6470fd02779aca27280e27aa29a4a5c4db62593f684de913a59d41
> >
> > A staged Maven repository is available for review at:
> > https://repository.apache.org/content/repositories/orgapachekylin-1109/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/xxyu.asc
> >
> >
> >
> >
> > Please vote on releasing this package as Apache Kylin 5.0.0-alpha.
> >
> > The vote is open for the next 72 hours and passes if a majority of
> > at least three +1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Kylin 5.0.0-alpha
> >
> > [ ] 0 I don't feel strongly about it, but I'm okay with the release
> >
> > [ ] -1 Do not release this package because...
> >
> >
> > Here is my vote:
> >
> > +1 (binding)
> >
> >
> > 
> > With warm regard
> > Xiaoxiang Yu (http://people.apache.org/~xxyu/)
> >
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Accept donation of new codebase as Apache Kylin 5.0

[George Ni]

+1

Zhong, Yanghong  于2023年2月27日周一 14:57写道：

> +1
>
> Best regards,
> Yanghong Zhong
> Email: nju_y...@apache.org
>
> From: hit_la...@126.com  on behalf of Xiaoxiang Yu <
> x...@apache.org>
> Date: Friday, February 24, 2023 at 10:26
> To: Kylin Dev 
> Subject: [VOTE] Accept donation of new codebase as Apache Kylin 5.0
> External Email
>
> Hi,
>
>
> The Kylin community plans to design and implement new modeling system.
>
>
> The new codebase[2] is now receiving regular contributions from Kyligence,
> and now eBay have contributed some features as well .
>
>
> As we discussed[1] before, I propose that we should now accept this new
> codebase
>  to Apache Kylin and continue development as part of the Kylin.
> All contributors have signed ICLAs and there is a branch with the
> donation[2].
>
>
> This vote is to determine if the Kylin PMC is in favor of accepting this
> donation. If the vote passes, the PMC and the authors of the code will work
> together to complete the ASF IP Clearance process (
>
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fincubator.apache.org%2Fip-clearance%2F=05%7C01%7Cyangzhong%40ebay.com%7Cbccaf5ca5f1845e136b608db160e9005%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C63812802402208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=3ruY752Ldtj11N14MV3qRJBfF%2BsrUe4T27Am2J0O%2Bh4%3D=0)
> .
>
>
> I have filled out the first draft of the IP clearance form and submitted it
> to the svn repo [3].
>
>
>
>
> [ ] +1 : Accept donation of new codebase as Apache Kylin 5.0
> [ ] 0  : No opinion
> [ ] -1 : Reject contribution because...
>
>
> Here is my vote: +1
>
>
> The vote will be open for at least 72 hours.
>
>
>
>
> [1]
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.apache.org%2Fthread%2Ftrvv0g2mqcq2bv6x2zpdvjl8hhzcccqr=05%7C01%7Cyangzhong%40ebay.com%7Cbccaf5ca5f1845e136b608db160e9005%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C63812802402208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=mc%2FErIsYDQGV304wDy0EA8PF9N1i9q0XUDmefdHh%2B4w%3D=0
> [2]
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Ftree%2Fkylin5=05%7C01%7Cyangzhong%40ebay.com%7Cbccaf5ca5f1845e136b608db160e9005%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C63812802402208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=hGmvXM4OYLtmONrlbUdEIwYvyYYprCWYqeO5voWMp0c%3D=0
> [3]
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsvn.apache.org%2Frepos%2Fasf%2Fincubator%2Fpublic%2Ftrunk%2Fcontent%2Fip-clearance%2Fkylin-new-modeling-system.xml=05%7C01%7Cyangzhong%40ebay.com%7Cbccaf5ca5f1845e136b608db160e9005%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C63812802402208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=%2FTCAhpSzUVtc3YLsphXTwyXEs%2BBrntLkmYLWeDvalvQ%3D=0
>
>
>
> --
>
> Best wishes to you !
> From ：Xiaoxiang Yu
>


-- 

-

Best regards,



Ni Chunen / George

Re: [Discuss] Adopt the new codebase as Apache Kylin 5.0

[George Ni]

Hi,

Overrall, I'd like to give +1 to this proposal, for Kylin5 has implemented
such a lot significant breakthroughs. Below are some of my questions:

1. Would it possible for users of Kylin 2-4 to upgrade their metadata to
Kylin5 easily?
2. Would the structures(URL, request and response) of the Restiful Apis in
Kylin 2-4 be kept?
3. Any benchmark test has been done?
4. Are features like Realtime Cubing, Cube Planner in Kylin3 are included
in Kylin5?

Li Yang  于2023年2月15日周三 17:23写道：

> As Xiaoxiang mentioned, the code donation has a lot of improvements
> compared to current Kylin 4. Many are long wanted, like
>
>- The flexible model can greatly improve the smoothness of adding new
>dimensions in a production environment.
>- The computed column can mind the gap of last-mile data transformation.
>- The new model metadata design that is more friendly to dynamic
>indexing.
>- Support of 63+ dimensions.
>
> Accepting this code base a good thing for the whole Kylin community.
>
> Cheers
> Yang
>
>
> On Tue, Feb 14, 2023 at 10:46 PM ShaoFeng Shi 
> wrote:
>
> > The current limitations are very difficult to solve in normal ways. For
> > example, the Cuboid ID is represented by a Long number, which is 64 bit,
> > and the sequence of each dimension is fixed. The Cuboid ID appears in
> every
> > part of Kylin's source code. This design couldn't be refactored easily.
> So
> > I agree that a whole new design is necessary, in long term it can help a
> > lot.
> >
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> > Apache Kylin PMC,
> > Apache Incubator PMC,
> > Email: shaofeng...@apache.org
> >
> > Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> > Join Kylin user mail group: user-subscr...@kylin.apache.org
> > Join Kylin dev mail group: dev-subscr...@kylin.apache.org
> >
> >
> >
> >
> > Xiaoxiang Yu  于2023年2月14日周二 14:22写道：
> >
> > > A formatted version of the discussion with the same content:
> > >
> > > ## Background ##
> > >
> > > As we discussed in the mailing list[2] last year, Kylin 4.0 has
> achieved
> > > its goal in new storage (columnar file) and new query engine (Spark
> > based),
> > > and gained some adoptions from the community. But due to the old design
> > > from the early versions, Kylin 4.0 still keep some limitations from
> > > previous versions, such as max. 63 dimension cap, cube structure
> couldn't
> > > be modified once built, etc. We think the only way to solve those
> > > limitations is to do a whole redesign, especially in the metadata.
> > >
> > > The good news is, Kyligence has started to do that from years ago, and
> > its
> > > comercial version has been verified by many customers in terms of its
> > > functionality, performance and stability. Last year, Kyligence open
> > sourced
> > > its core under Apache License v2.0, and signed CCLA to Apache Software
> > > Foundataion. We staged it in a separate branch of the github repository
> > for
> > > review[1]. Engineers from other teams such as eBay also reviewed the
> > > codebase, and put forward many new ideas. We think based on the
> codebase,
> > > Kylin will not only gain a flexible metadata design, a faster computing
> > > engine, but also will gain richer user scenarios.
> > >
> > > The new codebase has the following features compared with the latest
> > > release (Kylin 4.0.3):
> > >
> > > - More flexible and enhanced data model
> > > * Allow adding new dimensions and measures to the existing data
> model
> > > * The model adapts to table schema changes while retaining the
> > > existing index at the best effort
> > > * Support last-mile data transformation using Computed Column
> > > * Support raw query (non-aggregation query) using Table Index
> > > * Support changing dimension table (SCD2)
> > > - Simplified metadata design
> > > * Merge DataModel and CubeDesc into new DataModel
> > > * Add DataFlow for more generic data sequence, e.g. streaming like
> > > data flow
> > > * New metadata AuditLog for better cache synchronization
> > > - More flexible index management
> > > * Add IndexPlan to support flexible index management
> > > * Add IndexEntity to support different index type
> > > * Add LayoutEntity to support different storage layouts of the same
> > > Index
> > > - Toward a native and vectorized query engine
> > > * Experiment: Integrate with a native execution engine, leveraging
> > > Gluten
> > > * Support async query
> > > * Enhance cost-based index optimizer
> > > - More
> > > * Build engine refactoring and performance optimization
> > > * New WEB UI based on Vue.js, a brand new front-end framework, to
> > > replace AngularJS
> > > * Smooth modeling process on one canvas
> > >
> > >
> > >
> > >
> > > ## Proposal ##
> > > So, I'd like to propose adopting the new codebase from Kyligence as
> Kylin
> > > 's future code base, e.g, Kylin 5. If accepted, we will request an IP
> > > clearance in Apache Incubator for 

Re: [Draft][Report] Kylin board report - Feb 2023

[George Ni]

LGTM

ShaoFeng Shi  于2023年2月6日周一 16:17写道：

> Hello Kylin developers,
>
> Below is the draft report to the ASF board, please help to review and
> provide feedback before Feb 8. Thank you!
>
>
> ## Description:
> The mission of Apache Kylin is the creation and maintenance of software
> related
> to a distributed and scalable OLAP engine.
>
> ## Issues:
> There are no issues requiring board attention.
>
> ## Membership Data:
> Apache Kylin was founded 2015-11-18 (7 years ago)
> There are currently 47 committers and 23 PMC members in this project.
> The Committer-to-PMC ratio is roughly 2:1.
>
> Community changes, past quarter:
> - No new PMC members. Last addition was Xiaoxiang Yu on 2020-10-08.
> - Tengting Xu was added as committer on 2022-11-29
>
> ## Project Activity:
> Recent releases:
> 4.0.3 was released on 2022-12-23.
> 4.0.2 was released on 2022-10-10.
> 3.1.3 was released on 2022-01-05.
>
> ## Community Health:
> dev@kylin.apache.org had a 42% decrease in traffic in the past quarter
> (101
> emails compared to 173)
> iss...@kylin.apache.org had a 31% decrease in traffic in the past quarter
> (790 emails compared to 1130)
> 126 issues opened in JIRA, past quarter (88% increase)
> 73 issues closed in JIRA, past quarter (69% increase)
> 172 commits in the past quarter (59% increase)
> 52 code contributors in the past quarter (173% increase)
> 67 PRs opened on GitHub, past quarter (-22% change)
> 51 PRs closed on GitHub, past quarter (-40% change)
>
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-4.0.3 (RC1)

[George Ni]

+1

Xiaoxiang Yu  于2022年12月19日周一 11:39写道：

> +1
>
>
> mvn test passed
>
>
>
>
> --
>
> Best wishes to you !
> From ：Xiaoxiang Yu
>
>
>
>
>
> At 2022-12-17 14:25:29, "Li Yang"  wrote:
> >+1
> >
> >`mvn clean package` passed on commit
> >322ab6e5ee9738c5a07165af398c1faeeeacb079
> >
> >OpenJDK Runtime Environment (build 1.8.0_342-8u342-b07-0ubuntu1~20.04-b07)
> >OpenJDK 64-Bit Server VM (build 25.342-b07, mixed mode)
> >
> >On Fri, Dec 16, 2022 at 7:33 PM ShaoFeng Shi 
> wrote:
> >
> >> Hi all,
> >>
> >> I have created a build for Apache Kylin 4.0.3, release candidate 1.
> >>
> >> Changes highlights:
> >> - [KYLIN-5181] - Support postgresql to store kylin metadata
> >> - [KYLIN-5246] - Long running job's log staying in mem, may cause job
> >> server oom
> >> - [KYLIN-5250] - Add a switch for no hack aggregation group
> >> - [KYLIN-5251] - On hadoop 3 platform and start with class not found:
> >> org/apache/commons/Configuration
> >> - [KYLIN-5008] - When backend spark was failed, but corresponding job
> >> status is shown as finished in WebUI
> >> - [KYLIN-5245] - When a job is submitted with deployMode=cluster and the
> >> application driver is abnormal, Kylin displays the job status as success
> >> - [KYLIN-5271] - Query memory leaks
> >> - [KYLIN-5285] - Performance optimization for sharby column
> >>
> >>
> >> Thanks to everyone who has contributed to this release.
> >> Here are the release notes:
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12352685
> >>
> >> The commit to being voted upon:
> >>
> >>
> https://github.com/apache/kylin/commit/322ab6e5ee9738c5a07165af398c1faeeeacb079
> >> Its hash is 322ab6e5ee9738c5a07165af398c1faeeeacb079.
> >>
> >> The artifacts to be voted on, including the source package and one
> >> pre-compiled binary package are located here:
> >> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-4.0.3-rc1/
> >>
> >> The hash of the artifacts are as follows:
> >>
> >> apache-kylin-4.0.3-source-release.zip.sha256
> >> 725d2e7d96eae04013ce91687bf9e19df3041410476849c640f0cef68e25262b
> >>
> >> apache-kylin-4.0.3-bin-spark3.tar.gz
> >> b44d08b51f7b542ff8a93acaa345ffe26cf4b182c011555435078fae6215356a
> >>
> >> A staged Maven repository is available for review at:
> >> https://repository.apache.org/content/repositories/orgapachekylin-1101/
> >>
> >> Release artifacts are signed with the following key:
> >> https://people.apache.org/keys/committer/shaofengshi.asc
> >>
> >> Please vote on releasing this package as Apache Kylin 4.0.3.
> >>
> >> The vote is open for the next 72 hours and passes if a majority of
> >> at least three +1 PMC votes are cast.
> >>
> >> [ ] +1 Release this package as Apache Kylin 4.0.3
> >> [ ] 0 I don't feel strongly about it, but I'm okay with the release
> >> [ ] -1 Do not release this package because...
> >>
> >> Here is my vote:
> >> +1 (binding)
> >>
> >> Best regards,
> >>
> >> Shaofeng Shi 史少锋
> >> Apache Kylin PMC,
> >> Apache Incubator PMC,
> >> Email: shaofeng...@apache.org
> >>
> >> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> >> Join Kylin user mail group: user-subscr...@kylin.apache.org
> >> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
> >>
>


-- 

-

Best regards,



Ni Chunen / George

Re: [Draft][Report] Kylin board report - Nov 2022

[George Ni]

OK. Other content is fine to me.

ShaoFeng Shi  于2022年11月7日周一 21:53写道：

> George, thanks for the comment; That line was from the asf reporter wizard,
> which is auto generated; I copied it by mistake; Please ignore it.
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>
>
>
>
> George Ni  于2022年11月7日周一 21:43写道：
>
> > >
> > > Busiest topics (click to pop up): emailGitHubJIRA
> > >
> >
> > What's this?
> >
> > ShaoFeng Shi  于2022年11月7日周一 15:50写道：
> >
> > > Hello Kylin developers,
> > >
> > > Below is the draft report to the ASF board, please help to review and
> > > provide feedback before Nov 9. Thank you!
> > >
> > > ## Description:
> > > The mission of Apache Kylin is the creation and maintenance of software
> > > related
> > > to a distributed and scalable OLAP engine
> > >
> > > ## Issues:
> > > There are no issues requiring board attention.
> > >
> > > ## Membership Data:
> > > Apache Kylin was founded 2015-11-18 (7 years ago)
> > > There are currently 46 committers and 23 PMC members in this project.
> > > The Committer-to-PMC ratio is 2:1.
> > >
> > > Community changes, past quarter:
> > > - No new PMC members. Last addition was Xiaoxiang Yu on 2020-10-08.
> > > - No new committers. Last addition was Shengjun Zheng on 2021-07-07.
> > >
> > > ## Project Activity:
> > > The team is working on next generation Kylin 5's development; The code
> > base
> > > is
> > > on "kylin5" branch;
> > >
> > > Recent releases:
> > > 4.0.2 was released on 2022-10-10.
> > > 3.1.3 was released on 2022-01-05.
> > > 4.0.1 was released on 2022-01-05.
> > >
> > > ## Community Health:
> > > There is no new feature under development on Kylin 4, so the activity
> on
> > it
> > > is less than before. In order to make Kylin as cloud-native, we're
> > > developing Kylin 5.
> > >
> > > dev@kylin.apache.org had a 42% decrease in traffic in the past quarter
> > > (101
> > > emails compared to 173)
> > > iss...@kylin.apache.org had a 31% decrease in traffic in the past
> > quarter
> > > (790 emails compared to 1130)
> > > 62 issues opened in JIRA, past quarter (37% increase)
> > > 40 issues closed in JIRA, past quarter (207% increase)
> > > 95 commits in the past quarter (20% increase)
> > > 25 code contributors in the past quarter (150% increase)
> > > 78 PRs opened on GitHub, past quarter (14% increase)
> > > 77 PRs closed on GitHub, past quarter (32% increase)
> > > Busiest topics (click to pop up): emailGitHubJIRA
> > >
> > >
> > > Best regards,
> > >
> > > Shaofeng Shi 史少锋
> > > Apache Kylin PMC,
> > > Apache Incubator PMC,
> > > Email: shaofeng...@apache.org
> > >
> > > Apache Kylin FAQ:
> https://kylin.apache.org/docs/gettingstarted/faq.html
> > > Join Kylin user mail group: user-subscr...@kylin.apache.org
> > > Join Kylin dev mail group: dev-subscr...@kylin.apache.org
> > >
> >
> >
> > --
> >
> > -
> >
> > Best regards,
> >
> >
> >
> > Ni Chunen / George
> >
>


-- 

-

Best regards,



Ni Chunen / George

Re: [Draft][Report] Kylin board report - Nov 2022

[George Ni]

>
> Busiest topics (click to pop up): emailGitHubJIRA
>

What's this?

ShaoFeng Shi  于2022年11月7日周一 15:50写道：

> Hello Kylin developers,
>
> Below is the draft report to the ASF board, please help to review and
> provide feedback before Nov 9. Thank you!
>
> ## Description:
> The mission of Apache Kylin is the creation and maintenance of software
> related
> to a distributed and scalable OLAP engine
>
> ## Issues:
> There are no issues requiring board attention.
>
> ## Membership Data:
> Apache Kylin was founded 2015-11-18 (7 years ago)
> There are currently 46 committers and 23 PMC members in this project.
> The Committer-to-PMC ratio is 2:1.
>
> Community changes, past quarter:
> - No new PMC members. Last addition was Xiaoxiang Yu on 2020-10-08.
> - No new committers. Last addition was Shengjun Zheng on 2021-07-07.
>
> ## Project Activity:
> The team is working on next generation Kylin 5's development; The code base
> is
> on "kylin5" branch;
>
> Recent releases:
> 4.0.2 was released on 2022-10-10.
> 3.1.3 was released on 2022-01-05.
> 4.0.1 was released on 2022-01-05.
>
> ## Community Health:
> There is no new feature under development on Kylin 4, so the activity on it
> is less than before. In order to make Kylin as cloud-native, we're
> developing Kylin 5.
>
> dev@kylin.apache.org had a 42% decrease in traffic in the past quarter
> (101
> emails compared to 173)
> iss...@kylin.apache.org had a 31% decrease in traffic in the past quarter
> (790 emails compared to 1130)
> 62 issues opened in JIRA, past quarter (37% increase)
> 40 issues closed in JIRA, past quarter (207% increase)
> 95 commits in the past quarter (20% increase)
> 25 code contributors in the past quarter (150% increase)
> 78 PRs opened on GitHub, past quarter (14% increase)
> 77 PRs closed on GitHub, past quarter (32% increase)
> Busiest topics (click to pop up): emailGitHubJIRA
>
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-4.0.2 (RC1)

[George Ni]

+1

Mukvin  于2022年9月15日周四 09:56写道：

> +1
> Happy passed on "CDH 5.16.1"
> UT passed on macOS via "mvn clean install".
>
>
>
>
>
>
>
> --
>
> Best regards.
> Tengting Xu
>
>
>
>
>
> At 2022-09-14 23:23:09, "Xiaoxiang Yu"  wrote:
> >Happy path passed on Hadoop 3.0.0 + Spark 3.1.1
> >UT passed on centos via "mvn clean install -DskipTests ; mvn test"
> >
> >checksum verified
> >
> >
> >
> >
> >
> >
> >
> >--
> >
> >Best wishes to you !
> >From ：Xiaoxiang Yu
> >
> >
> >
> >
> >
> >At 2022-09-14 23:14:25, "Xiaoxiang Yu"  wrote:
> >>Hi all,
> >>
> >>
> >>
> >>
> >>I have created a build for Apache Kylin 4.0.2, release candidate 1.
> >>
> >>
> >>
> >>
> >>Changes highlights:
> >>
> >>[KYLIN-5187] - Support Alluxio Local Cache + Soft Affinity to speed up
> the query performance on the cloud
> >>
> >>[KYLIN-4954] - Cardinality statistics for Kylin 4
> >>
> >>[KYLIN-5166] - Use SQL hint to specify the cube that the user wants to
> query
> >>
> >>[KYLIN-5195] - update spark from 3.1.1 to 3.1.3 in kylin4
> >>
> >>[KYLIN-5181] - support postgresql to store kylin metadata
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>Thanks to everyone who has contributed to this release.
> >>
> >>Here are the release notes:
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12350849
> >>
> >>
> >>
> >>
> >>The commit to being voted upon:
> >>
> >>
> https://github.com/apache/kylin/commit/f88d14600ffb1a24d9eb33b29c6114c635600111
> >>
> >>Its hash is f88d14600ffb1a24d9eb33b29c6114c635600111.
> >>
> >>
> >>
> >>
> >>The artifacts to be voted on, including the source package and one
> pre-compiled binary package are located here:
> >>
> >>https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-4.0.2-rc1/
> >>
> >>
> >>
> >>
> >>The hash of the artifacts are as follows:
> >>
> >>
> >>
> >>
> >>apache-kylin-4.0.2-source-release.zip.sha256
> >>
> >>34920bbe4e3ec118a099fd7a5375515d5852aac45ed5e6c937cfff92f22869be
> >>
> >>
> >>
> >>
> >>apache-kylin-4.0.2-bin.tar.gz.sha256
> >>98309df502aff1154c80d3608b18b13ca305fb9926f7dfb8a15e1107f0a32c67
> >>
> >>
> >>
> >>
> >>A staged Maven repository is available for review at:
> >>
> >>https://repository.apache.org/content/repositories/orgapachekylin-1100/
> >>
> >>
> >>
> >>
> >>Release artifacts are signed with the following key:
> >>
> >>https://people.apache.org/keys/committer/xxyu.asc
> >>
> >>
> >>
> >>
> >>Please vote on releasing this package as Apache Kylin 4.0.2.
> >>
> >>
> >>
> >>
> >>The vote is open for the next 72 hours and passes if a majority of
> >>
> >>at least three +1 PMC votes are cast.
> >>
> >>
> >>
> >>
> >>[ ] +1 Release this package as Apache Kylin 4.0.2
> >>
> >>[ ] 0 I don't feel strongly about it, but I'm okay with the release
> >>
> >>[ ] -1 Do not release this package because...
> >>
> >>
> >>
> >>
> >>Here is my vote:
> >>
> >>+1 (binding)
> >>
> >>
> >>
> >>
> >>
> >>--
> >>
> >>Best wishes to you !
> >>From ：Xiaoxiang Yu
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-3.1.3 (RC1)

[George Ni]

+1

Li Yang  于2021年12月31日周五 06:31写道：

> +1
>
> On Thu, Dec 30, 2021 at 7:03 PM Mukvin  wrote:
>
> > +1
> >
> > mvn clean test passed.
> >
> >
> > | |
> > Mukvin
> > |
> > |
> > boyboys...@163.com
> > |
> > On 12/30/2021 19:01，Yaqian Zhang wrote：
> > +1.
> >
> > mvn clean test passed.
> >
> > Happy path passed on cdh5.7, cdh6.3 and hdp2.4.
> >
> > 在 2021年12月30日，下午6:04，Xiaoxiang Yu  写道：
> >
> > Hi all, I have created a build for Apache Kylin 3.1.3, release candidate
> 1.
> >
> >
> > Changes highlights:
> > KYLIN-4947 Implement spark engine for cube optimization jobs
> > KYLIN-4948 Provide an API to allow users to adjust cuboids manually
> > KYLIN-4971 Add new measure bitmap_map for count distinct measure in UI
> > Thanks to everyone who has contributed to this release. Here are the
> > release notes:
> > <
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12349394
> > >
> >
> >
> > The commit to being voted upon:
> > <
> >
> https://github.com/apache/kylin/commit/2fb07e6b1bf0f716090f3b73004c5afe0096b9be
> > >
> > Its hash is fb07e6b1bf0f716090f3b73004c5afe0096b9be.
> >
> >
> > The artifacts to be voted on, including the source package and four
> > pre-compiled binary packages are located here:
> > 
> >
> >
> > The hash of the artifacts are as follows:
> >
> >
> > apache-kylin-3.1.3-source-release.zip.sha256
> > 5da0cde33ae99899a40ead30cfd890315e8f5619b9ed4dae9239f1991c968d9d
> >
> >
> > apache-kylin-3.1.3-bin-cdh57.tar.gz.sha256
> > e8186eedda200db9420a7e439e74193e7a87f30a9c7938ec0250aab96ff5c048
> >
> >
> > apache-kylin-3.1.3-bin-cdh60.tar.gz.sha256
> > ad1544d1dbdd3637394376ce8a975a50eb78aef8e25f0e325a0570c40acb4347
> >
> >
> > apache-kylin-3.1.3-bin-hadoop3.tar.gz.sha256
> > 22ec20b232b50b379c01570bea08f3c02287bbbe666ece982fe5dd75c3c8bcde
> > apache-kylin-3.1.3-bin-hbase1x.tar.gz.sha256
> > 6f893cb3634461f856dd12bb174b3215bb8ee73eed4ea6efc697130479453182
> >
> >
> >
> >
> > A staged Maven repository is available for review at:
> >  >
> >
> >
> > Release artifacts are signed with the following key:
> > 
> >
> >
> >
> >
> > Please vote on releasing this package as Apache Kylin 3.1.3.
> >
> >
> > The vote is open for the next 72 hours and passes if a majority of at
> > least three +1 binding votes are cast.
> > [ ] +1 Release this package as Apache Kylin 3.1.3
> > [ ] 0 I don't feel strongly about it, but I'm okay with the release
> > [ ] -1 Do not release this package because...
> > Here is my vote:
> > +1 (binding)
> >
> > --
> >
> > Best wishes to you !
> > From ：Xiaoxiang Yu
> >
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-4.0.1 (RC1)

[George Ni]

+1

Li Yang  于2021年12月31日周五 06:30写道：

> +1
>
> On Thu, Dec 30, 2021 at 7:03 PM Mukvin  wrote:
>
> > +1
> >
> >
> > mvn clean test passed.
> >
> >
> > | |
> > Mukvin
> > |
> > |
> > boyboys...@163.com
> > |
> > On 12/30/2021 19:00，Yaqian Zhang wrote：
> > +1.
> >
> > mvn clean test passed.
> >
> > Happy path passed on CDH5.7 and CDH6.3.
> >
> > 在 2021年12月30日，下午5:17，Xiaoxiang Yu  写道：
> >
> > Hi all, I have created a build for Apache Kylin 4.0.1, release candidate
> 1.
> >
> >
> > Changes highlights:
> > KYLIN-5067 CubeBuildJob build unnecessary snapshot
> > KYLIN-5069 Remove find-hive-dependency.sh in Kylin 4
> > KYLIN-5111 Record the time spent for each stage of query in kylin4's log
> > KYLIN-5117 Support percentile function after aggregate sub query
> >
> >
> > Thanks to everyone who has contributed to this release. Here are the
> > release notes:
> > <
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12350472
> > >
> >
> >
> > The commit to being voted upon:
> > <
> >
> https://github.com/apache/kylin/commit/337026c97d47d0325c3eeefe9fd2f2bebdb1eb18
> > >
> > Its hash is 337026c97d47d0325c3eeefe9fd2f2bebdb1eb18.
> >
> >
> >
> >
> > The artifacts to be voted on, including the source package and two
> > pre-compiled binary packages are located here:
> > 
> >
> >
> >
> >
> > The hash of the artifacts are as follows:
> >
> >
> > apache-kylin-4.0.1-source-release.zip.sha256
> > 6b9671dbab337f7000768da552bb62473ebf919d1f9d12c5db02273eea2a9130
> >
> >
> > apache-kylin-4.0.1-bin-spark2.tar.gz.sha256
> > d680630ebc8aba6f6db8b06cab210ff7b1b79212554613cd0279077245b81c95
> >
> >
> > apache-kylin-4.0.1-bin-spark3.tar.gz.sha256
> > 94a897d52b6b556263d33dfb8b09db4556109b0a6c908c38b158283ac8110656
> >
> >
> >
> >
> > A staged Maven repository is available for review at:
> >  >
> >
> >
> > Release artifacts are signed with the following key:
> > 
> >
> >
> >
> >
> >
> >
> > Please vote on releasing this package as Apache Kylin 4.0.1.
> > The vote is open for the next 72 hours and passes if a majority of at
> > least three +1 binding votes are cast.
> > [ ] +1 Release this package as Apache Kylin 4.0.1
> > [ ] 0 I don't feel strongly about it, but I'm okay with the release
> > [ ] -1 Do not release this package because...
> > Here is my vote:
> > +1 (binding)
> >
> >
> >
> > --
> >
> > Best wishes to you !
> > From ：Xiaoxiang Yu
> >
>


-- 

-

Best regards,



Ni Chunen / George

Re: [Draft][Report] Apache Kylin - Nov 2021

[George Ni]

LGTM

ShaoFeng Shi  于2021年11月6日周六 下午10:51写道：

> Hello Kylin developers,
>
> Below is the draft report to ASF board, please help to review and provide
> feedback before Nov 9. Thank you!
>
> ## Description:
> The mission of Apache Kylin is the creation and maintenance of software
> related
> to a distributed and scalable OLAP engine
>
> ## Issues:
> No issue needs the board's attention.
>
> ## Membership Data:
> Apache Kylin was founded 2015-11-18 (6 years ago)
> There are currently 47 committers and 24 PMC members in this project.
> The Committer-to-PMC ratio is roughly 2:1.
>
> Community changes, past quarter:
> - No new PMC members. Last addition was Xiaoxiang Yu on 2020-10-08.
> - No new committers. Last addition was Shengjun Zheng on 2021-07-07.
>
> We need invite more developer into the community.
>
> ## Project Activity:
> By the end of August, Kylin community released the 4.0.0 version, which has
> the new storage and new query engine, with less dependency on Hadoop. We
> belive it will bring Kylin into a new era. Recent releases:
> 4.0.0 was released on 2021-08-31.
> 3.1.2 was released on 2021-04-26.
> 4.0.0-beta was released on 2021-02-07.
>
> ## Community Health:
>
> dev@kylin.apache.org had a 1% decrease in traffic in the past quarter (134
> emails compared to 135)
> u...@kylin.apache.org had a 139% increase in traffic in the past quarter
> (67 emails compared to 28)
> 60 issues opened in JIRA, past quarter (-7% change)
> 31 issues closed in JIRA, past quarter (-11% change)
> 140 commits in the past quarter (-15% change)
> 41 code contributors in the past quarter (-4% change)
> 43 PRs opened on GitHub, past quarter (-35% change)
> 47 PRs closed on GitHub, past quarter (-24% change)
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-4.0.0 (RC1)

[George Ni]

[INFO]

[INFO] Reactor Summary for Apache Kylin 4.0.0:
[INFO]
[INFO] Apache Kylin ... SUCCESS [22:02
min]
[INFO] Apache Kylin - Core Common . SUCCESS [04:10
min]
[INFO] Apache Kylin - Core Metadata ... SUCCESS [07:32
min]
[INFO] Apache Kylin - Core Cube ... SUCCESS [02:38
min]
[INFO] Apache Kylin - Core Metrics  SUCCESS [
 7.086 s]
[INFO] Apache Kylin - Core Job  SUCCESS [01:03
min]
[INFO] Apache Kylin - Core Storage  SUCCESS [
 9.418 s]
[INFO] Apache Kylin - Build Engine  SUCCESS [10:15
min]
[INFO] Apache Kylin - Hive Source . SUCCESS [02:26
min]
[INFO] Apache Kylin - Cache ... SUCCESS [
29.934 s]
[INFO] Apache Kylin - HBase Metastore . SUCCESS [01:56
min]
[INFO] Apache Kylin - Query ... SUCCESS [
38.784 s]
[INFO] Apache Kylin - Metrics Reporter Hive ... SUCCESS [
 2.994 s]
[INFO] Apache Kylin - Metrics Reporter Kafka .. SUCCESS [01:56
min]
[INFO] Apache Kylin 4.X ... SUCCESS [03:28
min]
[INFO] Apache Kylin 4.X - Metadata  SUCCESS [
31.488 s]
[INFO] Apache Kylin 4.X - Common .. SUCCESS [
35.322 s]
[INFO] Apache Kylin 4.X - Spark Engine  SUCCESS [10:45
min]
[INFO] Apache Kylin 4.X - Classloader . SUCCESS [02:37
min]
[INFO] Apache Kylin 4.X - Query ... SUCCESS [
56.359 s]
[INFO] Apache Kylin - REST Server Base  SUCCESS [03:47
min]
[INFO] Apache Kylin - REST Server . SUCCESS [05:29
min]
[INFO] Apache Kylin - JDBC Driver . SUCCESS [02:28
min]
[INFO] Apache Kylin - Tool  SUCCESS [02:10
min]
[INFO] Apache Kylin - Tool Assembly ... SUCCESS [
 8.195 s]
[INFO] Apache Kylin 4.X - Integration Test  SUCCESS [
11.448 s]
[INFO] Apache Kylin - Parquet Assembly  SUCCESS [
20.055 s]
[INFO]

[INFO] BUILD SUCCESS
[INFO]

[INFO] Total time:  01:29 h
[INFO] Finished at: 2021-08-25T22:01:45+08:00
[INFO]


Test passed on my side.

+1 binding

Li Yang  于2021年8月25日周三 下午8:07写道：

> +1 binding
>
> mvn clean install -DskipTests
> passed
>
> On Wed, Aug 25, 2021 at 2:05 PM wangrupeng  wrote:
>
> > + 1  mvn clean install -DskipTests passed
> >
> > ---
> > Best wishes,
> > Rupeng Wang
> >
> >
> >
> > 
> > 发件人: hit_la...@126.com  代表 Xiaoxiang Yu <
> > x...@apache.org>
> > 发送时间: 2021年8月24日 11:54
> > 收件人: Kylin Dev 
> > 主题: [VOTE] Release apache-kylin-4.0.0 (RC1)
> >
> > Hi all,
> >
> > I have created a build for Apache Kylin 4.0.0, release candidate 1.
> >
> > Changes highlights:
> >
> >
> >
> >
> > KYLIN-4903 cache parent datasource to accelerate next layer's cuboid
> > building
> >
> > KYLIN-4905 Support limit .. offset ... in spark query engine
> >
> > KYLIN-4925 Use Spark 3 as build and query engine for Kylin 4
> >
> > KYLIN-5011 Detect and scatter skewed data in dict encoding step
> >
> > KYLIN-4948 Provide an API to allow users to adjust cuboids manually
> >
> > KYLIN-5027 Add the config of whether to build base cuboid in kylin4
> >
> > KYLIN-5019 Avoid building global dictionary from all data of fact table
> > each time
> >
> >
> >
> >
> >
> >
> >
> > Thanks to everyone who has contributed to this release.
> >
> > Here are the release notes:
> >
> > <
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12349382
> > >
> >
> >
> >
> >
> >
> >
> >
> > The commit to being voted upon:
> >
> > <
> >
> https://github.com/apache/kylin/commit/aa6d582c0a96fdf31e85791f86850cfc00a7644f
> > >
> >
> > Its hash is aa6d582c0a96fdf31e85791f86850cfc00a7644f.
> >
> >
> >
> >
> >
> >
> >
> > The artifacts to be voted on, including the source package and two
> >
> > pre-compiled binary packages are located here:
> >
> > 
> >
> >
> >
> >
> >
> >
> >
> > The hash of the artifacts are as follows:
> >
> >
> >
> >
> > apache-kylin-4.0.0-source-release.zip.sha256
> >
> > 788d0402756dad6e735d6b435b94e3c67f2b3c730f38f8c9b4d71bc66dd71703
> >
> >
> >
> >
> > apache-kylin-4.0.0-bin-spark2.tar.gz.sha256
> >
> > 748c4916489e1e014eae81fe7e0cc72ef564573eb5882969b53feb2ac7ab9379
> >
> >
> >
> >
> > apache-kylin-4.0.0-bin-spark3.tar.gz.sha256
> >
> > 2378c066ff990b70f9a5f4ee32f56ed4a4d86afc88f5986dfbb05fd8f9cc5946
> >
> >
> >

Re: [Draft][Report] Apache Kylin - Aug 2021

[George Ni]

LGTM.

ShaoFeng Shi  于2021年8月6日周五 下午10:17写道：

> Hello Kylin developers,
>
> Below is the draft report to ASF board, please help to review and provide
> feedback before Aug 9. Thank you!
>
> ## Description: The mission of Apache Kylin is the creation and
> maintenance of software related to a distributed and scalable OLAP engine ##
> Issues: No issue needs the board's attention. ## Membership Data: Apache
> Kylin was founded 2015-11-18 (6 years ago) There are currently 47
> committers and 24 PMC members in this project. The Committer-to-PMC ratio
> is roughly 2:1. Community changes, past quarter: - No new PMC members.
> Last addition was Xiaoxiang Yu on 2020-10-08. - Shengjun Zheng was added
> as committer on 2021-07-07 ## Project Activity: 3.1.2 was released on
> 2021-04-26. 4.0.0-beta was released on 2021-02-07. 3.1.1 was released on
> 2020-10-18. ## Community Health: Luke Han gave a keynote speech on Apache
> Conn Asia 2021 on Aug 6. Zhichao Zhang introduced Kylin 4 new
> architecture on Apache Conn Asia 2021 on Aug 8. Shengjun Zhen shared
> their experience of using Kylin 4 in Youzan in the "Data & Cloud summit "
> in Shanghai on July 30. As Kylin 4's GA release was delayed due to
> limited resources, the community activity is less than last quarter. We
> plan to release 4.0 in this month, assuming the traffic will get increased
> in the next months. dev@kylin.apache.org had a 30% decrease in traffic in
> the past quarter (137 emails compared to 195) iss...@kylin.apache.org had
> a 35% decrease in traffic in the past quarter (1026 emails compared to 1578)
> u...@kylin.apache.org had a 56% decrease in traffic in the past quarter
> (28 emails compared to 63) 64 issues opened in JIRA, past quarter (-27%
> change) 35 issues closed in JIRA, past quarter (-44% change) 164 commits
> in the past quarter (168% increase) 44 code contributors in the past
> quarter (214% increase) 66 PRs opened on GitHub, past quarter (-7% change) 61
> PRs closed on GitHub, past quarter (-4% change)
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>
>
>

-- 

-

Best regards,



Ni Chunen / George

Re: Notice: The branch names of Apache Kylin on Github were changed !!!

[George Ni]

Great！

Zhichao Zhang  于2021年8月4日周三 下午3:20写道：

> Hi all:
>
>   Apache Kylin community has changed the branch names of Apache Kylin on
> Github:
>
>   1. The original branch 'kylin-on-parquet-v2' for kylin 4.X version has
> been changed to branch 'main', and as the default branch;
>
>   2. The original branch 'master' for kylin 3.X version has been changed
> to branch 'kylin3';
>
>
>
>
>   Please see the detail at:
> https://issues.apache.org/jira/browse/INFRA-22166  .
>
>
>
> Best regards,
>
> Zhichao Zhang



-- 

-

Best regards,



Ni Chunen / George

Re: [ANNOUNCE] new committer: Shengjun Zheng

[George Ni]

Congratulations!

Xiaoxiang Yu  于2021年7月13日周二 上午10:51写道：

> Sorry for my carelessness, I forget to update the commiter's name in the
> last paragraph. Please let me correct this mistake:
>
>
> Let's warmly welcome Shengjun as a Kylin committer. And congratulations to
> him.
>
> --
>
> Best wishes to you !
> From ：Xiaoxiang Yu
>
>
>
>
>
> At 2021-07-13 10:00:04, "Xiaoxiang Yu"  wrote:
> >Hello Kylin developers,
> >
> >
> >The Project Management Committee (PMC) for Apache Kylin
> >has invited Shengjun Zheng (郑生俊, email: shengjun_zh...@sina.com) to
> become a committer and
> >we are pleased to announce that he has accepted.
> >
> >
> >Zheng Shengjun, is a software engineer and head of Youzan<
> https://www.youzan.com/> 's data infrastructure platform.
> >He is a qualified Kylin expert and Apache evangelist, he joined the Kylin
> project since the middle of 2020. In the past over
> >1 year, he continues to contribute to the Kylin project, mainly on Kylin
> 4, including develop new features, fix bugs, answer
> >questions in the community, add/update documents, and also gave speech
> about Kylin 4.0 in meetups and conference.
> >
> >
> >Being a committer enables easier contribution to the project since there
> is no need to go via the patch
> >submission process. This should enable better productivity.
> >
> >
> >Let's warmly welcome Xiao as a Kylin committer!
> >
> >--
> >
> >Best wishes to you !
> >From ：Xiaoxiang Yu
>


-- 

-

Best regards,



Ni Chunen / George

Re: [DISCUSS] Plan of migrating 4.x codebase to the main branch

[George Ni]

+1

Xiaoxiang Yu  于2021年5月25日周二 下午2:57写道：

> Hi, all:
>
>
>
> At present, the code of Kylin 4.0 is located in the
> "kylin-on-parquet-v2" branch of the Kylin repository [
> https://github.com/apache/kylin/tree/kylin-on-parquet-v2]. This branch
> was separated from the master branch in April 2020 and became the
> development branch of Kylin 4.0.
>
>
>
> As more and more development tasks are on the new 4.0 codebase, we
> plan to promote it as the new master/main branch; the as-is master, which
> is 3.x codebase, will be rename to 3.x branch. In the meanwhile, many
> commits in the master branch after the separation were not in the
> "kylin-on-parquet-v2" branch, we need to catch up with them.
>
>
>
> Our preliminary plan is as follows:
>
> |
>
> Phase
>
> |
>
> Time Range
>
> |
>
> Action for maintainer
>
> |
>
> Caution for developer
>
> |
> |
>
> phase1
>
> |
>
> 2021-5-25~
>
> 2021-06-20
>
> |
> rename "kylin-on-parquet-v2" branch to "4.x"
> catch up the commits in master(since April 2020) to "4.x"
> |
>
> When you submit PR to the master branch (for 3.x), please consider whether
> it is needed for 4.x as well.
>
> |
> |
>
> phase2
>
> |
>
> 2021-6-20~
>
> 2021-07-10
>
> |
> package and do a round of test on the "4.x"
> |
>
> Same as above
>
> |
> |
>
> phase3
>
> |
>
> After
>
> 2021-07-10
>
> |
> rename master to "3.x"
> rename "4.x" to "main"
> update documents, jenkins job and other places, using the new main branch
> as default branch of Kylin repo.
> |
>
> The main branch becomes Kylin 4 code base; If you want to patch Kylin 3.x,
> submit PR to the "3.x" branch.
>
>
>
> |
>
>
>
> The above is the plan of migrating 4.x codebase to the main codebase. If
> you have any opinions or suggestions, please reply to the email and let us
> know. Thank you!
>
>
>
>
> --
>
> Best wishes to you !
> From ：Xiaoxiang Yu



-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-3.1.2 (RC1)

[George Ni]

[INFO]

[INFO] Reactor Summary for Apache Kylin 3.1.2:
[INFO]
[INFO] Apache Kylin ... SUCCESS [
 4.943 s]
[INFO] Apache Kylin - Core Common . SUCCESS [
24.080 s]
[INFO] Apache Kylin - Core Metadata ... SUCCESS [01:05
min]
[INFO] Apache Kylin - Core Dictionary . SUCCESS [05:05
min]
[INFO] Apache Kylin - Core Cube ... SUCCESS [03:19
min]
[INFO] Apache Kylin - Core Metrics  SUCCESS [
 5.548 s]
[INFO] Apache Kylin - Core Job  SUCCESS [01:14
min]
[INFO] Apache Kylin - Core Storage  SUCCESS [
10.620 s]
[INFO] Apache Kylin - Stream Core . SUCCESS [01:41
min]
[INFO] Apache Kylin - MapReduce Engine  SUCCESS [01:06
min]
[INFO] Apache Kylin - Spark Engine  SUCCESS [
 8.551 s]
[INFO] Apache Kylin - Flink Engine  SUCCESS [
 5.793 s]
[INFO] Apache Kylin - Hive Source . SUCCESS [
 8.742 s]
[INFO] Apache Kylin - DataSource SDK .. SUCCESS [
15.034 s]
[INFO] Apache Kylin - Jdbc Source . SUCCESS [
28.988 s]
[INFO] Apache Kylin - Kafka Source  SUCCESS [
 6.979 s]
[INFO] Apache Kylin - Cache ... SUCCESS [
10.814 s]
[INFO] Apache Kylin - HBase Storage ... SUCCESS [
46.756 s]
[INFO] Apache Kylin - Query ... SUCCESS [
15.935 s]
[INFO] Apache Kylin - Metrics Reporter Hive ... SUCCESS [
12.093 s]
[INFO] Apache Kylin - Metrics Reporter Kafka .. SUCCESS [
 7.476 s]
[INFO] Apache Kylin - Stream Source Kafka . SUCCESS [
 4.970 s]
[INFO] Apache Kylin - Stream Coordinator .. SUCCESS [
25.290 s]
[INFO] Apache Kylin - Stream Receiver . SUCCESS [
 6.288 s]
[INFO] Apache Kylin - Stream Storage .. SUCCESS [
 2.335 s]
[INFO] Apache Kylin - REST Server Base  SUCCESS [
30.923 s]
[INFO] Apache Kylin - Tool  SUCCESS [
18.341 s]
[INFO] Apache Kylin - Cube Migration Service .. SUCCESS [
 3.824 s]
[INFO] Apache Kylin - REST Server . SUCCESS [03:13
min]
[INFO] Apache Kylin - JDBC Driver . SUCCESS [
 6.698 s]
[INFO] Apache Kylin - Assembly  SUCCESS [
 9.855 s]
[INFO] Apache Kylin - Tool Assembly ... SUCCESS [
 1.508 s]
[INFO] Apache Kylin - Integration Test  SUCCESS [
15.912 s]
[INFO] Apache Kylin - Tomcat Extension  SUCCESS [
 1.690 s]
[INFO]

[INFO] BUILD SUCCESS
[INFO]

[INFO] Total time:  22:28 min
[INFO] Finished at: 2021-04-23T09:04:16Z
[INFO]


+1 binding
mvn test passed on my machine.

ShaoFeng Shi  于2021年4月22日周四 下午12:18写道：

> +1 (binding)
>
> I checked the source package and signature, looks good to me; and "mvn
> test" success with java 8 on MacOS 10.15:
>
> [INFO] Reactor Summary for Apache Kylin 3.1.2:
> [INFO]
> [INFO] Apache Kylin ... SUCCESS [
>  3.383 s]
> [INFO] Apache Kylin - Core Common . SUCCESS [
> 15.449 s]
> [INFO] Apache Kylin - Core Metadata ... SUCCESS [
> 30.591 s]
> [INFO] Apache Kylin - Core Dictionary . SUCCESS [06:06
> min]
> [INFO] Apache Kylin - Core Cube ... SUCCESS [01:28
> min]
> [INFO] Apache Kylin - Core Metrics  SUCCESS [
>  2.511 s]
> [INFO] Apache Kylin - Core Job  SUCCESS [01:05
> min]
> [INFO] Apache Kylin - Core Storage  SUCCESS [
>  4.507 s]
> [INFO] Apache Kylin - Stream Core . SUCCESS [
> 41.668 s]
> [INFO] Apache Kylin - MapReduce Engine  SUCCESS [
> 36.794 s]
> [INFO] Apache Kylin - Spark Engine  SUCCESS [
>  4.665 s]
> [INFO] Apache Kylin - Flink Engine  SUCCESS [
>  2.817 s]
> [INFO] Apache Kylin - Hive Source . SUCCESS [
>  3.724 s]
> [INFO] Apache Kylin - DataSource SDK .. SUCCESS [
>  6.164 s]
> [INFO] Apache Kylin - Jdbc Source . SUCCESS [
> 11.616 s]
> [INFO] Apache Kylin - Kafka Source  SUCCESS [
>  3.377 s]
> [INFO] Apache Kylin - Cache ... SUCCESS [
>  6.920 s]
> [INFO] Apache Kylin - HBase Storage ... SUCCESS [
> 25.712 s]
> [INFO] Apache Kylin 

Re: [VOTE] Release apache-kylin-4.0.0-beta (RC2)

[George Ni]

+1 binding

Wang rupeng  于2021年2月4日周四 下午2:58写道：

> +1
> Mvn clean test passed  in my environment
>
>
>
> ---
> Best wishes,
> Rupeng Wang
>
>
>
> 发件人: Yaqian Zhang 
> 日期: 星期四, 2021年2月4日 14:05
> 收件人: dev@kylin.apache.org 
> 主题: Re: [VOTE] Release apache-kylin-4.0.0-beta (RC2)
> +1
> Mvn clean test passed.
> Happy path on EMR5.x passed.
>
> > 在 2021年2月3日，21:31，Xiaoxiang Yu  写道：
> >
> > Hi all,
> >
> >
> >
> >
> > I have created a build for Apache Kylin 4.0.0-beta, release candidate 2.
> Please note that this release is built on kylin-on-parquet-v2 branch.
> >
> >
> >
> >
> > Changes highlights:
> >
> >
> >
> >
> > [KYLIN-4857] - Refactor system cube for kylin4
> >
> > [KYLIN-4842] - Supports grouping sets function for Kylin 4
> >
> > [KYLIN-4829] - Support to use thread-level SparkSession to execute query
> >
> > [KYLIN-4813] - Refine spark logger for Kylin 4 build engine
> >
> > [KYLIN-4858] - Support Kylin4 deployment on CDH 6.X
> >
> > [KYLIN-4818] - Calculate cuboid statistics in Kylin 4
> >
> > [KYLIN-4817] - Refine Cube Migration Tool for Kylin4
> >
> >
> >
> >
> > Thanks to everyone who has contributed to this release.
> >
> > Here are the release notes:
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12348723
> >
> >
> >
> >
> > The commit to being voted upon:
> >
> >
> https://github.com/apache/kylin/commit/546381392c55136310f591969e5a3f3db6074988
> >
> > Its hash is 546381392c55136310f591969e5a3f3db6074988.
> >
> >
> >
> >
> > The artifacts to be voted on, including the source package and one
> pre-compiled binary packages are located here:
> >
> >
> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-4.0.0-beta-rc2/
> >
> >
> >
> >
> > The hash of the artifacts are as follows:
> >
> > apache-kylin-4.0.0-beta-source-release.zip.sha256
> >
> > d5837ed106c4e10f71a6b7a6324520afdd536c10f5afd86bf6c98d734a3e64a8
> >
> >
> >
> >
> > apache-kylin-4.0.0-beta-bin.tar.gz.sha256
> >
> > e86ab855533104c2eac8fae53dc067d425ab263cebf558c666260a3ceb336b16
> >
> >
> >
> >
> >
> >
> >
> > A staged Maven repository is available for review at:
> >
> > https://repository.apache.org/content/repositories/orgapachekylin-1087/
> >
> >
> >
> >
> >
> >
> >
> > Release artifacts are signed with the following key:
> >
> > https://people.apache.org/keys/committer/xxyu.asc
> >
> >
> >
> >
> > Please vote on releasing this package as Apache Kylin 4.0.0-beta.
> >
> >
> >
> >
> > The vote is open for the next 72 hours and passes if a majority of
> >
> > at least three +1 binding votes are cast.
> >
> >
> >
> >
> > [ ] +1 Release this package as Apache Kylin 4.0.0-beta
> >
> > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> >
> > [ ] -1 Do not release this package because...
> >
> >
> >
> >
> > Here is my vote:
> >
> > +1 (binding)
> > --
> > Best wishes to you !
> > From ：Xiaoxiang Yu
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-4.0.0-beta (RC1)

[George Ni]

+1 binding

Yaqian Zhang  于2021年1月31日周日 下午12:53写道：

> +1
> Mvn clean test passed.
> Happy path passed on CDH6, EMR5, EMR6.
>
>
> > 在 2021年1月31日，10:03，Zhichao Zhang <441586...@qq.com> 写道：
> >
> > +1 from my side.
> >
> > Test passed on HDP2, CDH 5.
> >
> >
> > Best regards,
> > Zhichao Zhang
>
>

-- 

-

Best regards,



Ni Chunen / George

Re: [ANNOUNCE] new committer: Xiao Chu

[George Ni]

Congratulations

ShaoFeng Shi  于2020年11月4日周三 下午9:45写道：

> Hello Kylin developers,
>
> The Project Management Committee (PMC) for Apache Kylin
> has invited Xiao Chu (初晓, email: crow...@163.com) to become a committer
> and
> we are pleased
> to announce that he has accepted.
>
> In the past years, Xiao has contributed 21 commits in the master branch
> with an additional 1 in the
> document branch, resolved 21 JIRA issues. Besides, he published 5 articles
> on Kylin and gave 1
> speech in the community.
>
> Being a committer enables easier contribution to the
> project since there is no need to go via the patch
> submission process. This should enable better productivity.
>
> Let's warmly welcome Xiao as a Kylin committer!
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>


-- 

-

Best regards,



Ni Chunen / George

Re: new committer: Rupeng Wang

[George Ni]

Congratulations

vino yang  于2020年10月15日周四 下午4:20写道：

> Congratulations.
>
> Chao  于2020年10月15日周四 下午2:49写道：
>
> > Congratulations!
> >
> > Yaqian Zhang  于2020年10月15日周四 上午10:01写道：
> >
> > > Contratulations!
> > >
> > > > 在 2020年10月15日，08:11，Xiaoxiang Yu  写道：
> > > >
> > > > Congrats to rupeng.
> > > >
> > > >
> > > > | |
> > > > 敏丞
> > > > 邮箱：hit_la...@126.com
> > > > |
> > > >
> > > > 签名由 网易邮箱大师 定制
> > > >
> > > > On 10/14/2020 22:25, ShaoFeng Shi wrote:
> > > > The Project Management Committee (PMC) for Apache Kylin has invited
> > > Rupeng
> > > > Wang (王汝鹏, wangrup...@apache.org) to become a committer and we are
> > > pleased
> > > > to announce that he has accepted.
> > > >
> > > > Being a committer enables easier contribution to the project since
> > there
> > > is
> > > > no need to go via the patch submission process. This should enable
> > better
> > > > productivity.
> > > >
> > > > Congratulations, Rupeng!
> > > >
> > > > Best regards,
> > > >
> > > > Shaofeng Shi 史少锋
> > > > Apache Kylin PMC
> > > > Email: shaofeng...@apache.org
> > > >
> > > > Apache Kylin FAQ:
> > https://kylin.apache.org/docs/gettingstarted/faq.html
> > > > Join Kylin user mail group: user-subscr...@kylin.apache.org
> > > > Join Kylin dev mail group: dev-subscr...@kylin.apache.org
> > >
> > >
> >
>


-- 

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-3.1.1 (RC1)

[George Ni]

+1 (binding)


ShaoFeng Shi  于2020年10月15日周四 下午1:23写道：

> +1 (binding)
>
> I checked:
> - packages are signed by PMC x...@apache.org;
> - sha256 hash is good;
> - maven package and maven test are successful
>
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>
>
>
>
> Wang rupeng  于2020年10月15日周四 上午10:12写道：
>
> > +1
> > mvn test passed
> >
> > > 2020年10月15日 10:01，Yaqian Zhang  写道：
> > >
> > > +1
> > > Happy path passed on CDH57.
> > >
> > >> 在 2020年10月14日，23:21，Zhichao Zhang <441586...@qq.com> 写道：
> > >>
> > >> +1 from my side.
> > >> Happy path passed on HDP3.
> > >>
> > >> Best regards,
> > >> Zhichao Zhang
> > >
> >
> >
>


-- 

-

Best regards,



Ni Chunen / George

Re: New PMC: Xiaoxiang Yu

[George Ni]

Congratulations

Rupeng Wang  于2020年10月9日周五 下午6:53写道：

> Congratulations to Xiaoxiang!
>
>
> ---
> Best wishes,
> Rupeng Wang
>
>
>
> 在 2020/10/9 18:40，“Yaqian Zhang” 写入:
>
> Congratulations to Xiaoxiang!
>
> > 在 2020年10月9日，18:30，JiaTao Tao  写道：
> >
> > Congratulations!
> >
> >
> > Regards!
> >
> > Aron Tao
> >
> >
> > ShaoFeng Shi  于2020年10月9日周五 下午3:35写道：
> >
> >> The Project Management Committee (PMC) for Apache Kylin
> >> has invited Xiaoxiang Yu to become a PMC and we are pleased
> >> to announce that he has accepted.
> >>
> >> Xiaoxiang becomes the Kylin committer in late 2019; Since then, he
> plays a
> >> leadership role in the Kylin team, and actively coaches other
> contributors,
> >> including answer the questions, reviewing PRs, making the release,
> >> maintaining documents, etc. He also gave many sharings in the
> community.
> >>
> >> Being a PMC member enables assistance with the management
> >> and to guide the direction of the project.
> >>
> >> Congratulations to Xiaoxiang!
> >>
> >> Best regards,
> >>
> >> Shaofeng Shi 史少锋
> >> Apache Kylin PMC
> >> Email: shaofeng...@apache.org
> >>
> >> Apache Kylin FAQ:
> https://kylin.apache.org/docs/gettingstarted/faq.html
> >> Join Kylin user mail group: user-subscr...@kylin.apache.org
> >> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
> >>
>
>
>
>

-- 

-

Best regards,



Ni Chunen / George

[Announce] Apache Kylin 4.0.0-alpha released

[George Ni]

The Apache Kylin team is pleased to announce the immediate
availability of the 4.0.0-alpha release.

This is a major release after 3.1.0, with 35 new features and 22 bug
fixes. All of the changes in this release can be found in:
https://kylin.apache.org/docs/release_notes.html

You can download the source release and binary packages from Apache
Kylin's download page: https://kylin.apache.org/download/

Apache Kylin is an open-source Distributed Analytical Data Warehouse
for Big Data; it was designed to provide OLAP (Online Analytical
Processing) capability in the big data era. By renovating the
multi-dimensional cube and precalculation technology on Hadoop and
Spark, Kylin is able to achieve near-constant query speed regardless
of the ever-growing data volume. Reducing query latency from minutes
to sub-second, Kylin brings online analytics back to big data.

Apache Kylin lets you query billions of rows at sub-second latency in 3 steps:
1. Identify a Star/Snowflake Schema on Hadoop.
2. Build Cube from the identified tables.
3. Query using ANSI-SQL and get results in sub-second, via ODBC, JDBC
or RESTful API.

Thanks to everyone who has contributed to this release.

We welcome your help and feedback. For more information on how to
report problems, and to get involved, visit the project website at
https://kylin.apache.org/


-

Best regards,

Ni Chunen / George

[RESULT][VOTE] Release apache-kylin-4.0.0-alpha (RC1)

[George Ni]

Thanks to everyone who has tested the release candidate and given
their comments and votes.

The tally is as follows.

3 binding +1s:
Chunen Ni
Shaofeng Shi
Yang Li

8 non-binding +1s:
Zhichao Zhang
Xiaoxiang Yu
Rupeng Wang
Yaqian Zhang
Chao Long
Yaqian Zhang
Vino Yang
Guangxu Cheng

No 0s or -1s.

Therefore I am delighted to announce that the proposal to release
Apache-Kylin-4.0.0-alpha has passed.

-

Best regards,
Ni Chunen / George

[VOTE] Release apache-kylin-4.0.0-alpha (RC1)

[George Ni]

Hi all,

I have created a build for Apache Kylin 4.0.0-alpha, release candidate
1. Please note, this release is built on kylin-on-parquet-v2 branch.


Changes highlights:
[KYLIN-4213] - The new build engine with Spark-SQL
[KYLIN-4450] - Add the feature that adjusting spark driver memory adaptively
[KYLIN-4458] - FilePruner prune shards
[KYLIN-4475] - Support intersect count for Kylin on Parquet
[KYLIN-4462] - Support Count Distinct,TopN and Percentile by kylin on Parquet
[KYLIN-4713] - Support use diff spark schedule pool for diff query
[KYLIN-4468] - Support Percentile by kylin on Parquet
[KYLIN-4662] - Migrate from third-party Spark to offical Apache Spark
[KYLIN-4701] - Upgrade front-end from HBase Storage to Parquet Storage
[KYLIN-4644] - New tool to clean up  intermediate files for Kylin 4.0
[KYLIN-4744] - Add tracking URL for build spark job on yarn

Thanks to everyone who has contributed to this release.

Here are the release
notes:https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12348093


The commit to being voted
upon:https://github.com/apache/kylin/commit/a285f9a5b84affc36c5466ce5a1b2fcdb4348b37

Its hash is a285f9a5b84affc36c5466ce5a1b2fcdb4348b37.

The artifacts to be voted on, including the source package and two
pre-compiled binary packages are located
here:https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-4.0.0-alpha-rc1/

The hash of the artifacts are as follows:
apache-kylin-4.0.0-alpha-source-release.zip.sha256
f98da070a9839251c8cf3806c274c1191bb11d0b251288b4d2586e034f6ac291
apache-kylin-4.0.0-alpha-bin-hadoop2.tar.gz.sha256
8075af2608b62177f04bc5a528194c555959775ed69ae80e5ccaf9a37ec1bf74
apache-kylin-4.0.0-alpha-bin-cdh57.tar.gz.sha256
f98da070a9839251c8cf3806c274c1191bb11d0b251288b4d2586e034f6ac291


A staged Maven repository is available for review
at:https://repository.apache.org/content/repositories/orgapachekylin-1081/

Release artifacts are signed with the following
key:https://people.apache.org/keys/committer/nic.asc


Please vote on releasing this package as Apache Kylin 4.0.0-alpha.


The vote is open for the next 72 hours and passes if a majority of at
least three +1 binding votes are cast.


[ ] +1 Release this package as Apache Kylin 4.0.0-alpha
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)

-

Best regards,
Ni Chunen / George

Re: new committer: Vino Yang (杨华)

[George Ni]

Congratulations, Vino.

ShaoFeng Shi  于2020年8月7日周五 上午10:36写道：

> The Project Management Committee (PMC) for Apache Kylin has invited Vino
> Yang (杨华, vinoy...@apache.org) to become a committer and we are pleased to
> announce that he has accepted.
>
> Being a committer enables easier contribution to the project since there is
> no need to go via the patch submission process. This should enable better
> productivity.
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>


-- 

-

Best regards,



Ni Chunen / George

[Announce] Apache Kylin 3.1.0 released

[George Ni]

The Apache Kylin team is pleased to announce the immediate availability of
the 3.1.0 release.

This is a major release after 3.0.0, with 10 new features and 142 bug fixes
and enhancement. All of the changes in this release can be found in:
https://kylin.apache.org/docs/release_notes.html

You can download the source release and binary packages from Apache Kylin's
download page: https://kylin.apache.org/download/

Apache Kylin is an open-source Distributed Analytical Data Warehouse for
Big Data; it was designed to provide OLAP (Online Analytical Processing)
capability in the big data era. By renovating the multi-dimensional cube
and precalculation technology on Hadoop and Spark, Kylin is able to achieve
near-constant query speed regardless of the ever-growing data volume.
Reducing query latency from minutes to sub-second, Kylin brings online
analytics back to big data.

Apache Kylin lets you query billions of rows at sub-second latency in 3
steps:
1. Identify a Star/Snowflake Schema on Hadoop.
2. Build Cube from the identified tables.
3. Query using ANSI-SQL and get results in sub-second, via ODBC, JDBC or
RESTful API.

Thanks to everyone who has contributed to this release.

We welcome your help and feedback. For more information on how to report
problems, and to get involved, visit the project website at
https://kylin.apache.org/

-- 

-

Best regards,



Ni Chunen / George

[RESULT][VOTE] Release apache-kylin-3.1.0 (RC1)

[George Ni]

Thanks to everyone who has tested the release candidate and given their
comments and votes.

The tally is as follows.

5 binding +1s:
Chunen Ni
Shaofeng Shi
Yanghong Zhong
Dong Li
Gang Ma

8 non-binding +1s:
Chao Long
Qiang Zhang
Xiaoxiang Yu
Yaqian Zhang
Rupeng Wang
Guangxu
Zhichao Zhang
Chuxiao


No 0s or -1s.

Therefore I am delighted to announce that the proposal to release
Apache-Kylin-3.1.0 has passed.

-- 

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-3.1.0 (RC1)

[George Ni]

Hi all,

I have created a build for Apache Kylin 3.1.0, release candidate 1.

Changes highlights:
[KYLIN-4342] - Build Global Dict by MR/Hive New Version
[KYLIN-3758] - Flink Cube Build Engine
[KYLIN-3832] - Kylin pushdown to support PostgreSQL
[KYLIN-4445] - Provide a Kylin on Kubernetes solution
[KYLIN-4485] - Create a self-service interface for cube migration
[KYLIN-4425] - Refactor Diagnosis Tool

Thanks to everyone who has contributed to this release.
Here are the release notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12346593


The commit to being voted upon:
https://github.com/apache/kylin/commit/2e056748bf61ef89d421735bb7be41f4266d7b94

Its hash is 2e056748bf61ef89d421735bb7be41f4266d7b94.

The artifacts to be voted on, including the source package and four
pre-compiled binary packages are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-3.1.0-rc1/

The hash of the artifacts are as follows:
apache-kylin-3.1.0-source-release.zip.sha256
1efa8a60003ea8adaa39de7c020be2bd70ed045de736995153707c1ca08353e1
apache-kylin-3.1.0-bin-hbase1x.tar.gz.sha256
78921a27acba781adc41729aa65316833d2aec5d32047d6ffc195bfaf156cd5d
apache-kylin-3.1.0-bin-cdh57.tar.gz.sha256
bdc5a790880f1b6e1d894454e3512c54515f3b52d55f4d118363514c5007ba89
apache-kylin-3.1.0-bin-hadoop3.tar.gz.sha256
0dd5beafd97b258a1af2ea597b9b610a01a5c63d65b150d7c5a9ada9f0ab6697
apache-kylin-3.1.0-bin-cdh60.tar.gz.sha256
8e662950f331cdf9af877225d2b8d63b2797b0bb4453e21b80e9528e908414f2


A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1080/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/nic.asc


Please vote on releasing this package as Apache Kylin 3.1.0.

The vote is open for the next 72 hours and passes if a majority of at least
three +1 PMC votes are cast.

[ ] +1 Release this package as Apache Kylin 3.1.0
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)

--

-

Best regards,



Ni Chunen / George

[CVE-2020-1956] Apache Kylin command injection vulnerability

[George Ni]

Severity: Important

Vendor:
The Apache Software Foundation

Versions Affected:
Kylin 2.3.0 to 2.3.2
Kylin 2.4.0 to 2.4.1
Kylin 2.5.0 to 2.5.2
Kylin 2.6.0 to 2.6.5
Kylin 3.0.0-alpha, Kylin 3.0.0-alpha2, Kylin 3.0.0-beta, Kylin 3.0.0, Kylin
3.0.1

Description:
Kylin has some restful apis which will concatenate os command with the user
input string, a user is likely to be able to execute any os command without
any protection or validation.

Mitigation:
Users should upgrade to 3.0.2 or 2.6.6 or set
kylin.tool.auto-migrate-cube.enabled to false to disable command execution.

Credit:
This issue was discovered by Johannes Dahse.

References:
https://kylin.apache.org/docs/security.html

-- 

-

Best regards,



Ni Chunen / George

[Announce] Apache Kylin 3.0.2 released

[George Ni]

The Apache Kylin team is pleased to announce the immediate availability of
the 3.0.2 release.

This is a bugfix release after 3.0.1, with 25 bug fixes and enhancements.
All of the changes in this release can be found in:
https://kylin.apache.org/docs/release_notes.html

You can download the source release and binary packages from Apache Kylin's
download page: https://kylin.apache.org/download/

Apache Kylin is an open-source Distributed Analytical Data Warehouse for
Big Data; it was designed to provide OLAP (Online Analytical Processing)
capability in the big data era. By renovating the multi-dimensional cube
and precalculation technology on Hadoop and Spark, Kylin is able to achieve
near-constant query speed regardless of the ever-growing data volume.
Reducing query latency from minutes to sub-second, Kylin brings online
analytics back to big data.

Apache Kylin lets you query billions of rows at sub-second latency in 3
steps:
1. Identify a Star/Snowflake Schema on Hadoop.
2. Build Cube from the identified tables.
3. Query using ANSI-SQL and get results in sub-second, via ODBC, JDBC or
RESTful API.

Thanks to everyone who has contributed to this release.

We welcome your help and feedback. For more information on how to report
problems, and to get involved, visit the project website at
https://kylin.apache.org/

-- 

-

Best regards,



Ni Chunen / George

[Announce] Apache Kylin 2.6.6 released

[George Ni]

The Apache Kylin team is pleased to announce the immediate availability of
the 2.6.6 release.

This is a bugfix release after 2.6.5, with 20 bug fixes and enhancements.
All of the changes in this release can be found in:
https://kylin.apache.org/docs/release_notes.html

You can download the source release and binary packages from Apache Kylin's
download page: https://kylin.apache.org/download/

Apache Kylin is an open-source Distributed Analytics Engine designed to
provide SQL interface and multi-dimensional analysis (OLAP) on Apache
Hadoop, supporting extremely large datasets.

Apache Kylin lets you query massive dataset at sub-second latency in 3
steps:
1. Identify a star schema or snowflake schema data set on Hadoop.
2. Build Cube on Hadoop.
3. Query data with ANSI-SQL and get results in sub-second, via ODBC, JDBC
or RESTful API.

Thanks to everyone who has contributed to this release.

We welcome your help and feedback. For more information on how to report
problems, and to get involved, visit the project website at
https://kylin.apache.org/

-- 

-

Best regards,



Ni Chunen / George

[RESULT][VOTE] Release apache-kylin-3.0.2 (RC2)

[George Ni]

Thanks to everyone who has tested the release candidate and given their
comments and votes.

The tally is as follows.

4 binding +1s:
Chunen Ni

Shaofeng Shi

Yanghong Zhong

Dong Li

4 non-binding +1s:
Xiaoxiang Yu

Chao Long

Yaqian Zhang

Kaige Liu

No 0s or -1s.

Therefore I am delighted to announce that the proposal to release
Apache-Kylin-3.0.2 has passed.

-- 

-

Best regards,



Ni Chunen / George

[RESULT][VOTE] Release apache-kylin-2.6.6 (RC2)

[George Ni]

Thanks to everyone who has tested the release candidate and given their
comments and votes.

The tally is as follows.

4 binding +1s:
Chunen Ni

Shaofeng Shi

Yanghong Zhong

Dong Li

3 non-binding +1s:
Xiaoxiang Yu

Chao Long

Kaige Liu

No 0s or -1s.

Therefore I am delighted to announce that the proposal to release
Apache-Kylin-2.6.6 has passed.

-- 

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-3.0.2 (RC2)

[George Ni]

Hi all,



I have created a build for Apache Kylin 3.0.2, release candidate 2.



Changes highlights:

[KYLIN-4390] - Update tomcat to 7.0.100

[KYLIN-4426] - Refine CliCommandExecutor

[KYLIN-4206] - Support Glue as Hive Metatdata



Thanks to everyone who has contributed to this release.

Here are the release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346975==12316121



The commit to being voted upon:

https://github.com/apache/kylin/commit/57090efe4bdc079ccfde4f9c8729d69ba3a90624


Its hash is 57090efe4bdc079ccfde4f9c8729d69ba3a90624.



The artifacts to be voted on, including the source package and four

pre-compiled binary packages are located here:

https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-3.0.2-rc2/



The hash of the artifacts are as follows:

apache-kylin-3.0.2-source-release.zip.sha256
1add5892bd1d5994e0e467846e9a844758420f14819ceef63370c07a6aa0b8af

apache-kylin-3.0.2-bin-hbase1x.tar.gz.sha256
086397d9ecbccf80517977a4b65b660b8e1496ad097d890226bd78a34a9fe190

apache-kylin-3.0.2-bin-cdh57.tar.gz.sha256
181929fcd35a63a81b6dc097137a3dd1e129fd1f81400e09f64019dcb7ac8a21

apache-kylin-3.0.2-bin-hadoop3.tar.gz.sha256
c2250734fed971f32d242036a55ba955bcf8de91e0e73704e07cfb09124d9899

apache-kylin-3.0.2-bin-cdh60.tar.gz.sha256
83a68d2aec32e634475c490434981ebc91e8680dbb6388edc4ed919687ad1dac



A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1078/



Release artifacts are signed with the following key:

https://people.apache.org/keys/committer/nic.asc



Please vote on releasing this package as Apache Kylin 3.0.2.



The vote is open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.



[ ] +1 Release this package as Apache Kylin 3.0.2

[ ]  0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...





Here is my vote:



+1 (binding)

--

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-2.6.6 (RC2)

[George Ni]

Hi all,



I have created a build for Apache Kylin 2.6.6, release candidate 2.



Changes highlights:

[KYLIN-4390] - Update tomcat to 7.0.100

[KYLIN-4426] - Refine CliCommandExecutor

[KYLIN-4206] - Support Glue as Hive Metatdata



Thanks to everyone who has contributed to this release.

Here are the release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346976==12316121



The commit to being voted upon:

https://github.com/apache/kylin/commit/ddd5f8ecd4157b8f889b047e421dd9cfae7e1142


Its hash is ddd5f8ecd4157b8f889b047e421dd9cfae7e1142.



The artifacts to be voted on, including the source package and four

pre-compiled binary packages are located here:

https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.6-rc2/



The hash of the artifacts are as follows:

apache-kylin-2.6.6-source-release.zip.sha256
6d38671f494e3d5f2bb26dfb94d996a5ceb0c00c2a17b9c181ad853639198d3a

apache-kylin-2.6.6-bin-hbase1x.tar.gz.sha256
6a42962efbce5a51e2ce4bf8db0b8fa7341ef0b30e4f02e876a5c2fb0500944b

apache-kylin-2.6.6-bin-cdh57.tar.gz.sha256
85cb22e7d6d9adad214854f9ab285b7d47e874eb9f9df1c5bd01882877171762

apache-kylin-2.6.6-bin-hadoop3.tar.gz.sha256
f060f8e16f909ae74d9e3c188bb071fcfa87e0a21fd7581fc968e1bcf00e5121

apache-kylin-2.6.6-bin-cdh60.tar.gz.sha256
8d85a3036d312b47030e3b309af526afe4484720be156f7e3f05e626c02bf531



A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1077/



Release artifacts are signed with the following key:

https://people.apache.org/keys/committer/nic.asc



Please vote on releasing this package as Apache Kylin 2.6.6.



The vote is open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.



[ ] +1 Release this package as Apache Kylin 2.6.6

[ ]  0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...





Here is my vote:



+1 (binding)

--

-

Best regards,



Ni Chunen / George

[CANCELLED][VOTE] Release apache-kylin-2.6.6 (RC1)

[George Ni]

Hi all,

As titled, the vote of apache-kylin-2.6.6 RC1 has been canceled for issue
KYLIN-4383 is not fixed.

Thanks for your attention.

-- 

-

Best regards,



Ni Chunen / George

[CANCELLED][VOTE] Release apache-kylin-3.0.2 (RC1)

[George Ni]

Hi all,

As titled, the vote of apache-kylin-3.0.2 RC1 has been canceled for issue
KYLIN-4383 is not fixed.

Thanks for your attention.

-- 

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-2.6.6 (RC1)

[George Ni]

Hi all,



I have created a build for Apache Kylin 2.6.6, release candidate 1.



Changes highlights:

[KYLIN-4390] - Update tomcat to 7.0.100

[KYLIN-4426] - Refine CliCommandExecutor

[KYLIN-4206] - Support Glue as Hive Metatdata



Thanks to everyone who has contributed to this release.

Here are the release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346976==12316121



The commit to being voted upon:
https://github.com/apache/kylin/commit/b2f6fea3368f6b75892cf38294c2d18696758fa7


Its hash is b2f6fea3368f6b75892cf38294c2d18696758fa7.



The artifacts to be voted on, including the source package and four

pre-compiled binary packages are located here:

https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.6-rc1/



The hash of the artifacts are as follows:

apache-kylin-2.6.6-source-release.zip.sha256
1a796080df7bc3e7ed75a2f07a8795de11275686cca8b851f53a3df21f0cb824

apache-kylin-2.6.6-bin-hbase1x.tar.gz.sha256
39dee0f749cb8d83505ec8d24bbfc1c98681c2cfcc6ca7aec2ec058e20a68e21

apache-kylin-2.6.6-bin-cdh57.tar.gz.sha256
48169ddbe9ebba1977a490333e6a767c9eb5e172134d1c53cf581cff7064cc98

apache-kylin-2.6.6-bin-hadoop3.tar.gz.sha256
589dd14afaf5751ee1277d2920748a7000e44ecfef12d21574c3adf83825149b

apache-kylin-2.6.6-bin-cdh60.tar.gz.sha256
1768b8dc916f35d437c5c6080fa3c9ce4debeb2d3a7a442eace9bbf7a8840c26



A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1076/



Release artifacts are signed with the following key:

https://people.apache.org/keys/committer/nic.asc



Please vote on releasing this package as Apache Kylin 2.6.6.



The vote is open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.



[ ] +1 Release this package as Apache Kylin 2.6.6

[ ]  0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...





Here is my vote:



+1 (binding)

--

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-3.0.2 (RC1)

[George Ni]

Hi all,



I have created a build for Apache Kylin 3.0.2, release candidate 1.



Changes highlights:

[KYLIN-4390] - Update tomcat to 7.0.100

[KYLIN-4426] - Refine CliCommandExecutor

[KYLIN-4206] - Support Glue as Hive Metatdata



Thanks to everyone who has contributed to this release.

Here are the release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346975==12316121



The commit to being voted upon:

https://github.com/apache/kylin/commit/d0d3e124372991331d96f881b2361b865bf4f2d9



Its hash is d0d3e124372991331d96f881b2361b865bf4f2d9.



The artifacts to be voted on, including the source package and four

pre-compiled binary packages are located here:

https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-3.0.2-rc1/



The hash of the artifacts are as follows:

apache-kylin-3.0.2-source-release.zip.sha256
7f68ba3d9ffd73cb405cc1bea6b14f988274e851e1be0e93c75682120308c994

apache-kylin-3.0.2-bin-hbase1x.tar.gz.sha256
3119db9f3fdcf530a031d31f605148da092dc41be8c69194b609766091915ea0

apache-kylin-3.0.2-bin-cdh57.tar.gz.sha256
7a4f2f1aeb66d68012b42e03f0b92ad7a8abd3d5b6afcfbc9a3c27c9c3e7a219

apache-kylin-3.0.2-bin-hadoop3.tar.gz.sha256
7678390303e03c98fcf2d1233d21d95ac04d3e36424ba7f2b23155103d089c7b

apache-kylin-3.0.2-bin-cdh60.tar.gz.sha256
db5998d22679b19cf038b707faf6ad70178742b788eec2dcb215ccfb443c3433



A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1076/



Release artifacts are signed with the following key:

https://people.apache.org/keys/committer/nic.asc



Please vote on releasing this package as Apache Kylin 3.0.2.



The vote is open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.



[ ] +1 Release this package as Apache Kylin 3.0.2

[ ]  0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...





Here is my vote:



+1 (binding)

--

-

Best regards,



Ni Chunen / George

[Online Event] Introduction and Quick Start of Kylin on Parquet, April 18, 2020

[George Ni]

Kylin users & developers,



There will be an online Kylin event this Saturday (April 18). Kylin on
HBase has been mature for a long time, but there are still some
limitations. Engineers from Kyligence will share their new storage
solution, Kylin On Parquet.



Date: April 18

Time: 8:00 PM - 9:00 PM  (UTC+08:00)

Language: Chinese (PPT will be in English)

Activity form: live video streaming

Fee: Free!

Link for Registration:
https://mp.weixin.qq.com/s?__biz=MzAwODE3ODU5MA===2653079753=1=27986486a96aaa90af12b9469a63c2d6=80a4b638b7d33f2e40ea676f2aeda188712a06bb4ef7d3b9ec07a5f706c7429d307afedbd160=2112674860=zh_CN#rd



 -

Best regards,



Ni Chunen / George

[Online Meetup]Apache Kylin × Apache Hudi Meetup, Mar. 14, 2020

[George Ni]

Kylin users & developers,



There will be an online Kylin Meetup this week (Mar. 14). Engineers from
DXY.cn(丁香园), Tencent(腾讯), ClinBrain (柯林布瑞), and Kyligence will share their
use cases and experiences with Apache Kylin & Apache Hudi.



Date: Mar. 14

Time: 7:00 PM - 9:00 PM  (UTC+08:00)

Language: Chinese

Activity form: live video streaming

Fee: Free!

Link for Registration: https://mp.weixin.qq.com/s/KOCZNhInrJNDLXp5nD9V2w



Best regards,



Ni Chunen / George

-- 

-

Best regards,



Ni Chunen / George

[CVE-2020-1937] Apache Kylin SQL injection vulnerability

[George Ni]

Severity: Important

Vendor:
The Apache Software Foundation

Versions Affected:
Kylin 2.3.0 to 2.3.2
Kylin 2.4.0 to 2.4.1
Kylin 2.5.0 to 2.5.2
Kylin 2.6.0 to 2.6.4
Kylin 3.0.0-alpha, Kylin 3.0.0-alpha2, Kylin 3.0.0-beta, Kylin 3.0.0

Description:
Kylin has some restful apis which will concatenate SQLs with the user input
string, a user is likely to be able to run malicious database queries.

Mitigation:
Users should upgrade to 3.0.1 or 2.6.5

Credit:
This issue was discovered by Jonathan Leitschuh

References:
https://kylin.apache.org/docs/security.html


-

Best regards,



Ni Chunen / George

Apache Tomcat Security Vulnerability Notice

[George Ni]

Hi Kylin users,

On February 20, China National Vulnerability Database (CNVD) published a
severe vulnerability in Apache Tomcat’s Apache JServ Protocol (or AJP). For
Apache Kylin uses Tomcat as the web container and tomcat 7.0.91 is packaged
in Kylin's release package, Kylin also has this security issue.

I strongly recommend you take one of the two solutions below for your Kylin
servers to avoid this security issue:

   1. Download and install Tomcat 7.0.100 in Kylin
   2. Simply comment it out from the $KYLIN_HOME/tomcat/conf/server.xml
   file, find comment the following configuration (the specific port may be
   different according to the initial configuration, the protocol is confirmed
   as protocol="AJP/1.3")



Then restart your Kylin instances.

We'll upgrade the packed Tomcat in Kylin's next releases.

-

Best regards,



Ni Chunen / George

[Announce] Apache Kylin 2.6.5 released

[George Ni]

The Apache Kylin team is pleased to announce the immediate availability of
the 2.6.5 release.

This is a bugfix release after 2.6.4, with 32 bug fixes and enhancements. All
of the changes in this release can be found in:
https://kylin.apache.org/docs/release_notes.html

You can download the source release and binary packages from Apache Kylin's
download page: https://kylin.apache.org/download/

Apache Kylin is an open-source Distributed Analytics Engine designed to
provide SQL interface and multi-dimensional analysis (OLAP) on Apache
Hadoop, supporting extremely large datasets.

Apache Kylin lets you query massive dataset at sub-second latency in 3
steps:
1. Identify a star schema or snowflake schema data set on Hadoop.
2. Build Cube on Hadoop.
3. Query data with ANSI-SQL and get results in sub-second, via ODBC, JDBC
or RESTful API.

Thanks to everyone who has contributed to this release.

We welcome your help and feedback. For more information on how to report
problems, and to get involved, visit the project website at
https://kylin.apache.org/

-

Best regards,



Ni Chunen / George

[Announce] Apache Kylin 3.0.1 released

[George Ni]

The Apache Kylin team is pleased to announce the immediate availability of
the 3.0.1 release.

This is a bugfix release after 3.0.0, with 24 bug fixes and enhancements. All
of the changes in this release can be found in:
https://kylin.apache.org/docs/release_notes.html

You can download the source release and binary packages from Apache Kylin's
download page: https://kylin.apache.org/download/

Apache Kylin is an open-source Distributed Analytics Engine designed to
provide SQL interface and multi-dimensional analysis (OLAP) on Apache
Hadoop, supporting extremely large datasets.

Apache Kylin lets you query massive dataset at sub-second latency in 3
steps:
1. Identify a star schema or snowflake schema data set on Hadoop.
2. Build Cube on Hadoop.
3. Query data with ANSI-SQL and get results in sub-second, via ODBC, JDBC
or RESTful API.

Thanks to everyone who has contributed to this release.

We welcome your help and feedback. For more information on how to report
problems, and to get involved, visit the project website at
https://kylin.apache.org/


-

Best regards,



Ni Chunen / George

[RESULT][VOTE] Release apache-kylin-2.6.5 (RC2)

[George Ni]

Thanks to everyone who has tested the release candidate and given their
comments and votes.

The tally is as follows.

4 binding +1s:
Shaofeng Shi

Chunen Ni

Luke Han

Dong Li

5 non-binding +1s:
Xiaoyuan Gu

Yaqian Zhang

Xiaoxiang Yu

Weibin Zhu

Wang Rupeng

No 0s or -1s.

Therefore I am delighted to announce that the proposal to release
Apache-Kylin-2.6.5 has passed.

-- 

-

Best regards,



Ni Chunen / George

[RESULT][VOTE] Release apache-kylin-3.0.1 (RC2)

[George Ni]

Thanks to everyone who has tested the release candidate and given their
comments and votes.

The tally is as follows.

4 binding +1s:
Shaofeng Shi

Chunen Ni

Luke Han

Dong Li

3 non-binding +1s:
Xiaoyuan Gu

Yaqian Zhang

Wang Rupeng

Xiaoyuan Gu

No 0s or -1s.

Therefore I am delighted to announce that the proposal to release
Apache-Kylin-3.0.1 has passed.

-- 

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-2.6.5 (RC2)

[George Ni]

Hi all,



I have created a build for Apache Kylin 2.6.5, release candidate 2.



Changes highlights:

[KYLIN-4374] - Fix security issues reported by code analysis platform LGTM

[KYLIN-4291] - Parallel segment building may causes WriteConflictException

[KYLIN-4263] - Inappropriate exception handling causes job stuck on running
status

[KYLIN-4169] - Too many logs during DataModelManager’s initiation, cause
the first RESTful API to hang for a long time



Thanks to everyone who has contributed to this release.

Here are the release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346281==12316121



The commit to being voted upon:

https://github.com/apache/kylin/commit/73d42edec5f6492b3d3ffc222c26dce4bdfe7263


Its hash is 73d42edec5f6492b3d3ffc222c26dce4bdfe7263.



The artifacts to be voted on, including the source package and four

pre-compiled binary packages are located here:

https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.5-rc2/



The hash of the artifacts are as follows:

apache-kylin-2.6.5-source-release.zip.sha256

32fb722a58ed49318dc5f72da429506238ee2089170236c742f22240d93080a3

apache-kylin-2.6.5-bin-hbase1x.tar.gz.sha256

f8e04fafa7e63cdeb28aa4e8c35bc2f54456888bef37d4cca060c424be722e1e

apache-kylin-2.6.5-bin-cdh57.tar.gz.sha256

71deb9bc84e5b75320e2c8ca358449f808ef2decbee11679e7f4339abeeb3d3f

apache-kylin-2.6.5-bin-hadoop3.tar.gz.sha256

e77218204800a7b6be42e90e0fcb03e6e8458d600125e44bc112a8a359291fc4

apache-kylin-2.6.5-bin-cdh60.tar.gz.sha256

2f7003eba8b528198aa7f886be04ecb75e86ece9e2e67dba4c15a89fb8817f7a



A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1075/



Release artifacts are signed with the following key:

https://people.apache.org/keys/committer/nic.asc



Please vote on releasing this package as Apache Kylin 2.6.5



The vote is open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.



[ ] +1 Release this package as Apache Kylin 2.6.5

[ ]  0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...



Here is my vote:



+1 (binding)

-- 

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-3.0.1 (RC2)

[George Ni]

Hi all,



I have created a build for Apache Kylin 3.0.1, release candidate 2.



Changes highlights:

[KYLIN-4374] - Fix security issues reported by code analysis platform LGTM

[KYLIN-4333] - Memory leak on job server

[KYLIN-4297] - Build cube throw NPE error when partition column is not set
in JDBC Data Source



Thanks to everyone who has contributed to this release.

Here are the release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346958==12316121



The commit to being voted upon:

https://github.com/apache/kylin/commit/818c21cc9c2a995a58d85497a8649ebcf11a975c



Its hash is 818c21cc9c2a995a58d85497a8649ebcf11a975c.



The artifacts to be voted on, including the source package and four

pre-compiled binary packages are located here:

https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-3.0.1-rc2/



The hash of the artifacts are as follows:

apache-kylin-3.0.1-source-release.zip.sha256

78cceaba517b7c62f0dfa6c4610144d7913051588d8a99083a89cf74e37a724f

apache-kylin-3.0.1-bin-hbase1x.tar.gz.sha256

9bf9db5e9152755928f08ebe9fa2dc0d2647feb56604ceb06343e95fd362dc50

apache-kylin-3.0.1-bin-cdh57.tar.gz.sha256

f1f60cbc525942c7c044aee212455eaabb092da0e99bede11501920b8258ba42

apache-kylin-3.0.1-bin-hadoop3.tar.gz.sha256

b405c2dd0cd93400c18c46bbb36f601cf58cb5e48cc760f422daa4bcc7899084

apache-kylin-3.0.1-bin-cdh60.tar.gz.sha256

5ef70897392072ee74d0909971a197413a64e677f89952f1b23abf6969c3443d



A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1074/



Release artifacts are signed with the following key:

https://people.apache.org/keys/committer/nic.asc



Please vote on releasing this package as Apache Kylin 3.0.1.



The vote is open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.



[ ] +1 Release this package as Apache Kylin 3.0.1

[ ]  0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...





Here is my vote:



+1 (binding)

-- 

-

Best regards,



Ni Chunen / George

[CANCELLED][VOTE] Release apache-kylin-3.0.1 (RC1)

[George Ni]

Hi all,

As titled, the vote of apache-kylin-3.0.1 RC1 has been canceled for some
un-expected files included in the source zip package.

Thanks for your attention.

-- 

-

Best regards,



Ni Chunen / George

[CANCELED][VOTE] Release apache-kylin-2.6.5 (RC1)

[George Ni]

Hello all,

As titled, the vote of apache-kylin-2.6.5 RC1 has been canceled for some
un-expected files included in the source zip package.

Thanks for your attention.

-- 

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-2.6.5 (RC1)

[George Ni]

Hi all,

I have created a build for Apache Kylin 2.6.5, release candidate 1.

Changes highlights:
[KYLIN-4374] - Fix security issues reported by code analysis platform LGTM
[KYLIN-4291] - Parallel segment building may causes WriteConflictException
[KYLIN-4263] - Inappropriate exception handling causes job stuck on running
status
[KYLIN-4169] - Too many logs during DataModelManager’s initiation, cause
the first RESTful API to hang for a long time

Thanks to everyone who has contributed to this release.
Here are the release notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346281==12316121

The commit to being voted upon:
https://github.com/apache/kylin/commit/3c18c4334418b91581195708c8f8f23fa6166c26

Its hash is 3c18c4334418b91581195708c8f8f23fa6166c26.

The artifacts to be voted on, including the source package and two
pre-compiled binary packages are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.5-rc1/


The hash of the artifacts are as follows:
apache-kylin-2.6.5-source-release.zip.sha256
0707abfa092613a437b23f1973947bc04db8f24a824b31ab986b66da3e923322
apache-kylin-2.6.5-bin-hbase1x.tar.gz.sha256
f8e04fafa7e63cdeb28aa4e8c35bc2f54456888bef37d4cca060c424be722e1e
apache-kylin-2.6.5-bin-cdh57.tar.gz.sha256
71deb9bc84e5b75320e2c8ca358449f808ef2decbee11679e7f4339abeeb3d3f
apache-kylin-2.6.5-bin-hadoop3.tar.gz.sha256
e77218204800a7b6be42e90e0fcb03e6e8458d600125e44bc112a8a359291fc4
apache-kylin-2.6.5-bin-cdh60.tar.gz.sha256
2f7003eba8b528198aa7f886be04ecb75e86ece9e2e67dba4c15a89fb8817f7a

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1071/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/nic.asc

Please vote on releasing this package as Apache Kylin 2.6.5

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PMC votes are cast.

[ ] +1 Release this package as Apache Kylin 2.6.5
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)

-- 

-

Best regards,



Ni Chunen / George

[VOTE] Release apache-kylin-3.0.1 (RC1)

[George Ni]

Hi all,

I have created a build for Apache Kylin 3.0.1, release candidate 1.

Changes highlights:
[KYLIN-4374] - Fix security issues reported by code analysis platform LGTM
[KYLIN-4333] - Memory leak on job server
[KYLIN-4297] - Build cube throw NPE error when partition column is not set
in JDBC Data Source

Thanks to everyone who has contributed to this release.
Here are the release notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346958==12316121

The commit to being voted upon:
https://github.com/apache/kylin/commit/638a1eb68f257366d240105b33e5eea3bfa4dbf3


Its hash is 638a1eb68f257366d240105b33e5eea3bfa4dbf3.

The artifacts to be voted on, including the source package and two
pre-compiled binary packages are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-3.0.1-rc1/

The hash of the artifacts are as follows:
apache-kylin-3.0.1-source-release.zip.sha256
2fa38524b620737c5ebe5148924f6d25876244c11be49841bcff652555bb3c97
apache-kylin-3.0.1-bin-hbase1x.tar.gz.sha256
9bf9db5e9152755928f08ebe9fa2dc0d2647feb56604ceb06343e95fd362dc50
apache-kylin-3.0.1-bin-cdh57.tar.gz.sha256
f1f60cbc525942c7c044aee212455eaabb092da0e99bede11501920b8258ba42
apache-kylin-3.0.1-bin-hadoop3.tar.gz.sha256
b405c2dd0cd93400c18c46bbb36f601cf58cb5e48cc760f422daa4bcc7899084
apache-kylin-3.0.1-bin-cdh60.tar.gz.sha256
5ef70897392072ee74d0909971a197413a64e677f89952f1b23abf6969c3443d

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1071/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/nic.asc

Please vote on releasing this package as Apache Kylin 3.0.1.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PMC votes are cast.

[ ] +1 Release this package as Apache Kylin 3.0.1
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)

-- 

-

Best regards,



Ni Chunen / George

Kylin Building Engine With SparkSql & Parquet

[George Ni]

Hi Kylin users & developers,

By-layer Spark Cubing has been introduced into Apache Kylin since v2.0 to
achieve better performance and it does run much faster compared to MR
engine. Also Hbase has been Kylin’s trustful storage engine since Kylin was
born and it has been proved to be a success for providing the ability to
handle high concurrency queries in extremely large data scale with low
latency. But there are also limitations for HBase, such as filtering is not
flexible as we could only filter by RowKey, measures are usually combined
together which causes more data to be scanned than requested.



So in order to optimize Kylin in both building strategy and storage engine,
development team of Kyligence is introducing a new cube building engine
which uses Spark Sql to construct cuboids with a new strategy and stores
cube results in Parquet files. The building strategy allows Kylin to build
cuboids in a smarter way by choosing and building on the optimal cuboid
source. And Parquet, a columnar storage format available to any project in
the Hadoop ecosystem, will power the filtering ability with the page-level
column index and reduce I/O by saving measures in different columns. Also
with Storing cuboid in Parquet instead of Hbase, we can utilize Kylin in
Cloud Native way. More information on design and technique details will
come soon.



Below is the comparison in building duration and size of results between
By-layer Spark Cubing and the new cubing strategy.



Environment

4-nodes Hadoop cluster

YRAN has 400GB RAM and 128 cores in total;

CDH 5.1, Apache Kylin 3.0.



Spark

Spark 2.4.1-kylin-r17



Test Data

SSB data

Cube: 15 dimensions, 3 measures (SUM)



Test Scenarios

Build the cube at different source size level: 30 million, 60 million
source rows; Compare the build time with Spark (by layer) + Hbase and
SparkSql + Parquet.


Besides, we attempt to resolve many drawbacks in current query engine,
which relies heavily on Apache Calcite, such as the performance bottleneck
in aggregating large query results which currently can only be operated by
a single worker. By embracing SparkSql, this kind of expensive computing
can be done distributedly. Also combined with Parquet format, plenty of
filtering optimizations could be applied,which will boost Kylin’s query
performance significantly. The features will be open source along with
technique details in the near future.



   - https://issues.apache.org/jira/browse/KYLIN-4188


-- 

-

Best regards,



Ni Chunen / George

Re: [Discuss] Reposition Kylin as "Analytical Data warehouse for big data"

[George Ni]

+1
Actually, Kylin plays a much more important role than just an OLAP engine
in many Kylin users’ production environments.

ShaoFeng Shi  于2020年1月12日周日 下午8:32写道：

> Hello, Kylin developers and users, HAPPY NEW YEAR 2020!
>
> In last month, we released Kylin 3.0, with the new Real-time streaming
> feature and a Lambda architecture. This allows our users to host only one
> system for both batch and real-time analytics, and then can query batch and
> streaming data together.
>
> If you look at Kylin's home page, its slogan is still the "OLAP Engine for
> Big data", which was made 5 years ago when it was born. While today,
> Kylin's capability has been verified beyond an "OLAP engine". I visited
> many Kylin users in China, US, Euro in last year, and have got many
> different scenarios:
>
> 1. eBay initiated the Kylin project to offload analytical workloads from
> Teradata to Hadoop; Kylin serves the online queries with high performance
> and high availability. Till today, Kylin serves millions of queries every
> day, most are in < 1 seconds;
> 2. China Unionpay and CPIC use Kylin to replace IBM Cognos cubes. One
> Kylin cube replaced more than 100 Cognos cubes, with better building
> performance and query performance.
> 3. China Construction Bank uses Hadoop + Kylin to offload the Greenplum.
> Some systems have been migrated to Kylin successfully.
> 4. Yum (KFC) and several other users are using Kylin to replace Microsoft
> SSAS.
> 5. Meituan, Ctrip, JD, Didi, Xiao Mi, Huawei, OLX group, autohome.com.cn,
> Xactly, and many others are using Kylin as the platform of their DaaS (Data
> as a Service), providing data service to their thousands of internal
> analysts and tens of thousands of external tenants.
>
> Now let's look at the definition of Data warehouse [1]:
>
> "*A data warehouse is a subject-oriented, integrated, time-variant and
> non-volatile collection of data in support of management's decision-making
> process.*"
>
> In Kylin, each model/cube is created for a certain subject; Kylin
> integrates well with Hive, Hadoop, Spark, Kafka, and other systems; Kylin
> incremental loads the data by time, build the cube and then save as
> segments (partitions), and they are non-volatile unless you refresh them;
> During the analysis (roll-up, drill-down, etc), the data is always
> consistent. Kylin provides SQL interface and JDBC/ODBC/HTTP API for you to
> easily connect from BI/visualization tools like Tableau and others.
>
> All in all, you can see that users are using Kylin not just as a SQL
> engine, but also as an Analytical Data Warehouse, for very large scale data
> (PB scale). In the world of big data, Kylin is unique. Its design is
> elegant, its architecture is scalable and pluggable.  In order to give
> Kylin more visibility and can be discovered by more people, I propose to
> change Kylin's position/slogan from the "OLAP engine for big data" to
> "Analytical Data warehouse for big data".
>
> Please feel free to share your comments.
>
> [1]
> https://www.1keydata.com/datawarehousing/data-warehouse-definition.html
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
>
>
>

-- 

-

Best regards,



Ni Chunen / George

Releasing Apache Kylin v3.0-GA

[George Ni]

Hi Community,

As we have released v3.0-alpha, v3.0-alpha2, v3.0-beta, we have enough
cofidence to
release the GA version for v3.0 next week, and I’m planning to create a
branch for its release.

Detail features, improvements and bug fixes will come later, the main
features are:
1. Realtime OLAP
2. Job scheduler with Apache Curator
3. User and user group management

Please feel free to leave your comments here.

-

Best regards,



Ni Chunen / George

Re: [VOTE] Release apache-kylin-2.5.2 (RC2)

[George Ni]

+1
mvn test passed
build success
md5 verified


Best regards,
 
Chun’en Ni(George)

- 原始邮件 -
发件人: Rongchuan Jin 
收件人: dev@kylin.apache.org
已发送邮件: Sat, 01 Dec 2018 17:47:35 +0800 (CST)
主题: Re: [VOTE] Release apache-kylin-2.5.2 (RC2)

+1 
mvn test passed

 

在 2018/12/1 下午5:15，“zhan shaoxiong” 写入:

+1 mvn test passed.

On [DATE], "[NAME]" <[ADDRESS]> wrote:

+1

Local CI pass


Best wishes,
Xiaoxiang Yu 
 

On [DATE], "[NAME]" <[ADDRESS]> wrote:

Hi all,

I have created a build for Apache Kylin 2.5.2, release candidate 2.

Changes:
[KYLIN-3187] - JDK APIs using the default locale, time zone or 
character
set should be avoided
[KYLIN-3636] - Wrong "storage_type" in CubeDesc causing cube 
building error
[KYLIN-3666] - Mege cube step 2: Update dictionary throws
IllegalStateException
[KYLIN-3672] - Performance is poor when multiple queries occur in a 
short
period
[KYLIN-3676] - Update to custom calcite and remove the "atopcalcite"
[KYLIN-3678] - CacheStateChecker may remove a cache file that under 
a
building
[KYLIN-3683] - Package org.apache.commons.lang3 not exists
[KYLIN-3689] - When the startTime is equal to the endTime in build 
request,
the segment will build all data.
[KYLIN-3693] - TopN, Count distinct incorrect in Spark engine
[KYLIN-3705] - Segment Pruner mis-functions when the source data has
Chinese characters
Thanks to everyone who has contributed to this release.

Here are release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12344466

The commit to being voted upon:


https://github.com/apache/kylin/commit/0e519d859e217fbfadd534313376e532d2c647fa

Its hash is 0e519d859e217fbfadd534313376e532d2c647fa.

The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.5.2-rc2/

The hashe of the artifact is as follows:
apache-kylin-2.5.2-source-release.zip.sha256
fca5688cf64442ea595e07c2a4a4b2b549836d268ce8f10f3d559f05c22b61d0

A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1058/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/shaofengshi.asc

Please vote on releasing this package as Apache Kylin 2.5.2.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PPMC votes are cast.

[ ] +1 Release this package as Apache Kylin 2.5.2
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Work email: shaofeng@kyligence.io
Kyligence Inc: https://kyligence.io/

Apache Kylin FAQ: 
https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: [Announce] Welcome new Apache Kylin committer: ChunEn Ni （倪春恩）

[George Ni]

Thanks very much.
It is a great honor to me. Let's make Apache Kylin better together.
Best regards,

Chun’en Ni(George)
- 原始邮件 -
发件人: ShaoFeng Shi 
收件人: dev , user , Apache Kylin PMC 

已发送邮件: Tue, 27 Nov 2018 15:59:16 +0800 (CST)
主题: [Announce] Welcome new Apache Kylin committer: ChunEn Ni （倪春恩）
The Project Management Committee (PMC) for Apache Kylin
has invited ChunEn Ni（倪春恩） to become a committer and we are pleased
to announce that he has accepted.


Congratulations and welcome, ChunEn!

Shaofeng Shi
On behalf of the Apache Kylin PMC

Re: 大神，求助kylin的使用问题

[George Ni]

Hi, have you queried with "select count(*) from {fact_table}" both in hive and 
kylin, and please check they have the same result. 

I doubt the segments you have built do not include all your hive data.

Best regards,
 
Chun’en Ni(George)

- 原始邮件 -
发件人: 742093...@qq.com
收件人: dev 
已发送邮件: Thu, 15 Nov 2018 17:43:31 +0800 (CST)
主题: 大神，求助kylin的使用问题

大神们好！

请容我慢慢描述我的问题
在kylin使用中，我建立了一个model，暂且叫他 big_int_sum_model，Dimensions有11个，
Measures 有三个 分别是 求count, SUM, SUM,  sum 是对 两个bigint字段求和，分别为 sum_4g 和sum_wifi 
，用以统计4g总流量和wifi总流量
hive表中的数据有400万，在cube之后，可以从kylin查出数据。
但是出现了一个奇怪的现象：
从 hive表中统计的4g流量总数为 295763957458 ,但是kylin中统计出来的是89605527250，
hive表中统计的WIFI流量总数为 456897813426,但是kylin中统计出来的是164840037298。

各位大神，可以给点思考方向吗？




742093...@qq.com

Re: [VOTE] Release apache-kylin-2.5.1 (RC1)

[George Ni]

+1(no binding)
mvn test passed
build success
md5 verified

Best regards,
 
Chun’en Ni(George)

- 原始邮件 -
发件人: Lijun Cao <641507...@qq.com>
收件人: dev@kylin.apache.org
已发送邮件: Sun, 04 Nov 2018 15:46:15 +0800 (CST)
主题: Re: [VOTE] Release apache-kylin-2.5.1 (RC1)

+1 mvn test passed

> 在 2018年11月3日，21:34，Yichen Zhou  写道：
> 
> I have verified this release.
> 
> +1
> 
> 
> Regards,
> 
> Yichen
> 
> 
> 
> 发件人: Na Zhai 
> 发送时间: 2018年11月2日 15:37:58
> 收件人: dev@kylin.apache.org
> 主题: 答复: [VOTE] Release apache-kylin-2.5.1 (RC1)
> 
> +1
> 
> mvn test passed
> 
> 
> 
> 
> 
> 发送自 Windows 10 版邮件应用
> 
> 
> 
> 
> 发件人: Cheng Wang 
> 发送时间: Friday, November 2, 2018 3:29:12 PM
> 收件人: dev@kylin.apache.org
> 主题: Re: [VOTE] Release apache-kylin-2.5.1 (RC1)
> 
> +1 (binding)
> 
> 
> 
> 
> Best Regards,
> Cheng
> 
> On 11/2/18, 2:09 PM, "ShaoFeng Shi"  wrote:
> 
>> Hi all,
>> 
>> I have created a build for Apache Kylin 2.5.1, release candidate 1.
>> 
>> Changes highlights:
>> 
>> [KYLIN-3531] - Login failed with case-insensitive username
>> [KYLIN-3604] - Can't build cube with spark in HBase standalone mode
>> [KYLIN-3613] - Kylin with Standalone HBase Cluster could not find the main
>> cluster namespace at "Create HTable" step
>> [KYLIN-3634] - When the filter column has null value may cause incorrect
>> query result
>> [KYLIN-3635] - Percentile calculation on Spark engine is wrong
>> [KYLIN-3644] - NumberFormatExcetion on null values when building cube with
>> Spark
>> [KYLIN-3599] - Bulk Add Measures
>> 
>> Thanks to everyone who has contributed to this release.
>> Here’s release notes:
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12344108
>> 
>> The commit to be voted upon:
>> 
>> https://github.com/apache/kylin/commit/24e2452309a450ec4ef62339b003343eabe23016
>> 
>> Its hash is 24e2452309a450ec4ef62339b003343eabe23016.
>> 
>> The artifacts to be voted on are located here:
>> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.5.1-rc1/
>> 
>> The hashe of the artifact is as follows:
>> apache-kylin-2.5.1-source-release.zip.sha256
>> 21db5dab4d3900a49237b9083b5d270c8471d1882a5427cddf1cc74873df42f2
>> 
>> A staged Maven repository is available for review at:
>> https://repository.apache.org/content/repositories/orgapachekylin-1056/
>> 
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/shaofengshi.asc
>> 
>> Please vote on releasing this package as Apache Kylin 2.5.1.
>> 
>> The vote is open for the next 72 hours and passes if a majority of
>> at least three +1 PPMC votes are cast.
>> 
>> [ ] +1 Release this package as Apache Kylin 2.5.1
>> [ ]  0 I don't feel strongly about it, but I'm okay with the release
>> [ ] -1 Do not release this package because...
>> 
>> 
>> Here is my vote:
>> 
>> +1 (binding)
>> 
>> --
>> Best regards,
>> 
>> Shaofeng Shi 史少锋

Re: Partition Column for Kylin

[George Ni]

As I know, partition column on separate columns is not supported yet. 

There is an issue: https://issues.apache.org/jira/browse/KYLIN-3650

I think dipesh is working on it.

Best regards,
 
Chun’en Ni(George)

- 原始邮件 -
发件人: liuzhixin 
收件人: dev@kylin.apache.org
抄送: 335960...@qq.com
已发送邮件: Wed, 31 Oct 2018 20:11:34 +0800 (CST)
主题: Partition Column for Kylin

Hi kylin team:

If my hive table partitions are below:
#
PARTITIONED BY (
  `` string,
  `mm` string,
  `dd` string,
  `re` string,
  `hh` string)
#
How can I set the partition Partition Date Column and Partition Time Column?


Best wishes.

Re: [VOTE] Release apache-kylin-2.1.0 (RC2)

[George Ni (Chunen Ni)]

+1(no binding) 
mvn test passed 
build success 
md5 verified
Best regards,
 
Chun’en Ni(倪春恩)
Mail: chunen...@kyligence.io 
Shanghai Kyligence Information Technology Co., Ltd
上海市浦东新区亮秀路112号Y1座405室
 

在 2017/8/15 下午6:10，“roger shi” 写入:

+1 (non-binding)

mvn test passed
md5 & sha1 verified

Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 
2017-04-04T03:39:06+08:00)
Maven home: /usr/local/Cellar/maven/3.5.0/libexec
Java version: 1.8.0_91, vendor: Oracle Corporation
Java home: 
/Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.12.6", arch: "x86_64", family: "mac"

On 13/08/2017, 2:45 PM, "ShaoFeng Shi"  wrote:

Hi all,

I have created a build for Apache Kylin 2.1.0, release candidate 2.

Changes highlights:
KYLIN-2506 - Refactor global dictionary
KYLIN-2515 - Route unsupported query back to query its source directly
KYLIN-2579 KYLIN-2580  - Improvement on subqueries
KYLIN-2633 - Upgrade Spark to 2.1
KYLIN-2646 - Project level query authorization

And more than 100 bug fixes and enhancements.

Thanks to everyone who has contributed to this release. Here’s release
notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12340443

The commit to be voted upon:


https://github.com/apache/kylin/commit/562dd173aaf6b398be8e053f896755b3afe8137f

Its hash is 562dd173aaf6b398be8e053f896755b3afe8137f.

The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.1.0-rc2/

The hashes of the artifacts are as follows:
apache-kylin-2.1.0-src.tar.gz.md5 44cab3240772dd1b2e717b48105b416c
apache-kylin-2.1.0-src.tar.gz.sha1 
a3470589523cfa9046d70123d78059b913f31b9f

(The binary packages for HBase 1.x and CDH 5.7are also provided for 
testing)

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1043/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/shaofengshi.asc

Please vote on releasing this package as Apache Kylin 2.1.0.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PPMC votes are cast.

[ ] +1 Release this package as Apache Kylin 2.1.0
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...

Here is my vote:

+1 (binding)


-- 
Best regards,

Shaofeng Shi 史少锋

Re: hbase namespace for final cube

[George Ni (Chunen Ni)]

Hi Hong Wei,

Namespace configuration is code ready, but not well tested. It will be 
available in one of kylin’s later releases.

Best regards,
 
Chun’en Ni(倪春恩)
Mail: chunen...@kyligence.io 
Shanghai Kyligence Information Technology Co., Ltd
上海市浦东新区亮秀路112号Y1座405室
 

在 2017/4/26 下午1:05，“Hong Wei” 写入:

Hi Kylin:
Can I configure to store cube into the other namespace of hbase more 
than 'default' ?

 # The storage for final cube file in hbase (namespace is default)
 kylin.storage.url=hbase

Re: Kylin-over-Alluxio

[George Ni (Chunen Ni)]

Hi Huangzhi,

Below are links of “how to doc” and “hot to contribute”
http://kylin.apache.org/development/howto_docs.html

http://kylin.apache.org/development/howto_contribute.html

Looking forward to your sharing.

Best regards,
 
Chun’en Ni(倪春恩)
Mail: chunen...@kyligence.io 
Shanghai Kyligence Information Technology Co., Ltd
上海市浦东新区亮秀路112号Y1座405室
 

在 2017/4/14 下午2:55，“Huangzhi” 写入:

Hi,

I am a contributor of Alluxio
community[https://github.com/Alluxio/alluxio].My name is Huangzhi.

Alluxio is a memory-centric distributed filesystem and provides a
hdfs-compatible API which can be used as a Hadoop FileSytem.

In the past weeks, we have been working the test of running Kylin on
Alluxio.We just use Alluxio's hdfs-compatible API and to see if we can
running Kylin over it.

We have successfully run the example of Kylin doc:

http://kylin.apache.org/docs20/tutorial/kylin_sample.html

Here is our doc:

https://github.com/Alluxio/alluxio/pull/4426/files

What we want to know is whether we can add this doc into Kylin's doc and if
we can, how to do it?

 

Best regards,

Huangzhi

Re: Local development environment configuration run test

[George Ni (Chunen Ni)]

Hi,
Please follow steps in articles of http://kylin.apache.org/development/

Best regards,
 
Chun’en Ni(倪春恩)
Mail: chunen...@kyligence.io 
Shanghai Kyligence Information Technology Co., Ltd
上海市浦东新区亮秀路112号Y1座405室
 

在 2017/3/17 上午11:01，“独孤依人”<459994...@qq.com> 写入:

hi：  I want to be a contributor to the kylin code, so I need to 
configure the local development environment, local testing, etc., should be how 
to do, can give a developer documentation?
thanks