Re: [VOTE] Accept donation of new codebase as Apache Kylin 5.0
+1 Best regards, Yanghong Zhong Email: nju_y...@apache.org From: hit_la...@126.com on behalf of Xiaoxiang Yu Date: Friday, February 24, 2023 at 10:26 To: Kylin Dev Subject: [VOTE] Accept donation of new codebase as Apache Kylin 5.0 External Email Hi, The Kylin community plans to design and implement new modeling system. The new codebase[2] is now receiving regular contributions from Kyligence, and now eBay have contributed some features as well . As we discussed[1] before, I propose that we should now accept this new codebase to Apache Kylin and continue development as part of the Kylin. All contributors have signed ICLAs and there is a branch with the donation[2]. This vote is to determine if the Kylin PMC is in favor of accepting this donation. If the vote passes, the PMC and the authors of the code will work together to complete the ASF IP Clearance process ( https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fincubator.apache.org%2Fip-clearance%2F=05%7C01%7Cyangzhong%40ebay.com%7Cbccaf5ca5f1845e136b608db160e9005%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C63812802402208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=3ruY752Ldtj11N14MV3qRJBfF%2BsrUe4T27Am2J0O%2Bh4%3D=0) . I have filled out the first draft of the IP clearance form and submitted it to the svn repo [3]. [ ] +1 : Accept donation of new codebase as Apache Kylin 5.0 [ ] 0 : No opinion [ ] -1 : Reject contribution because... Here is my vote: +1 The vote will be open for at least 72 hours. [1] https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.apache.org%2Fthread%2Ftrvv0g2mqcq2bv6x2zpdvjl8hhzcccqr=05%7C01%7Cyangzhong%40ebay.com%7Cbccaf5ca5f1845e136b608db160e9005%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C63812802402208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=mc%2FErIsYDQGV304wDy0EA8PF9N1i9q0XUDmefdHh%2B4w%3D=0 [2] https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Ftree%2Fkylin5=05%7C01%7Cyangzhong%40ebay.com%7Cbccaf5ca5f1845e136b608db160e9005%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C63812802402208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=hGmvXM4OYLtmONrlbUdEIwYvyYYprCWYqeO5voWMp0c%3D=0 [3] https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsvn.apache.org%2Frepos%2Fasf%2Fincubator%2Fpublic%2Ftrunk%2Fcontent%2Fip-clearance%2Fkylin-new-modeling-system.xml=05%7C01%7Cyangzhong%40ebay.com%7Cbccaf5ca5f1845e136b608db160e9005%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C63812802402208%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=%2FTCAhpSzUVtc3YLsphXTwyXEs%2BBrntLkmYLWeDvalvQ%3D=0 -- Best wishes to you ! >From ：Xiaoxiang Yu
Re: [Discuss] Adopt the new codebase as Apache Kylin 5.0
Thanks Xiaoxiang for raising this discussion. From my point of view, it’s time for our Kylin community to take a big step to make Kylin great again. I totally agree with Xiaoxiang’s proposal of adopting the new codebase of the branch https://github.com/apache/kylin/tree/kylin5, which is mainly contributed by the Kyligence. The Kylin team inside eBay also has been working on that branch together with the contributors from Kyligence for nearly half a year. And we just made an internal alpha release based on that branch and get lots of positive feedbacks from our trial users. The main breakthrough of Kylin5 is the change from the cube-based to the index-based. Therefore, now we can make our focus on how to make Kylin as an excellent index management system. Compared to the Kylin4, the current Kylin5 has already owned the following advantages: * Low barrier of creating a new index model. Indexes are optional and can be adjusted iteratively. * Easy and transparent index model upgrade. Dimension and measure change on existing index model can be with no downtime. * Raw data query can be supported by a new kind of index, projection index. * No limitation of the dimension number for the aggregation index (previous cuboid). At the meanwhile, the code of Kylin5 also has been refactored so that it makes it’s much easier to introduce different execution engines for querying on Kylin indexes. The Kylin team inside eBay has been working on a native vectorized execution engine (DataFusion+Ballista) with the Apache Arrow community for more than one year. And it’s used in our internal alpha release. We get an incredibly excellent result. Benchmarking on the SSB testing data set(1TB, 6Billion rows), our version can have average 20 times query performance gain compared to the Kylin3. [cid:image001.png@01D94264.0FC17600] Also thanks George for raising your concerns. Actually, the eBay Kylin also has the similar issues as we are stilling using Kylin3. We are mainly facing 3 kinds of challenges: 1. How to deal with incompatibility of interfaces between different Kylin versions? 2. How to make the iteration of the index model update more intelligently and transparently for users? 3. How to migrate Kylin3’s metadata and data to Kylin5? For the first challenge, the eBay Kylin team has been working on designing and implementing Kylin’s own SQL grammar for all of the DDL, DML, DQL and other commands. The SQL grammar should be standard, easy understanding. All of Kylin future versions should follow that SQL grammar so that users will be able to use the same SQLs for different versions of Kylin and don’t need to worry about the incompatibility issue. We have finished an initial version and now it’s under testing and verification. And we will raise issues and PRs to the community soon. For the second challenge, the eBay Kylin team has been working on reimplementation a new two-phase index planner for Kylin5 based on the Kylin3’s two-phase cube planner. The basic idea is as follows: 1. Do index recommendation based on data, like the row count of aggregation index 2. Do index recommendation based on user behavior, like query statistics The whole iteration process of index model will be user transparent. Currently, we have proposed PR for the phase one and it’s under review. For the third challenge, the eBay Kylin team has created tools for metadata migration from Kylin3 to Kylin5. And we will raise PR to the community soon. Overall, I will give +1 for this proposal of making Kylin5 as the codebase for Apache Kylin. Best regards, Yanghong Zhong 钟阳红 Apache Kylin Committer, PMC, Apache Arrow Committer, Email: nju_y...@apache.org From: hit_la...@126.com on behalf of Xiaoxiang Yu Date: Thursday, February 16, 2023 at 14:29 To: dev@kylin.apache.org Subject: Re: [Discuss] Adopt the new codebase as Apache Kylin 5.0 External Email 1. Would it possible for users of Kylin 2-4 to upgrade their metadata to Kylin5 easily? I was talking with some early users of new codebase, they told me that they have a plan to upgrade to new codebase(kylin 5) from kylin 3, and they plan to developed and contributed the metadata upgradation tools. So I think this issue will be solved soon. 2. Would the structures(URL, request and response) of the Restiful Apis in Kylin 2-4 be kept? It is a good question, but I have to say most REST APIs have been rewritten so they are call in new way. I think new REST doc will help to solve this partially. 3. Any benchmark test has been done? I think I will do a benchmark in next month. 4. Are features like Realtime Cubing, Cube Planner in Kylin3 are included in Kylin5? Kafka streaming/Realtime cubing/JDBC source are implemented in new way so previous code are not exists. For cube planner, Liu Kun are trying hard to implement it in new codebase (see
[jira] [Created] (KYLIN-5404) Prefer to use common standard dependencies rather than self-maintained ones
Zhong Yanghong created KYLIN-5404: - Summary: Prefer to use common standard dependencies rather than self-maintained ones Key: KYLIN-5404 URL: https://issues.apache.org/jira/browse/KYLIN-5404 Project: Kylin Issue Type: Task Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KYLIN-5321) Don't make the unprecomputed inner join defined in the model fail the match of the query without that join
Zhong Yanghong created KYLIN-5321: - Summary: Don't make the unprecomputed inner join defined in the model fail the match of the query without that join Key: KYLIN-5321 URL: https://issues.apache.org/jira/browse/KYLIN-5321 Project: Kylin Issue Type: Improvement Components: Query Engine Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KYLIN-5307) [kylin5] Distinguish sum(1) and count(*)
Zhong Yanghong created KYLIN-5307: - Summary: [kylin5] Distinguish sum(1) and count(*) Key: KYLIN-5307 URL: https://issues.apache.org/jira/browse/KYLIN-5307 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KYLIN-5306) [kylin5] Allow more inner join keys in sql than the model
Zhong Yanghong created KYLIN-5306: - Summary: [kylin5] Allow more inner join keys in sql than the model Key: KYLIN-5306 URL: https://issues.apache.org/jira/browse/KYLIN-5306 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KYLIN-5119) kylin-native branch for next generation development
Zhong Yanghong created KYLIN-5119: - Summary: kylin-native branch for next generation development Key: KYLIN-5119 URL: https://issues.apache.org/jira/browse/KYLIN-5119 Project: Kylin Issue Type: Task Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (KYLIN-4992) Source row count statistics calculated in a wrong way in MergeDictionaryMapper
Zhong Yanghong created KYLIN-4992: - Summary: Source row count statistics calculated in a wrong way in MergeDictionaryMapper Key: KYLIN-4992 URL: https://issues.apache.org/jira/browse/KYLIN-4992 Project: Kylin Issue Type: Bug Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4851) Better to throw exception when lazy query waiting timeout
Zhong Yanghong created KYLIN-4851: - Summary: Better to throw exception when lazy query waiting timeout Key: KYLIN-4851 URL: https://issues.apache.org/jira/browse/KYLIN-4851 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4779) Use TreeCuboidScheduler even when cube planner is not enabled for query
Zhong Yanghong created KYLIN-4779: - Summary: Use TreeCuboidScheduler even when cube planner is not enabled for query Key: KYLIN-4779 URL: https://issues.apache.org/jira/browse/KYLIN-4779 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4769) Make supportAppend to be true for hdfs federation
Zhong Yanghong created KYLIN-4769: - Summary: Make supportAppend to be true for hdfs federation Key: KYLIN-4769 URL: https://issues.apache.org/jira/browse/KYLIN-4769 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4758) Introduce a new measure to allow input to be negative for topn
Zhong Yanghong created KYLIN-4758: - Summary: Introduce a new measure to allow input to be negative for topn Key: KYLIN-4758 URL: https://issues.apache.org/jira/browse/KYLIN-4758 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4752) Refine server mode checking
Zhong Yanghong created KYLIN-4752: - Summary: Refine server mode checking Key: KYLIN-4752 URL: https://issues.apache.org/jira/browse/KYLIN-4752 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4749) Add isNeedMaterialize() for TableDesc
Zhong Yanghong created KYLIN-4749: - Summary: Add isNeedMaterialize() for TableDesc Key: KYLIN-4749 URL: https://issues.apache.org/jira/browse/KYLIN-4749 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4745) Fix BeelineHiveClient parseResultEntry
Zhong Yanghong created KYLIN-4745: - Summary: Fix BeelineHiveClient parseResultEntry Key: KYLIN-4745 URL: https://issues.apache.org/jira/browse/KYLIN-4745 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4718) Trim memory hungry measures in region server if no need to do post aggregation at server side
Zhong Yanghong created KYLIN-4718: - Summary: Trim memory hungry measures in region server if no need to do post aggregation at server side Key: KYLIN-4718 URL: https://issues.apache.org/jira/browse/KYLIN-4718 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4707) Add one config to disable mapper side combiner especially there's topn measure
Zhong Yanghong created KYLIN-4707: - Summary: Add one config to disable mapper side combiner especially there's topn measure Key: KYLIN-4707 URL: https://issues.apache.org/jira/browse/KYLIN-4707 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong Since mapper side combiner is only using one single thread to do measure merge. If there's some topn measure defined in cube, it will become very slow to finish a mapper task. It's better to provide an option to disable it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4702) Missing cube-level lookup table snapshot when doing cube migration
Zhong Yanghong created KYLIN-4702: - Summary: Missing cube-level lookup table snapshot when doing cube migration Key: KYLIN-4702 URL: https://issues.apache.org/jira/browse/KYLIN-4702 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4697) User info update logic is not correct
Zhong Yanghong created KYLIN-4697:
-
Summary: User info update logic is not correct
Key: KYLIN-4697
URL: https://issues.apache.org/jira/browse/KYLIN-4697
Project: Kylin
Issue Type: Bug
Reporter: Zhong Yanghong
Assignee: Zhong Yanghong
There are currently 3 main issues:
* In KylinUserGroupService.init(), the following code is not correct:
{code}
store.checkAndPutResource(PATH, userGroup, USER_GROUP_SERIALIZER);
{code}
* The logic for KylinAuthenticationProvider.needUpdateUser() is not correct due
to not considering ALL_USERS
* The logic of updateUser in KylinUserService & KylinUserManager is not correct
due to not following copy on write.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (KYLIN-4682) java.lang.IndexOutOfBoundsException due to not setting havingFilter correctly
Zhong Yanghong created KYLIN-4682: - Summary: java.lang.IndexOutOfBoundsException due to not setting havingFilter correctly Key: KYLIN-4682 URL: https://issues.apache.org/jira/browse/KYLIN-4682 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4674) support cast in sum() expression
Zhong Yanghong created KYLIN-4674: - Summary: support cast in sum() expression Key: KYLIN-4674 URL: https://issues.apache.org/jira/browse/KYLIN-4674 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4670) Improve query performance by reusing LookupStringTable
Zhong Yanghong created KYLIN-4670: - Summary: Improve query performance by reusing LookupStringTable Key: KYLIN-4670 URL: https://issues.apache.org/jira/browse/KYLIN-4670 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4667) Automatically set kylin.query.cache-signature-enabled to be true when memcached is enabled
Zhong Yanghong created KYLIN-4667: - Summary: Automatically set kylin.query.cache-signature-enabled to be true when memcached is enabled Key: KYLIN-4667 URL: https://issues.apache.org/jira/browse/KYLIN-4667 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4666) Improve TopNCounter's merge performance
Zhong Yanghong created KYLIN-4666: - Summary: Improve TopNCounter's merge performance Key: KYLIN-4666 URL: https://issues.apache.org/jira/browse/KYLIN-4666 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4664) Use translated TupleFilter for segment pruning
Zhong Yanghong created KYLIN-4664: - Summary: Use translated TupleFilter for segment pruning Key: KYLIN-4664 URL: https://issues.apache.org/jira/browse/KYLIN-4664 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4658) Windows function does not work for union all
Zhong Yanghong created KYLIN-4658: - Summary: Windows function does not work for union all Key: KYLIN-4658 URL: https://issues.apache.org/jira/browse/KYLIN-4658 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4653) Don't set capacity for the LinkedBlockingQueue of BlockingReservoir
Zhong Yanghong created KYLIN-4653: - Summary: Don't set capacity for the LinkedBlockingQueue of BlockingReservoir Key: KYLIN-4653 URL: https://issues.apache.org/jira/browse/KYLIN-4653 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4652) Fix sum(case when)
Zhong Yanghong created KYLIN-4652: - Summary: Fix sum(case when) Key: KYLIN-4652 URL: https://issues.apache.org/jira/browse/KYLIN-4652 Project: Kylin Issue Type: Bug Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4651) TopN does not work when force hit cube enabled
Zhong Yanghong created KYLIN-4651: - Summary: TopN does not work when force hit cube enabled Key: KYLIN-4651 URL: https://issues.apache.org/jira/browse/KYLIN-4651 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4650) Make it possible to support topn measure by only defining topn without sum
Zhong Yanghong created KYLIN-4650: - Summary: Make it possible to support topn measure by only defining topn without sum Key: KYLIN-4650 URL: https://issues.apache.org/jira/browse/KYLIN-4650 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4647) Only allow system admin able to Approve or Reject cube Migration
Zhong Yanghong created KYLIN-4647: - Summary: Only allow system admin able to Approve or Reject cube Migration Key: KYLIN-4647 URL: https://issues.apache.org/jira/browse/KYLIN-4647 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4641) Refine system cube build tool
Zhong Yanghong created KYLIN-4641: - Summary: Refine system cube build tool Key: KYLIN-4641 URL: https://issues.apache.org/jira/browse/KYLIN-4641 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4639) Make batch account without any authorities to be able to see web pages
Zhong Yanghong created KYLIN-4639: - Summary: Make batch account without any authorities to be able to see web pages Key: KYLIN-4639 URL: https://issues.apache.org/jira/browse/KYLIN-4639 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4637) Fix sum(null) issue
Zhong Yanghong created KYLIN-4637: - Summary: Fix sum(null) issue Key: KYLIN-4637 URL: https://issues.apache.org/jira/browse/KYLIN-4637 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4636) Make /api/admin/public_config callable for profile saml
Zhong Yanghong created KYLIN-4636: - Summary: Make /api/admin/public_config callable for profile saml Key: KYLIN-4636 URL: https://issues.apache.org/jira/browse/KYLIN-4636 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4620) sum(expression) support should be limited since it's not conform the associative law of addition in standard sql
Zhong Yanghong created KYLIN-4620: - Summary: sum(expression) support should be limited since it's not conform the associative law of addition in standard sql Key: KYLIN-4620 URL: https://issues.apache.org/jira/browse/KYLIN-4620 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4619) Make shrunken dict able to coexist with mr-hive global dict
Zhong Yanghong created KYLIN-4619: - Summary: Make shrunken dict able to coexist with mr-hive global dict Key: KYLIN-4619 URL: https://issues.apache.org/jira/browse/KYLIN-4619 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4616) The config of kylin.source.hive.databasedir can be self detected
Zhong Yanghong created KYLIN-4616: - Summary: The config of kylin.source.hive.databasedir can be self detected Key: KYLIN-4616 URL: https://issues.apache.org/jira/browse/KYLIN-4616 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: 回复：[VOTE] Release apache-kylin-3.1.0 (RC1)
+1 (binding) mvn test passed. Best regards, Yanghong Zhong On 2020/6/28, 11:13 PM, "恩爸" <441586...@qq.com> wrote: External Email +1 from my side. Tested passed on CDH5 and HDP3. Best regards, Zhichao Zhang --原始邮件-- 发件人:"George Ni"https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3FprojectId%3D12316121%26amp%3Bversion%3D12346593data=02%7C01%7Cyangzhong%40ebay.com%7C3237b3771e5541ab35a408d81b75c6f3%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637289539944798530sdata=ncIL3k82VXOGSPTCoo1HXD0Srmb9ti%2Bcvd%2FJbJQaqOo%3Dreserved=0 The commit to being voted upon: https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Fcommit%2F2e056748bf61ef89d421735bb7be41f4266d7b94data=02%7C01%7Cyangzhong%40ebay.com%7C3237b3771e5541ab35a408d81b75c6f3%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637289539944798530sdata=lCJYAjlP1zM7RzkwO2gI1BRqWHWyagn9jaHfAUdg0hw%3Dreserved=0 Its hash is 2e056748bf61ef89d421735bb7be41f4266d7b94. The artifacts to be voted on, including the source package and four pre-compiled binary packages are located here: https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fkylin%2Fapache-kylin-3.1.0-rc1%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7C3237b3771e5541ab35a408d81b75c6f3%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637289539944798530sdata=%2FkLpG5SuRmROChmme2Q5l76AqEhHQd1xh%2FkfSbG7rr4%3Dreserved=0 The hash of the artifacts are as follows: apache-kylin-3.1.0-source-release.zip.sha256 1efa8a60003ea8adaa39de7c020be2bd70ed045de736995153707c1ca08353e1 apache-kylin-3.1.0-bin-hbase1x.tar.gz.sha256 78921a27acba781adc41729aa65316833d2aec5d32047d6ffc195bfaf156cd5d apache-kylin-3.1.0-bin-cdh57.tar.gz.sha256 bdc5a790880f1b6e1d894454e3512c54515f3b52d55f4d118363514c5007ba89 apache-kylin-3.1.0-bin-hadoop3.tar.gz.sha256 0dd5beafd97b258a1af2ea597b9b610a01a5c63d65b150d7c5a9ada9f0ab6697 apache-kylin-3.1.0-bin-cdh60.tar.gz.sha256 8e662950f331cdf9af877225d2b8d63b2797b0bb4453e21b80e9528e908414f2 A staged Maven repository is available for review at: https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachekylin-1080%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7C3237b3771e5541ab35a408d81b75c6f3%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637289539944808522sdata=qZGAbjfOvVvIUqAb7B8lZciAp4rBxClkcxIjrw0nMsw%3Dreserved=0 Release artifacts are signed with the following key: https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fnic.ascdata=02%7C01%7Cyangzhong%40ebay.com%7C3237b3771e5541ab35a408d81b75c6f3%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637289539944808522sdata=R%2B9H3gchug6G1SrM4i3d2S5xyx8X5CM5ygbVV%2FtjT2g%3Dreserved=0 Please vote on releasing this package as Apache Kylin 3.1.0. The vote is open for the next 72 hours and passes if a majority of at least three +1 PMC votes are cast. [ ] +1 Release this package as Apache Kylin 3.1.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) -- - Best regards, Ni Chunen / George
[jira] [Created] (KYLIN-4602) Query display format not correct in insight table
Zhong Yanghong created KYLIN-4602: - Summary: Query display format not correct in insight table Key: KYLIN-4602 URL: https://issues.apache.org/jira/browse/KYLIN-4602 Project: Kylin Issue Type: Improvement Components: Website Reporter: Zhong Yanghong Assignee: Julian Pan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4600) Add new configuration to indicate the kylin env is prod or not
Zhong Yanghong created KYLIN-4600: - Summary: Add new configuration to indicate the kylin env is prod or not Key: KYLIN-4600 URL: https://issues.apache.org/jira/browse/KYLIN-4600 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Julian Pan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4596) Consider CubeInstance reinitialization time when querying system cubes
Zhong Yanghong created KYLIN-4596: - Summary: Consider CubeInstance reinitialization time when querying system cubes Key: KYLIN-4596 URL: https://issues.apache.org/jira/browse/KYLIN-4596 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4594) Add cli tool to detect inactive cubes
Zhong Yanghong created KYLIN-4594: - Summary: Add cli tool to detect inactive cubes Key: KYLIN-4594 URL: https://issues.apache.org/jira/browse/KYLIN-4594 Project: Kylin Issue Type: Sub-task Components: Tools, Build and Test Reporter: Zhong Yanghong Assignee: Julian Pan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4593) Add cli tools for better maintenance
Zhong Yanghong created KYLIN-4593: - Summary: Add cli tools for better maintenance Key: KYLIN-4593 URL: https://issues.apache.org/jira/browse/KYLIN-4593 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4592) Make KylinConfig used by hbase coprocessor be cube segment level
Zhong Yanghong created KYLIN-4592: - Summary: Make KylinConfig used by hbase coprocessor be cube segment level Key: KYLIN-4592 URL: https://issues.apache.org/jira/browse/KYLIN-4592 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4590) New column may be not shown after reloading hive table
Zhong Yanghong created KYLIN-4590: - Summary: New column may be not shown after reloading hive table Key: KYLIN-4590 URL: https://issues.apache.org/jira/browse/KYLIN-4590 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Julian Pan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4589) Display ready segments only in the "REFRESH SEGMENT" drop-down box
Zhong Yanghong created KYLIN-4589: - Summary: Display ready segments only in the "REFRESH SEGMENT" drop-down box Key: KYLIN-4589 URL: https://issues.apache.org/jira/browse/KYLIN-4589 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Julian Pan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4588) Add a rest API to get project list for a user able to access
Zhong Yanghong created KYLIN-4588: - Summary: Add a rest API to get project list for a user able to access Key: KYLIN-4588 URL: https://issues.apache.org/jira/browse/KYLIN-4588 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4587) Send out notification email when triggering cube optimization
Zhong Yanghong created KYLIN-4587: - Summary: Send out notification email when triggering cube optimization Key: KYLIN-4587 URL: https://issues.apache.org/jira/browse/KYLIN-4587 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4586) Add a configuration of maximum partition returned bytes
Zhong Yanghong created KYLIN-4586: - Summary: Add a configuration of maximum partition returned bytes Key: KYLIN-4586 URL: https://issues.apache.org/jira/browse/KYLIN-4586 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4584) Add one option backup-hdfs for metastore.sh to backup metadata to hdfs
Zhong Yanghong created KYLIN-4584: - Summary: Add one option backup-hdfs for metastore.sh to backup metadata to hdfs Key: KYLIN-4584 URL: https://issues.apache.org/jira/browse/KYLIN-4584 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4583) Collect cpu time for coprocessor thread
Zhong Yanghong created KYLIN-4583: - Summary: Collect cpu time for coprocessor thread Key: KYLIN-4583 URL: https://issues.apache.org/jira/browse/KYLIN-4583 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4580) Add 90, 360 auto-merge thresholds for system cubes
Zhong Yanghong created KYLIN-4580: - Summary: Add 90, 360 auto-merge thresholds for system cubes Key: KYLIN-4580 URL: https://issues.apache.org/jira/browse/KYLIN-4580 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4579) Add fat API to create cube & delete cube
Zhong Yanghong created KYLIN-4579: - Summary: Add fat API to create cube & delete cube Key: KYLIN-4579 URL: https://issues.apache.org/jira/browse/KYLIN-4579 Project: Kylin Issue Type: Improvement Components: REST Service Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4573) Add option to indicate when close file for every append for Hive Producer
Zhong Yanghong created KYLIN-4573: - Summary: Add option to indicate when close file for every append for Hive Producer Key: KYLIN-4573 URL: https://issues.apache.org/jira/browse/KYLIN-4573 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4571) Always set GMT timezone for RecordEventTimeDetail
Zhong Yanghong created KYLIN-4571: - Summary: Always set GMT timezone for RecordEventTimeDetail Key: KYLIN-4571 URL: https://issues.apache.org/jira/browse/KYLIN-4571 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong Since the config kylin.web.timezone may be changed by users overtime, the formatted time strings RecordEventTimeDetail may have incorrect meanings. It's better to always set the time zone to be GMT so that the formatted time strings will not be influenced by the change of kylin.web.timezone. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4570) Create static rule knowledge repository for join dimensions
Zhong Yanghong created KYLIN-4570: - Summary: Create static rule knowledge repository for join dimensions Key: KYLIN-4570 URL: https://issues.apache.org/jira/browse/KYLIN-4570 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4568) Create Static Rule Knowledge Repository
Zhong Yanghong created KYLIN-4568: - Summary: Create Static Rule Knowledge Repository Key: KYLIN-4568 URL: https://issues.apache.org/jira/browse/KYLIN-4568 Project: Kylin Issue Type: New Feature Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4569) Create static rule knowledge repository for hierarchy dimensions
Zhong Yanghong created KYLIN-4569: - Summary: Create static rule knowledge repository for hierarchy dimensions Key: KYLIN-4569 URL: https://issues.apache.org/jira/browse/KYLIN-4569 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4566) Add cli tool to analyze hbase storage usage statistics
Zhong Yanghong created KYLIN-4566: - Summary: Add cli tool to analyze hbase storage usage statistics Key: KYLIN-4566 URL: https://issues.apache.org/jira/browse/KYLIN-4566 Project: Kylin Issue Type: New Feature Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4565) Add cli tool to export base cuboid data
Zhong Yanghong created KYLIN-4565: - Summary: Add cli tool to export base cuboid data Key: KYLIN-4565 URL: https://issues.apache.org/jira/browse/KYLIN-4565 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4564) Refine query metrics update
Zhong Yanghong created KYLIN-4564: - Summary: Refine query metrics update Key: KYLIN-4564 URL: https://issues.apache.org/jira/browse/KYLIN-4564 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4553) Expose job filtered with more job types
Zhong Yanghong created KYLIN-4553: - Summary: Expose job filtered with more job types Key: KYLIN-4553 URL: https://issues.apache.org/jira/browse/KYLIN-4553 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Julian Pan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4551) Provide an interface to transfer cube ownership
Zhong Yanghong created KYLIN-4551: - Summary: Provide an interface to transfer cube ownership Key: KYLIN-4551 URL: https://issues.apache.org/jira/browse/KYLIN-4551 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Julian Pan In many companies, employee variation is very common. If cube owners leave office, it's necessary to transfer the cube ownership to others. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4550) Provide advanced refresh interface inside the refresh panel
Zhong Yanghong created KYLIN-4550: - Summary: Provide advanced refresh interface inside the refresh panel Key: KYLIN-4550 URL: https://issues.apache.org/jira/browse/KYLIN-4550 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Julian Pan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4549) Show column cardinality in rowkeys area of advanced settings
Zhong Yanghong created KYLIN-4549: - Summary: Show column cardinality in rowkeys area of advanced settings Key: KYLIN-4549 URL: https://issues.apache.org/jira/browse/KYLIN-4549 Project: Kylin Issue Type: Improvement Components: Web Reporter: Zhong Yanghong Assignee: Julian Pan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4536) Refine cube planner
Zhong Yanghong created KYLIN-4536: - Summary: Refine cube planner Key: KYLIN-4536 URL: https://issues.apache.org/jira/browse/KYLIN-4536 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4535) Frontend support for query & storage trend of cube planner optimization
Zhong Yanghong created KYLIN-4535: - Summary: Frontend support for query & storage trend of cube planner optimization Key: KYLIN-4535 URL: https://issues.apache.org/jira/browse/KYLIN-4535 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4534) Backend support for query & storage trend of cube planner optimization
Zhong Yanghong created KYLIN-4534: - Summary: Backend support for query & storage trend of cube planner optimization Key: KYLIN-4534 URL: https://issues.apache.org/jira/browse/KYLIN-4534 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4533) Create a tool to check all cubes' cube planner optimization score
Zhong Yanghong created KYLIN-4533: - Summary: Create a tool to check all cubes' cube planner optimization score Key: KYLIN-4533 URL: https://issues.apache.org/jira/browse/KYLIN-4533 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4532) Define cube planner optimization score
Zhong Yanghong created KYLIN-4532: - Summary: Define cube planner optimization score Key: KYLIN-4532 URL: https://issues.apache.org/jira/browse/KYLIN-4532 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4531) Automate cube planner optimization
Zhong Yanghong created KYLIN-4531: - Summary: Automate cube planner optimization Key: KYLIN-4531 URL: https://issues.apache.org/jira/browse/KYLIN-4531 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4530) Refine log
Zhong Yanghong created KYLIN-4530: - Summary: Refine log Key: KYLIN-4530 URL: https://issues.apache.org/jira/browse/KYLIN-4530 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4529) Add user audit log
Zhong Yanghong created KYLIN-4529: - Summary: Add user audit log Key: KYLIN-4529 URL: https://issues.apache.org/jira/browse/KYLIN-4529 Project: Kylin Issue Type: New Feature Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4528) Bad hbase region & irregular query detection
Zhong Yanghong created KYLIN-4528: - Summary: Bad hbase region & irregular query detection Key: KYLIN-4528 URL: https://issues.apache.org/jira/browse/KYLIN-4528 Project: Kylin Issue Type: New Feature Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4513) Introduce query call trace
Zhong Yanghong created KYLIN-4513: - Summary: Introduce query call trace Key: KYLIN-4513 URL: https://issues.apache.org/jira/browse/KYLIN-4513 Project: Kylin Issue Type: New Feature Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4508) Refine log
Zhong Yanghong created KYLIN-4508: - Summary: Refine log Key: KYLIN-4508 URL: https://issues.apache.org/jira/browse/KYLIN-4508 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4507) Override getSocketAddress() in TCPMemcachedNodeImpl to achieve same hostname with ip changing
Zhong Yanghong created KYLIN-4507: - Summary: Override getSocketAddress() in TCPMemcachedNodeImpl to achieve same hostname with ip changing Key: KYLIN-4507 URL: https://issues.apache.org/jira/browse/KYLIN-4507 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4506) Remove unresolved memcached servers before initialize MemcachedClient
Zhong Yanghong created KYLIN-4506: - Summary: Remove unresolved memcached servers before initialize MemcachedClient Key: KYLIN-4506 URL: https://issues.apache.org/jira/browse/KYLIN-4506 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4505) Change guava cache to spring cache for user authentication
Zhong Yanghong created KYLIN-4505: - Summary: Change guava cache to spring cache for user authentication Key: KYLIN-4505 URL: https://issues.apache.org/jira/browse/KYLIN-4505 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4504) Cache usage improvement
Zhong Yanghong created KYLIN-4504: - Summary: Cache usage improvement Key: KYLIN-4504 URL: https://issues.apache.org/jira/browse/KYLIN-4504 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4499) Refactor CuratorScheduler
Zhong Yanghong created KYLIN-4499: - Summary: Refactor CuratorScheduler Key: KYLIN-4499 URL: https://issues.apache.org/jira/browse/KYLIN-4499 Project: Kylin Issue Type: Improvement Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Release apache-kylin-3.0.2 (RC2)
+1 (binding) Mvn test successfully on Java 8. Best regards, Yanghong Zhong Apache Kylin PMC Email: nju_y...@apache.org On 2020/5/15, 9:18 AM, "Chao Long" wrote: +1 mvn test passed On Fri, May 15, 2020 at 8:43 AM ShaoFeng Shi wrote: > +1 (binding) > > Checked the signature and sha hash; > 'Mvn test' build successfully on Java 8; > > Best regards, > > Shaofeng Shi 史少锋 > Apache Kylin PMC > Email: shaofeng...@apache.org > > Apache Kylin FAQ: https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.htmldata=02%7C01%7Cyangzhong%40ebay.com%7C4d3caa986c564dcfb39208d7f86df131%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251023389507888sdata=erQkbXFVvALDEGq%2BzjPH%2Fz6IP0Qj2dQndtuuXGWtk9w%3Dreserved=0 > Join Kylin user mail group: user-subscr...@kylin.apache.org > Join Kylin dev mail group: dev-subscr...@kylin.apache.org > > > > > Xiaoxiang Yu 于2020年5月14日周四 下午11:21写道： > > > +1 . > > Maven test passed and happy path passed in CDH5.7. > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > Best wishes to you ! > > From ：Xiaoxiang Yu > > > > > > > > > > > > At 2020-05-14 17:11:28, "George Ni" wrote: > > >Hi all, > > > > > > > > > > > >I have created a build for Apache Kylin 3.0.2, release candidate 2. > > > > > > > > > > > >Changes highlights: > > > > > >[KYLIN-4390] - Update tomcat to 7.0.100 > > > > > >[KYLIN-4426] - Refine CliCommandExecutor > > > > > >[KYLIN-4206] - Support Glue as Hive Metatdata > > > > > > > > > > > >Thanks to everyone who has contributed to this release. > > > > > >Here are the release notes: > > > > > > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3Fversion%3D12346975%26styleName%3D%26projectId%3D12316121data=02%7C01%7Cyangzhong%40ebay.com%7C4d3caa986c564dcfb39208d7f86df131%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251023389507888sdata=IXZk7RfjEPNKJj%2BU7aTJpGRHlfaaMjnmuiFXL1T8RTg%3Dreserved=0 > > > > > > > > > > > >The commit to being voted upon: > > > > > > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Fcommit%2F57090efe4bdc079ccfde4f9c8729d69ba3a90624data=02%7C01%7Cyangzhong%40ebay.com%7C4d3caa986c564dcfb39208d7f86df131%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251023389507888sdata=IouOhqeT0YwlkKySSmBPKi0zU9Ej2E3jBm%2F8dLQbW40%3Dreserved=0 > > > > > > > > >Its hash is 57090efe4bdc079ccfde4f9c8729d69ba3a90624. > > > > > > > > > > > >The artifacts to be voted on, including the source package and four > > > > > >pre-compiled binary packages are located here: > > > > > >https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fkylin%2Fapache-kylin-3.0.2-rc2%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7C4d3caa986c564dcfb39208d7f86df131%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251023389507888sdata=m98FrMcNoiuDORxN253rLeUGipkWwpAshnpFsK9RBCg%3Dreserved=0 > > > > > > > > > > > >The hash of the artifacts are as follows: > > > > > >apache-kylin-3.0.2-source-release.zip.sha256 > > >1add5892bd1d5994e0e467846e9a844758420f14819ceef63370c07a6aa0b8af > > > > > >apache-kylin-3.0.2-bin-hbase1x.tar.gz.sha256 > > >086397d9ecbccf80517977a4b65b660b8e1496ad097d890226bd78a34a9fe190 > > > > > >apache-kylin-3.0.2-bin-cdh57.tar.gz.sha256 > > >181929fcd35a63a81b6dc097137a3dd1e129fd1f81400e09f64019dcb7ac8a21 > > > > > >apache-kylin-3.0.2-bin-hadoop3.tar.gz.sha256 > > >c2250734fed971f32d242036a55ba955bcf8de91e0e73704e07cfb09124d9899 > > > > > >apache-kylin-3.0.2-bin-cdh60.tar.gz.sha256 > > >83a68d2aec32e634475c490434981ebc91e8680dbb6388edc4ed919687ad1dac > > > > > > > > > > > >A staged Maven repository is available for review at: > > > > > >https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachekylin-1078%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7C4d3caa986c564dcfb39208d7f86df131%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251023389507888sdata=XFGmXCIbOEyZ0kqVtiYE4kj%2BWHm7W33FN%2F8MpPoalFM%3Dreserved=0 > > > > > > > > > > > >Release artifacts are signed with the following key: > > > > >
Re: [VOTE] Release apache-kylin-2.6.6 (RC2)
+1 (binding) Mvn test successfully on Java 8. Best regards, Yanghong Zhong Apache Kylin PMC Email: nju_y...@apache.org On 2020/5/15, 8:47 AM, "ShaoFeng Shi" wrote: +1 (binding) Checked the signature and sha hash; 'Mvn test' build successfully on Java 8; Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.htmldata=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=LJEdErMsxQwECLmAgnoMia40Lx2mNP%2FWWyr3xDJKYfc%3Dreserved=0 Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org Xiaoxiang Yu 于2020年5月14日周四 下午11:23写道： > +1 . > Maven test passed and happy path passed in CDH5.7. > > > > > > > > > > > -- > > Best wishes to you ! > From ：Xiaoxiang Yu > > > > > > At 2020-05-14 17:06:55, "George Ni" wrote: > >Hi all, > > > > > > > >I have created a build for Apache Kylin 2.6.6, release candidate 2. > > > > > > > >Changes highlights: > > > >[KYLIN-4390] - Update tomcat to 7.0.100 > > > >[KYLIN-4426] - Refine CliCommandExecutor > > > >[KYLIN-4206] - Support Glue as Hive Metatdata > > > > > > > >Thanks to everyone who has contributed to this release. > > > >Here are the release notes: > > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3Fversion%3D12346976%26styleName%3D%26projectId%3D12316121data=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=36c%2BrngKbUKGzcoV%2BiWXatYYaddQjSEdTUpazsb3CA8%3Dreserved=0 > > > > > > > >The commit to being voted upon: > > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Fcommit%2Fddd5f8ecd4157b8f889b047e421dd9cfae7e1142data=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=5g73LF70lEf%2BXQhLGkJFddVld%2BaKiVJgix9nKJidaX8%3Dreserved=0 > > > > > >Its hash is ddd5f8ecd4157b8f889b047e421dd9cfae7e1142. > > > > > > > >The artifacts to be voted on, including the source package and four > > > >pre-compiled binary packages are located here: > > > >https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fkylin%2Fapache-kylin-2.6.6-rc2%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=kFZAYJQRMm4J9fhjnO4Xhgjz2W9qy%2FtpvD25Yq9Mxf0%3Dreserved=0 > > > > > > > >The hash of the artifacts are as follows: > > > >apache-kylin-2.6.6-source-release.zip.sha256 > >6d38671f494e3d5f2bb26dfb94d996a5ceb0c00c2a17b9c181ad853639198d3a > > > >apache-kylin-2.6.6-bin-hbase1x.tar.gz.sha256 > >6a42962efbce5a51e2ce4bf8db0b8fa7341ef0b30e4f02e876a5c2fb0500944b > > > >apache-kylin-2.6.6-bin-cdh57.tar.gz.sha256 > >85cb22e7d6d9adad214854f9ab285b7d47e874eb9f9df1c5bd01882877171762 > > > >apache-kylin-2.6.6-bin-hadoop3.tar.gz.sha256 > >f060f8e16f909ae74d9e3c188bb071fcfa87e0a21fd7581fc968e1bcf00e5121 > > > >apache-kylin-2.6.6-bin-cdh60.tar.gz.sha256 > >8d85a3036d312b47030e3b309af526afe4484720be156f7e3f05e626c02bf531 > > > > > > > >A staged Maven repository is available for review at: > > > >https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachekylin-1077%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=zjKukkQNRt%2Bd%2B6oPBZdX%2Bji3DSbiYeu3evDALkQX%2BqI%3Dreserved=0 > > > > > > > >Release artifacts are signed with the following key: > > > >https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fnic.ascdata=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=8Dxcdmg8GnjZyx1Z1pk2kaQZCmoSZ906hCEa03UTSHM%3Dreserved=0 > > > > > > > >Please vote on releasing this package as Apache Kylin 2.6.6. > > > > > > > >The vote is open for the next 72 hours and passes if a majority of > > > >at least three +1 PMC votes are cast. > > > > > > > >[ ] +1 Release this package as Apache Kylin 2.6.6 > > > >[ ] 0 I don't feel strongly
[jira] [Created] (KYLIN-4492) Bad query leads to full gc
Zhong Yanghong created KYLIN-4492:
-
Summary: Bad query leads to full gc
Key: KYLIN-4492
URL: https://issues.apache.org/jira/browse/KYLIN-4492
Project: Kylin
Issue Type: Bug
Components: Query Engine
Reporter: Zhong Yanghong
The following sql goes into dead loop of calcite sql parser leading to OOM
{code}
select LSTG_FORMAT_NAME,
cast(sum(t.sid_cnt) as bigint) as sid_cnts
from
(select LSTG_FORMAT_NAME,
count(distinct SELLER_ID) as sid_cnt
from TEST_KYLIN_FACT
group by LSTG_FORMAT_NAME) t
group by LSTG_FORMAT_NAME
order by sid_cnts
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (KYLIN-4489) Create a tool for migration cross clusters
Zhong Yanghong created KYLIN-4489: - Summary: Create a tool for migration cross clusters Key: KYLIN-4489 URL: https://issues.apache.org/jira/browse/KYLIN-4489 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4487) Backend support for auto-migration to allow user to do cube migration by self service
Zhong Yanghong created KYLIN-4487: - Summary: Backend support for auto-migration to allow user to do cube migration by self service Key: KYLIN-4487 URL: https://issues.apache.org/jira/browse/KYLIN-4487 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4488) Frontend support for auto-migration to allow user to do cube migration by self service
Zhong Yanghong created KYLIN-4488: - Summary: Frontend support for auto-migration to allow user to do cube migration by self service Key: KYLIN-4488 URL: https://issues.apache.org/jira/browse/KYLIN-4488 Project: Kylin Issue Type: Task Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4485) Create a self service interface for cube migration
Zhong Yanghong created KYLIN-4485: - Summary: Create a self service interface for cube migration Key: KYLIN-4485 URL: https://issues.apache.org/jira/browse/KYLIN-4485 Project: Kylin Issue Type: New Feature Components: Tools, Build and Test Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4484) Relex TableSchemaUpdateChecker
Zhong Yanghong created KYLIN-4484: - Summary: Relex TableSchemaUpdateChecker Key: KYLIN-4484 URL: https://issues.apache.org/jira/browse/KYLIN-4484 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4429) For LEAST_RESTRICTIVE consistency, which is the '=' operator, convert implicitly
Zhong Yanghong created KYLIN-4429:
-
Summary: For LEAST_RESTRICTIVE consistency, which is the '='
operator, convert implicitly
Key: KYLIN-4429
URL: https://issues.apache.org/jira/browse/KYLIN-4429
Project: Kylin
Issue Type: Improvement
Reporter: Zhong Yanghong
Assignee: Zhong Yanghong
For the following sql,
{code}
select count(*)
from TEST_KYLIN_FACT
where cal_dt = date'2012-01-01'
{code}
, if the data type of *cal_dt* is varchar, the sql cannot run successfully due
to no implicitly data type conversion.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (KYLIN-4428) Left join result is empty
Zhong Yanghong created KYLIN-4428:
-
Summary: Left join result is empty
Key: KYLIN-4428
URL: https://issues.apache.org/jira/browse/KYLIN-4428
Project: Kylin
Issue Type: Improvement
Components: Query Engine
Reporter: Zhong Yanghong
Assignee: Zhong Yanghong
The below sql
{code}
select
f.cal_dt
from test_kylin_fact f
where
f.cal_dt not in (
select cal_dt from EDW.TEST_CAL_DT where week_beg_dt = date'2012-01-01'
)
{code}
should be equal to
{code}
select f.cal_dt
from test_kylin_fact f
left join ( select cal_dt from EDW.TEST_CAL_DT where week_beg_dt =
date'2012-01-01' ) s
on f.cal_dt = s.cal_dt
where s.cal_dt IS NULL
{code}
However, when run the later sql with left join, it returns no results.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (KYLIN-4422) Allow to change data type from varchar to date
Zhong Yanghong created KYLIN-4422: - Summary: Allow to change data type from varchar to date Key: KYLIN-4422 URL: https://issues.apache.org/jira/browse/KYLIN-4422 Project: Kylin Issue Type: Sub-task Components: Metadata Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4421) Allow to update table & database name
Zhong Yanghong created KYLIN-4421: - Summary: Allow to update table & database name Key: KYLIN-4421 URL: https://issues.apache.org/jira/browse/KYLIN-4421 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4420) Add model compatibility check
Zhong Yanghong created KYLIN-4420: - Summary: Add model compatibility check Key: KYLIN-4420 URL: https://issues.apache.org/jira/browse/KYLIN-4420 Project: Kylin Issue Type: Sub-task Reporter: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4419) Make it possible to change metadata in some cases without rebuilding data
Zhong Yanghong created KYLIN-4419: - Summary: Make it possible to change metadata in some cases without rebuilding data Key: KYLIN-4419 URL: https://issues.apache.org/jira/browse/KYLIN-4419 Project: Kylin Issue Type: Improvement Components: Metadata Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4418) Bug fix for ShardingHash.getShard in HBaseLookupRowEncoder
Zhong Yanghong created KYLIN-4418: - Summary: Bug fix for ShardingHash.getShard in HBaseLookupRowEncoder Key: KYLIN-4418 URL: https://issues.apache.org/jira/browse/KYLIN-4418 Project: Kylin Issue Type: Sub-task Components: Job Engine Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4417) Use hash rather than random for ConvergeCuboidDataPartitioner to avoid potential issue
Zhong Yanghong created KYLIN-4417: - Summary: Use hash rather than random for ConvergeCuboidDataPartitioner to avoid potential issue Key: KYLIN-4417 URL: https://issues.apache.org/jira/browse/KYLIN-4417 Project: Kylin Issue Type: Sub-task Components: Job Engine Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4416) Disable htable compaction
Zhong Yanghong created KYLIN-4416: - Summary: Disable htable compaction Key: KYLIN-4416 URL: https://issues.apache.org/jira/browse/KYLIN-4416 Project: Kylin Issue Type: Sub-task Components: Job Engine Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4414) make bulkload locality possible
Zhong Yanghong created KYLIN-4414: - Summary: make bulkload locality possible Key: KYLIN-4414 URL: https://issues.apache.org/jira/browse/KYLIN-4414 Project: Kylin Issue Type: Sub-task Components: Job Engine Reporter: Zhong Yanghong Assignee: Zhong Yanghong -- This message was sent by Atlassian Jira (v8.3.4#803005)
