[jira] [Commented] (KYLIN-3487) Create a new measure for precise count distinct
[ https://issues.apache.org/jira/browse/KYLIN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115708#comment-17115708 ] ASF subversion and git services commented on KYLIN-3487: Commit 7437c1a1b1a09c366ddabc4112559e2918214eef in kylin's branch refs/heads/master from Zhong, Yanghong [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=7437c1a ] KYLIN-3487 add a bitmap map-based new measure for precise count distinct > Create a new measure for precise count distinct > --- > > Key: KYLIN-3487 > URL: https://issues.apache.org/jira/browse/KYLIN-3487 > Project: Kylin > Issue Type: Improvement >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v3.1.0 > > > To compute the precise count distinct, we can use bitmap and global > dictionary. However, there's a limitation for the global dictionary. It maps > from values to ids whose type is integer, which means the number of ids will > be less than 2B. And it's like a Pixiu for which there's increase but no > decrease. > In eBay, there's a requirement of calculating precise count distinct of > session. The session cardinality is large and will grow as time goes on. It > will not be feasible to use the global dictionary when its cardinality > exceeds the upper bound 2B. How can we deal with this? > There's good news that a session never crosses days. With this feature, we > don't need to merge bitmap across days. To calculate precise session > cardinality, we can assign each day a bitmap and directly summarize the > cardinalities estimated by each bitmap. No bitmap merge is needed. > To use bitmap for cardinality calculation, we need to map raw data from value > to an integer id, which is achieved by encoding the value with a dictionary. > Previously, for the ability of merging bitmaps from multiple segments, global > dictionary is used. However, in this case, there's no need of bitmap merge, > the global dictionary is not needed. > And we don't need to filter by or group by session. Then there's no need to > map from value to id and from id to value after the related bitmap is > constructed. Therefore, we don't need to store dictionaries for session. Only > the bitmap is enough. > To deal with segment merge, since bitmaps of each segment are not able to > merge to one bitmap, we use a map for storing multiple bitmaps. In the map, > the key is the segment name and the value is the segment-level bitmap. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4281) Precisely set the data type of tuple expression
[ https://issues.apache.org/jira/browse/KYLIN-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115706#comment-17115706 ] ASF GitHub Bot commented on KYLIN-4281: --- nichunen merged pull request #1144: URL: https://github.com/apache/kylin/pull/1144 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Precisely set the data type of tuple expression > --- > > Key: KYLIN-4281 > URL: https://issues.apache.org/jira/browse/KYLIN-4281 > Project: Kylin > Issue Type: Improvement >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v3.1.0 > > > Previously to simplify the calculating of sum(case when), all of the binary > calculation is based on BigDecimal, which is not good for all, especially > when dealing with count(distinct case when), whose inner data type may be hll > or bitmap. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4282) support case when in count (distinct)
[ https://issues.apache.org/jira/browse/KYLIN-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115704#comment-17115704 ] ASF subversion and git services commented on KYLIN-4282: Commit 94b707fe24f83aabf50c92ac216b78ba1d9fefdc in kylin's branch refs/heads/master from Zhong, Yanghong [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=94b707f ] KYLIN-4282 support case when in count (distinct) > support case when in count (distinct) > - > > Key: KYLIN-4282 > URL: https://issues.apache.org/jira/browse/KYLIN-4282 > Project: Kylin > Issue Type: Improvement >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4281) Precisely set the data type of tuple expression
[ https://issues.apache.org/jira/browse/KYLIN-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115702#comment-17115702 ] ASF subversion and git services commented on KYLIN-4281: Commit d896fce611b15a787f9e618fff4e4152014d00a2 in kylin's branch refs/heads/master from Zhong, Yanghong [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d896fce ] KYLIN-4281 Precisely set the data type of tuple expression > Precisely set the data type of tuple expression > --- > > Key: KYLIN-4281 > URL: https://issues.apache.org/jira/browse/KYLIN-4281 > Project: Kylin > Issue Type: Improvement >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v3.1.0 > > > Previously to simplify the calculating of sum(case when), all of the binary > calculation is based on BigDecimal, which is not good for all, especially > when dealing with count(distinct case when), whose inner data type may be hll > or bitmap. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-3361) Support stddev as a new measure
[ https://issues.apache.org/jira/browse/KYLIN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115707#comment-17115707 ] ASF subversion and git services commented on KYLIN-3361: Commit 873d42c59943209f0aad6d06f041e95265c44bad in kylin's branch refs/heads/master from Zhong, Yanghong [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=873d42c ] KYLIN-3361 Add a two layer udaf stddev_sum > Support stddev as a new measure > --- > > Key: KYLIN-3361 > URL: https://issues.apache.org/jira/browse/KYLIN-3361 > Project: Kylin > Issue Type: New Feature >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v3.1.0 > > > (x ~1~ - +x+) ^2^ + (x ~2~ - +x+) ^2^ + ... + (x ~n~ - +x+) ^2^ = x ~1~ ^2^ + > x ~2~ ^2^ + ... + x ~n~ ^2^ - n +x+ ^2^, where +x+ is the average of x ~1~, x > ~2~, ..., x ~n~. Therefore, to compute stddev, what kylin need to do is to > pre-calculate sum(x ~i~ ^2^), sum(x ~i~) and count -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4275) Result of count(case when) is not correct
[
https://issues.apache.org/jira/browse/KYLIN-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115703#comment-17115703
]
ASF subversion and git services commented on KYLIN-4275:
Commit 5fd72499966db1deffef08d5e52e97af6c0876b7 in kylin's branch
refs/heads/master from Zhong, Yanghong
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5fd7249 ]
KYLIN-4275 Fix result of count(case when) is not correct
> Result of count(case when) is not correct
> -
>
> Key: KYLIN-4275
> URL: https://issues.apache.org/jira/browse/KYLIN-4275
> Project: Kylin
> Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
>
> For the following sql, the result is not correct:
> {code}
> select count(case when LEAF_CATEG_ID=165888 then 1 else null end)
> from TEST_KYLIN_FACT
> {code}
> The result should be equal to
> {code}
> select count(*)
> from TEST_KYLIN_FACT
> where LEAF_CATEG_ID=165888
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4282) support case when in count (distinct)
[ https://issues.apache.org/jira/browse/KYLIN-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115705#comment-17115705 ] ASF subversion and git services commented on KYLIN-4282: Commit b0fadb06ed5b1dfc0f232c34a69a99dcc6697ae8 in kylin's branch refs/heads/master from Zhong, Yanghong [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=b0fadb0 ] KYLIN-4282 support case when in count (distinct) if all related columns are dims > support case when in count (distinct) > - > > Key: KYLIN-4282 > URL: https://issues.apache.org/jira/browse/KYLIN-4282 > Project: Kylin > Issue Type: Improvement >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] nichunen merged pull request #1144: KYLIN-4281 Precisely set the data type of tuple expression
nichunen merged pull request #1144: URL: https://github.com/apache/kylin/pull/1144 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] codecov-commenter commented on pull request #1144: KYLIN-4281 Precisely set the data type of tuple expression
codecov-commenter commented on pull request #1144: URL: https://github.com/apache/kylin/pull/1144#issuecomment-633369840 # [Codecov](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=h1) Report > Merging [#1144](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=desc) into [master](https://codecov.io/gh/apache/kylin/commit/178c7377d39b004144e54b1c931c92be82fe76de=desc) will **increase** coverage by `0.01%`. > The diff coverage is `23.60%`. [](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#1144 +/- ## + Coverage 25.91% 25.92% +0.01% - Complexity 6521 6595 +74 Files 1456 1475 +19 Lines 8945990159 +700 Branches 1248212578 +96 + Hits 2317923371 +192 - Misses6402264516 +494 - Partials 2258 2272 +14 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...a/org/apache/kylin/cube/CubeCapabilityChecker.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL0N1YmVDYXBhYmlsaXR5Q2hlY2tlci5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...in/java/org/apache/kylin/cube/CubeDescManager.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL0N1YmVEZXNjTWFuYWdlci5qYXZh) | `33.57% <0.00%> (-0.25%)` | `12.00 <0.00> (ø)` | | | [...c/main/java/org/apache/kylin/cube/CubeSegment.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL0N1YmVTZWdtZW50LmphdmE=) | `48.52% <0.00%> (-0.42%)` | `65.00 <0.00> (ø)` | | | [...kylin/cube/gridtable/CuboidToGridTableMapping.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2dyaWR0YWJsZS9DdWJvaWRUb0dyaWRUYWJsZU1hcHBpbmcuamF2YQ==) | `45.13% <ø> (ø)` | `17.00 <0.00> (ø)` | | | [...in/cube/gridtable/CuboidToGridTableMappingExt.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2dyaWR0YWJsZS9DdWJvaWRUb0dyaWRUYWJsZU1hcHBpbmdFeHQuamF2YQ==) | `0.00% <ø> (ø)` | `0.00 <0.00> (ø)` | | | [...che/kylin/cube/gridtable/ScanRangePlannerBase.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2dyaWR0YWJsZS9TY2FuUmFuZ2VQbGFubmVyQmFzZS5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...ain/java/org/apache/kylin/cube/model/CubeDesc.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL21vZGVsL0N1YmVEZXNjLmphdmE=) | `62.29% <0.00%> (-1.52%)` | `182.00 <0.00> (ø)` | | | [...va/org/apache/kylin/cube/util/KeyValueBuilder.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL3V0aWwvS2V5VmFsdWVCdWlsZGVyLmphdmE=) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...e/kylin/gridtable/GTAggregateTransformScanner.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9ncmlkdGFibGUvR1RBZ2dyZWdhdGVUcmFuc2Zvcm1TY2FubmVyLmphdmE=) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (?)` | | | [.../org/apache/kylin/gridtable/GTFunctionScanner.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9ncmlkdGFibGUvR1RGdW5jdGlvblNjYW5uZXIuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | ... and [80 more](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=footer). Last update [178c737...bd0964f](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from
[jira] [Commented] (KYLIN-4281) Precisely set the data type of tuple expression
[ https://issues.apache.org/jira/browse/KYLIN-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115677#comment-17115677 ] ASF GitHub Bot commented on KYLIN-4281: --- codecov-commenter commented on pull request #1144: URL: https://github.com/apache/kylin/pull/1144#issuecomment-633369840 # [Codecov](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=h1) Report > Merging [#1144](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=desc) into [master](https://codecov.io/gh/apache/kylin/commit/178c7377d39b004144e54b1c931c92be82fe76de=desc) will **increase** coverage by `0.01%`. > The diff coverage is `23.60%`. [](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#1144 +/- ## + Coverage 25.91% 25.92% +0.01% - Complexity 6521 6595 +74 Files 1456 1475 +19 Lines 8945990159 +700 Branches 1248212578 +96 + Hits 2317923371 +192 - Misses6402264516 +494 - Partials 2258 2272 +14 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...a/org/apache/kylin/cube/CubeCapabilityChecker.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL0N1YmVDYXBhYmlsaXR5Q2hlY2tlci5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...in/java/org/apache/kylin/cube/CubeDescManager.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL0N1YmVEZXNjTWFuYWdlci5qYXZh) | `33.57% <0.00%> (-0.25%)` | `12.00 <0.00> (ø)` | | | [...c/main/java/org/apache/kylin/cube/CubeSegment.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL0N1YmVTZWdtZW50LmphdmE=) | `48.52% <0.00%> (-0.42%)` | `65.00 <0.00> (ø)` | | | [...kylin/cube/gridtable/CuboidToGridTableMapping.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2dyaWR0YWJsZS9DdWJvaWRUb0dyaWRUYWJsZU1hcHBpbmcuamF2YQ==) | `45.13% <ø> (ø)` | `17.00 <0.00> (ø)` | | | [...in/cube/gridtable/CuboidToGridTableMappingExt.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2dyaWR0YWJsZS9DdWJvaWRUb0dyaWRUYWJsZU1hcHBpbmdFeHQuamF2YQ==) | `0.00% <ø> (ø)` | `0.00 <0.00> (ø)` | | | [...che/kylin/cube/gridtable/ScanRangePlannerBase.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2dyaWR0YWJsZS9TY2FuUmFuZ2VQbGFubmVyQmFzZS5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...ain/java/org/apache/kylin/cube/model/CubeDesc.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL21vZGVsL0N1YmVEZXNjLmphdmE=) | `62.29% <0.00%> (-1.52%)` | `182.00 <0.00> (ø)` | | | [...va/org/apache/kylin/cube/util/KeyValueBuilder.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL3V0aWwvS2V5VmFsdWVCdWlsZGVyLmphdmE=) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...e/kylin/gridtable/GTAggregateTransformScanner.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9ncmlkdGFibGUvR1RBZ2dyZWdhdGVUcmFuc2Zvcm1TY2FubmVyLmphdmE=) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (?)` | | | [.../org/apache/kylin/gridtable/GTFunctionScanner.java](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9ncmlkdGFibGUvR1RGdW5jdGlvblNjYW5uZXIuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | ... and [80 more](https://codecov.io/gh/apache/kylin/pull/1144/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/1144?src=pr=footer). Last update
[jira] [Commented] (KYLIN-4281) Precisely set the data type of tuple expression
[ https://issues.apache.org/jira/browse/KYLIN-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115673#comment-17115673 ] ASF GitHub Bot commented on KYLIN-4281: --- coveralls edited a comment on pull request #1144: URL: https://github.com/apache/kylin/pull/1144#issuecomment-595125477 ## Pull Request Test Coverage Report for [Build 5941](https://coveralls.io/builds/31004475) * **233** of **898** **(25.95%)** changed or added relevant lines in **57** files are covered. * **18** unchanged lines in **11** files lost coverage. * Overall coverage increased (+**0.01%**) to **28.445%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [core-cube/src/main/java/org/apache/kylin/gridtable/GTFunctionScanner.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fgridtable%2FGTFunctionScanner.java#L54) | 0 | 1 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/measure/MeasureType.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmeasure%2FMeasureType.java#L82) | 0 | 1 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/measure/bitmap/BitmapSerializer.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmeasure%2Fbitmap%2FBitmapSerializer.java#L42) | 1 | 2 | 50.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/ColumnTupleExpression.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FColumnTupleExpression.java#L44) | 3 | 4 | 75.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/NoneTupleExpression.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FNoneTupleExpression.java#L30) | 0 | 1 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/RexCallTupleExpression.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FRexCallTupleExpression.java#L31) | 0 | 1 | 0.0% | [core-storage/src/main/java/org/apache/kylin/storage/gtrecord/CubeTupleConverter.java](https://coveralls.io/builds/31004475/source?filename=core-storage%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fgtrecord%2FCubeTupleConverter.java#L119) | 0 | 1 | 0.0% | [query/src/main/java/org/apache/kylin/query/relnode/OLAPUnionRel.java](https://coveralls.io/builds/31004475/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPUnionRel.java#L114) | 0 | 1 | 0.0% | [core-cube/src/main/java/org/apache/kylin/cube/CubeDescManager.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2FCubeDescManager.java#L300) | 0 | 2 | 0.0% | [core-cube/src/main/java/org/apache/kylin/cube/CubeSegment.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2FCubeSegment.java#L360) | 0 | 2 | 0.0% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-cube/src/main/java/org/apache/kylin/cube/CubeDescManager.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2FCubeDescManager.java#L302) | 1 | 38.57% | | [core-cube/src/main/java/org/apache/kylin/gridtable/GTUtil.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fgridtable%2FGTUtil.java#L148) | 1 | 1.34% | | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/RexCallTupleExpression.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FRexCallTupleExpression.java#L32) | 1 | 0% | | [query/src/main/java/org/apache/kylin/query/relnode/OLAPContext.java](https://coveralls.io/builds/31004475/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPContext.java#L196) | 1 | 0% | | [query/src/main/java/org/apache/kylin/query/relnode/OLAPProjectRel.java](https://coveralls.io/builds/31004475/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPProjectRel.java#L205) | 1 | 0% | | [query/src/main/java/org/apache/kylin/query/relnode/OLAPUnionRel.java](https://coveralls.io/builds/31004475/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPUnionRel.java#L115) | 1 | 0% | |
[GitHub] [kylin] coveralls edited a comment on pull request #1144: KYLIN-4281 Precisely set the data type of tuple expression
coveralls edited a comment on pull request #1144: URL: https://github.com/apache/kylin/pull/1144#issuecomment-595125477 ## Pull Request Test Coverage Report for [Build 5941](https://coveralls.io/builds/31004475) * **233** of **898** **(25.95%)** changed or added relevant lines in **57** files are covered. * **18** unchanged lines in **11** files lost coverage. * Overall coverage increased (+**0.01%**) to **28.445%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [core-cube/src/main/java/org/apache/kylin/gridtable/GTFunctionScanner.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fgridtable%2FGTFunctionScanner.java#L54) | 0 | 1 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/measure/MeasureType.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmeasure%2FMeasureType.java#L82) | 0 | 1 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/measure/bitmap/BitmapSerializer.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmeasure%2Fbitmap%2FBitmapSerializer.java#L42) | 1 | 2 | 50.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/ColumnTupleExpression.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FColumnTupleExpression.java#L44) | 3 | 4 | 75.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/NoneTupleExpression.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FNoneTupleExpression.java#L30) | 0 | 1 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/RexCallTupleExpression.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FRexCallTupleExpression.java#L31) | 0 | 1 | 0.0% | [core-storage/src/main/java/org/apache/kylin/storage/gtrecord/CubeTupleConverter.java](https://coveralls.io/builds/31004475/source?filename=core-storage%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fgtrecord%2FCubeTupleConverter.java#L119) | 0 | 1 | 0.0% | [query/src/main/java/org/apache/kylin/query/relnode/OLAPUnionRel.java](https://coveralls.io/builds/31004475/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPUnionRel.java#L114) | 0 | 1 | 0.0% | [core-cube/src/main/java/org/apache/kylin/cube/CubeDescManager.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2FCubeDescManager.java#L300) | 0 | 2 | 0.0% | [core-cube/src/main/java/org/apache/kylin/cube/CubeSegment.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2FCubeSegment.java#L360) | 0 | 2 | 0.0% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-cube/src/main/java/org/apache/kylin/cube/CubeDescManager.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2FCubeDescManager.java#L302) | 1 | 38.57% | | [core-cube/src/main/java/org/apache/kylin/gridtable/GTUtil.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fgridtable%2FGTUtil.java#L148) | 1 | 1.34% | | [core-metadata/src/main/java/org/apache/kylin/metadata/expression/RexCallTupleExpression.java](https://coveralls.io/builds/31004475/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fexpression%2FRexCallTupleExpression.java#L32) | 1 | 0% | | [query/src/main/java/org/apache/kylin/query/relnode/OLAPContext.java](https://coveralls.io/builds/31004475/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPContext.java#L196) | 1 | 0% | | [query/src/main/java/org/apache/kylin/query/relnode/OLAPProjectRel.java](https://coveralls.io/builds/31004475/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPProjectRel.java#L205) | 1 | 0% | | [query/src/main/java/org/apache/kylin/query/relnode/OLAPUnionRel.java](https://coveralls.io/builds/31004475/source?filename=query%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fquery%2Frelnode%2FOLAPUnionRel.java#L115) | 1 | 0% | | [core-cube/src/main/java/org/apache/kylin/cube/gridtable/ScanRangePlannerBase.java](https://coveralls.io/builds/31004475/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fgridtable%2FScanRangePlannerBase.java#L184) | 2 | 0% | |
[jira] [Commented] (KYLIN-4515) could not send mail on ssl port
[
https://issues.apache.org/jira/browse/KYLIN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115671#comment-17115671
]
ASF GitHub Bot commented on KYLIN-4515:
---
chenqingspring edited a comment on pull request #1214:
URL: https://github.com/apache/kylin/pull/1214#issuecomment-632772676
@shaofengshi Hi shaofeng, what do you mean by associating github commit? I'm
trying to rename this issue start with KYLIN-4515, but it seems not editable.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> could not send mail on ssl port
> ---
>
> Key: KYLIN-4515
> URL: https://issues.apache.org/jira/browse/KYLIN-4515
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: v3.0.1
>Reporter: CHEN Qing
>Priority: Minor
> Labels: pull-request-available
> Fix For: v3.0.1
>
>
> Here is context of this
> problem：[https://www.mail-archive.com/user@kylin.apache.org/msg04009.html]
> When I set {{starttlsEnabled}} to true, and specify a ssl port as 465, the
> email could not be sent by this ssl port. It still use 25 default port.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] chenqingspring edited a comment on pull request #1214: KYLIN-4515 fix error with sending mail on ssl
chenqingspring edited a comment on pull request #1214: URL: https://github.com/apache/kylin/pull/1214#issuecomment-632772676 @shaofengshi Hi shaofeng, what do you mean by associating github commit? I'm trying to rename this issue start with KYLIN-4515, but it seems not editable. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4469) Cannot clone model
[ https://issues.apache.org/jira/browse/KYLIN-4469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115669#comment-17115669 ] ASF GitHub Bot commented on KYLIN-4469: --- nichunen merged pull request #1231: URL: https://github.com/apache/kylin/pull/1231 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Cannot clone model > -- > > Key: KYLIN-4469 > URL: https://issues.apache.org/jira/browse/KYLIN-4469 > Project: Kylin > Issue Type: Bug > Components: Website >Reporter: wangrupeng >Assignee: Yaqian Zhang >Priority: Major > Fix For: v3.1.0, v4.0.0-beta > > Attachments: image-2020-04-24-10-27-20-989.png > > Original Estimate: 48h > Remaining Estimate: 48h > > !image-2020-04-24-10-27-20-989.png|width=422,height=303! > When I clone a model, it will throw this error and the model clone failed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4469) Cannot clone model
[ https://issues.apache.org/jira/browse/KYLIN-4469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115667#comment-17115667 ] ASF subversion and git services commented on KYLIN-4469: Commit c3b1f0c0b61dd6665ffaa8f3e41eff8da9d54c3b in kylin's branch refs/heads/master from yaqian.zhang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=c3b1f0c ] KYLIN-4469 Fix clone model error > Cannot clone model > -- > > Key: KYLIN-4469 > URL: https://issues.apache.org/jira/browse/KYLIN-4469 > Project: Kylin > Issue Type: Bug > Components: Website >Reporter: wangrupeng >Assignee: Yaqian Zhang >Priority: Major > Fix For: v3.1.0, v4.0.0-beta > > Attachments: image-2020-04-24-10-27-20-989.png > > Original Estimate: 48h > Remaining Estimate: 48h > > !image-2020-04-24-10-27-20-989.png|width=422,height=303! > When I clone a model, it will throw this error and the model clone failed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] nichunen merged pull request #1231: KYLIN-4469 Fix clone model error
nichunen merged pull request #1231: URL: https://github.com/apache/kylin/pull/1231 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (KYLIN-4469) Cannot clone model
[ https://issues.apache.org/jira/browse/KYLIN-4469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-4469: Fix Version/s: v3.1.0 > Cannot clone model > -- > > Key: KYLIN-4469 > URL: https://issues.apache.org/jira/browse/KYLIN-4469 > Project: Kylin > Issue Type: Bug > Components: Website >Reporter: wangrupeng >Assignee: Yaqian Zhang >Priority: Major > Fix For: v3.1.0, v4.0.0-beta > > Attachments: image-2020-04-24-10-27-20-989.png > > Original Estimate: 48h > Remaining Estimate: 48h > > !image-2020-04-24-10-27-20-989.png|width=422,height=303! > When I clone a model, it will throw this error and the model clone failed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] coveralls commented on pull request #1231: KYLIN-4469 Fix clone model error
coveralls commented on pull request #1231: URL: https://github.com/apache/kylin/pull/1231#issuecomment-633347125 ## Pull Request Test Coverage Report for [Build 5940](https://coveralls.io/builds/31003497) * **0** of **1** **(0.0%)** changed or added relevant line in **1** file are covered. * **8** unchanged lines in **3** files lost coverage. * Overall coverage decreased (**-0.0003%**) to **28.434%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [server-base/src/main/java/org/apache/kylin/rest/controller/ModelController.java](https://coveralls.io/builds/31003497/source?filename=server-base%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Frest%2Fcontroller%2FModelController.java#L211) | 0 | 1 | 0.0% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [server-base/src/main/java/org/apache/kylin/rest/controller/ModelController.java](https://coveralls.io/builds/31003497/source?filename=server-base%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Frest%2Fcontroller%2FModelController.java#L212) | 1 | 0% | | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/31003497/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194) | 2 | 80.23% | | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/31003497/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439) | 5 | 77.81% | | Totals | [](https://coveralls.io/builds/31003497) | | :-- | --: | | Change from base [Build 5937](https://coveralls.io/builds/30987930): | -0.0003% | | Covered Lines: | 25437 | | Relevant Lines: | 89460 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4469) Cannot clone model
[ https://issues.apache.org/jira/browse/KYLIN-4469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115639#comment-17115639 ] ASF GitHub Bot commented on KYLIN-4469: --- coveralls commented on pull request #1231: URL: https://github.com/apache/kylin/pull/1231#issuecomment-633347125 ## Pull Request Test Coverage Report for [Build 5940](https://coveralls.io/builds/31003497) * **0** of **1** **(0.0%)** changed or added relevant line in **1** file are covered. * **8** unchanged lines in **3** files lost coverage. * Overall coverage decreased (**-0.0003%**) to **28.434%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [server-base/src/main/java/org/apache/kylin/rest/controller/ModelController.java](https://coveralls.io/builds/31003497/source?filename=server-base%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Frest%2Fcontroller%2FModelController.java#L211) | 0 | 1 | 0.0% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [server-base/src/main/java/org/apache/kylin/rest/controller/ModelController.java](https://coveralls.io/builds/31003497/source?filename=server-base%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Frest%2Fcontroller%2FModelController.java#L212) | 1 | 0% | | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/31003497/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194) | 2 | 80.23% | | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/31003497/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439) | 5 | 77.81% | | Totals | [](https://coveralls.io/builds/31003497) | | :-- | --: | | Change from base [Build 5937](https://coveralls.io/builds/30987930): | -0.0003% | | Covered Lines: | 25437 | | Relevant Lines: | 89460 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Cannot clone model > -- > > Key: KYLIN-4469 > URL: https://issues.apache.org/jira/browse/KYLIN-4469 > Project: Kylin > Issue Type: Bug > Components: Website >Reporter: wangrupeng >Assignee: Yaqian Zhang >Priority: Major > Fix For: v4.0.0-beta > > Attachments: image-2020-04-24-10-27-20-989.png > > Original Estimate: 48h > Remaining Estimate: 48h > > !image-2020-04-24-10-27-20-989.png|width=422,height=303! > When I clone a model, it will throw this error and the model clone failed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] codecov-commenter commented on pull request #1231: KYLIN-4469 Fix clone model error
codecov-commenter commented on pull request #1231: URL: https://github.com/apache/kylin/pull/1231#issuecomment-633346310 # [Codecov](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=h1) Report > Merging [#1231](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=desc) into [master](https://codecov.io/gh/apache/kylin/commit/7886a2498178ded085497d6204b4b367f56ce0c8=desc) will **increase** coverage by `1.04%`. > The diff coverage is `0.00%`. [](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#1231 +/- ## + Coverage 24.85% 25.90% +1.04% - Complexity 6266 6520 +254 Files 1453 1456 +3 Lines 8922589460 +235 Branches 1245612482 +26 + Hits 2218123175 +994 + Misses6486964026 -843 - Partials 2175 2259 +84 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [.../apache/kylin/rest/controller/ModelController.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3QvY29udHJvbGxlci9Nb2RlbENvbnRyb2xsZXIuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...he/kylin/dict/lookup/cache/RocksDBLookupTable.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y29yZS1kaWN0aW9uYXJ5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9kaWN0L2xvb2t1cC9jYWNoZS9Sb2Nrc0RCTG9va3VwVGFibGUuamF2YQ==) | `72.97% <0.00%> (-5.41%)` | `6.00% <0.00%> (-1.00%)` | | | [...org/apache/kylin/rest/util/QueryRequestLimits.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3QvdXRpbC9RdWVyeVJlcXVlc3RMaW1pdHMuamF2YQ==) | `35.71% <0.00%> (-4.77%)` | `5.00% <0.00%> (-1.00%)` | | | [...he/kylin/job/impl/threadpool/DefaultScheduler.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9pbXBsL3RocmVhZHBvb2wvRGVmYXVsdFNjaGVkdWxlci5qYXZh) | `74.41% <0.00%> (-2.33%)` | `12.00% <0.00%> (ø%)` | | | [.../apache/kylin/cube/cuboid/TreeCuboidScheduler.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2N1Ym9pZC9UcmVlQ3Vib2lkU2NoZWR1bGVyLmphdmE=) | `63.84% <0.00%> (-2.31%)` | `0.00% <0.00%> (ø%)` | | | [...rg/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2lubWVtY3ViaW5nL01lbURpc2tTdG9yZS5qYXZh) | `69.30% <0.00%> (-1.83%)` | `7.00% <0.00%> (ø%)` | | | [.../kylin/cache/memcached/MemcachedChunkingCache.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y2FjaGUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NhY2hlL21lbWNhY2hlZC9NZW1jYWNoZWRDaHVua2luZ0NhY2hlLmphdmE=) | `39.70% <0.00%> (-0.45%)` | `15.00% <0.00%> (ø%)` | | | [...ava/org/apache/kylin/tool/JobDiagnosisInfoCLI.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-dG9vbC9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vdG9vbC9Kb2JEaWFnbm9zaXNJbmZvQ0xJLmphdmE=) | `0.00% <0.00%> (ø)` | `0.00% <0.00%> (ø%)` | | | [.../org/apache/kylin/query/relnode/OLAPTableScan.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-cXVlcnkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3F1ZXJ5L3JlbG5vZGUvT0xBUFRhYmxlU2Nhbi5qYXZh) | `0.00% <0.00%> (ø)` | `0.00% <0.00%> (ø%)` | | | [...va/org/apache/kylin/rest/service/QueryService.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3Qvc2VydmljZS9RdWVyeVNlcnZpY2UuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00% <0.00%> (ø%)` | | | ... and [53 more](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=footer). Last update [7886a24...6c224e0](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
[jira] [Commented] (KYLIN-4469) Cannot clone model
[ https://issues.apache.org/jira/browse/KYLIN-4469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115637#comment-17115637 ] ASF GitHub Bot commented on KYLIN-4469: --- codecov-commenter commented on pull request #1231: URL: https://github.com/apache/kylin/pull/1231#issuecomment-633346310 # [Codecov](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=h1) Report > Merging [#1231](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=desc) into [master](https://codecov.io/gh/apache/kylin/commit/7886a2498178ded085497d6204b4b367f56ce0c8=desc) will **increase** coverage by `1.04%`. > The diff coverage is `0.00%`. [](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#1231 +/- ## + Coverage 24.85% 25.90% +1.04% - Complexity 6266 6520 +254 Files 1453 1456 +3 Lines 8922589460 +235 Branches 1245612482 +26 + Hits 2218123175 +994 + Misses6486964026 -843 - Partials 2175 2259 +84 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [.../apache/kylin/rest/controller/ModelController.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3QvY29udHJvbGxlci9Nb2RlbENvbnRyb2xsZXIuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...he/kylin/dict/lookup/cache/RocksDBLookupTable.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y29yZS1kaWN0aW9uYXJ5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9kaWN0L2xvb2t1cC9jYWNoZS9Sb2Nrc0RCTG9va3VwVGFibGUuamF2YQ==) | `72.97% <0.00%> (-5.41%)` | `6.00% <0.00%> (-1.00%)` | | | [...org/apache/kylin/rest/util/QueryRequestLimits.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3QvdXRpbC9RdWVyeVJlcXVlc3RMaW1pdHMuamF2YQ==) | `35.71% <0.00%> (-4.77%)` | `5.00% <0.00%> (-1.00%)` | | | [...he/kylin/job/impl/threadpool/DefaultScheduler.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9pbXBsL3RocmVhZHBvb2wvRGVmYXVsdFNjaGVkdWxlci5qYXZh) | `74.41% <0.00%> (-2.33%)` | `12.00% <0.00%> (ø%)` | | | [.../apache/kylin/cube/cuboid/TreeCuboidScheduler.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2N1Ym9pZC9UcmVlQ3Vib2lkU2NoZWR1bGVyLmphdmE=) | `63.84% <0.00%> (-2.31%)` | `0.00% <0.00%> (ø%)` | | | [...rg/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2lubWVtY3ViaW5nL01lbURpc2tTdG9yZS5qYXZh) | `69.30% <0.00%> (-1.83%)` | `7.00% <0.00%> (ø%)` | | | [.../kylin/cache/memcached/MemcachedChunkingCache.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-Y2FjaGUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NhY2hlL21lbWNhY2hlZC9NZW1jYWNoZWRDaHVua2luZ0NhY2hlLmphdmE=) | `39.70% <0.00%> (-0.45%)` | `15.00% <0.00%> (ø%)` | | | [...ava/org/apache/kylin/tool/JobDiagnosisInfoCLI.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-dG9vbC9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vdG9vbC9Kb2JEaWFnbm9zaXNJbmZvQ0xJLmphdmE=) | `0.00% <0.00%> (ø)` | `0.00% <0.00%> (ø%)` | | | [.../org/apache/kylin/query/relnode/OLAPTableScan.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-cXVlcnkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3F1ZXJ5L3JlbG5vZGUvT0xBUFRhYmxlU2Nhbi5qYXZh) | `0.00% <0.00%> (ø)` | `0.00% <0.00%> (ø%)` | | | [...va/org/apache/kylin/rest/service/QueryService.java](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3Qvc2VydmljZS9RdWVyeVNlcnZpY2UuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00% <0.00%> (ø%)` | | | ... and [53 more](https://codecov.io/gh/apache/kylin/pull/1231/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/1231?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by
[jira] [Commented] (KYLIN-4515) could not send mail on ssl port
[
https://issues.apache.org/jira/browse/KYLIN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115623#comment-17115623
]
ASF GitHub Bot commented on KYLIN-4515:
---
chenqingspring commented on pull request #1214:
URL: https://github.com/apache/kylin/pull/1214#issuecomment-633341324
@shaofengshi somehow ... this issue name could be changed. Tell me if I
should do anything else?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> could not send mail on ssl port
> ---
>
> Key: KYLIN-4515
> URL: https://issues.apache.org/jira/browse/KYLIN-4515
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: v3.0.1
>Reporter: CHEN Qing
>Priority: Minor
> Labels: pull-request-available
> Fix For: v3.0.1
>
>
> Here is context of this
> problem：[https://www.mail-archive.com/user@kylin.apache.org/msg04009.html]
> When I set {{starttlsEnabled}} to true, and specify a ssl port as 465, the
> email could not be sent by this ssl port. It still use 25 default port.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4469) Cannot clone model
[ https://issues.apache.org/jira/browse/KYLIN-4469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115622#comment-17115622 ] ASF GitHub Bot commented on KYLIN-4469: --- zhangayqian opened a new pull request #1231: URL: https://github.com/apache/kylin/pull/1231 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature request, be sure to link to that issue. ## Types of changes What types of changes does your code introduce to Kylin? _Put an `x` in the boxes that apply_ - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected) - [ ] Documentation Update (if none of the other choices apply) ## Checklist _Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code._ - [ ] I have create an issue on [Kylin's jira](https://issues.apache.org/jira/browse/KYLIN), and have described the bug/feature there in detail - [ ] Commit messages in my PR start with the related jira ID, like "KYLIN- Make Kylin project open-source" - [ ] Compiling and unit tests pass locally with my changes - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] If this change need a document change, I will prepare another pr against the `document` branch - [ ] Any dependent changes have been merged ## Further comments If this is a relatively large or complex change, kick off the discussion at user@kylin or dev@kylin by explaining why you chose the solution you did and what alternatives you considered, etc... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Cannot clone model > -- > > Key: KYLIN-4469 > URL: https://issues.apache.org/jira/browse/KYLIN-4469 > Project: Kylin > Issue Type: Bug > Components: Website >Reporter: wangrupeng >Assignee: Yaqian Zhang >Priority: Major > Fix For: v4.0.0-beta > > Attachments: image-2020-04-24-10-27-20-989.png > > Original Estimate: 48h > Remaining Estimate: 48h > > !image-2020-04-24-10-27-20-989.png|width=422,height=303! > When I clone a model, it will throw this error and the model clone failed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] chenqingspring commented on pull request #1214: KYLIN-4515 fix error with sending mail on ssl
chenqingspring commented on pull request #1214: URL: https://github.com/apache/kylin/pull/1214#issuecomment-633341324 @shaofengshi somehow ... this issue name could be changed. Tell me if I should do anything else? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] zhangayqian opened a new pull request #1231: KYLIN-4469 Fix clone model error
zhangayqian opened a new pull request #1231: URL: https://github.com/apache/kylin/pull/1231 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature request, be sure to link to that issue. ## Types of changes What types of changes does your code introduce to Kylin? _Put an `x` in the boxes that apply_ - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected) - [ ] Documentation Update (if none of the other choices apply) ## Checklist _Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code._ - [ ] I have create an issue on [Kylin's jira](https://issues.apache.org/jira/browse/KYLIN), and have described the bug/feature there in detail - [ ] Commit messages in my PR start with the related jira ID, like "KYLIN- Make Kylin project open-source" - [ ] Compiling and unit tests pass locally with my changes - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] If this change need a document change, I will prepare another pr against the `document` branch - [ ] Any dependent changes have been merged ## Further comments If this is a relatively large or complex change, kick off the discussion at user@kylin or dev@kylin by explaining why you chose the solution you did and what alternatives you considered, etc... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] nichunen merged pull request #1229: Update website RESTful API page
nichunen merged pull request #1229: URL: https://github.com/apache/kylin/pull/1229 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (KYLIN-4493) On HDP3 using spark to build dimension dictionary, it throws NoSuchMethodError.
[
https://issues.apache.org/jira/browse/KYLIN-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhichao Zhang updated KYLIN-4493:
--
Sprint: Sprint 51
> On HDP3 using spark to build dimension dictionary, it throws
> NoSuchMethodError.
> ---
>
> Key: KYLIN-4493
> URL: https://issues.apache.org/jira/browse/KYLIN-4493
> Project: Kylin
> Issue Type: Bug
> Components: Spark Engine
>Affects Versions: v3.0.1, v3.0.2
>Reporter: Zhichao Zhang
>Assignee: Zhichao Zhang
>Priority: Minor
>
> Test env:
> {code:java}
> HDP 3.0.1.0-187
> Hadoop 3.1.1
> Hive 3.1.0
> Kylin 3.0.2
> Spark 2.3.2{code}
>
> Problems:
> when use spark engine and turn on
> *'kylin.engine.spark-dimension-dictionary'*, it will throw error:
> {code:java}
> java.lang.NoSuchMethodError:
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V
> at
> org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:164)
> at
> org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78)
> at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:48)
> at
> org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68)
> at
> org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145)
> at
> org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.buildSnapshotTable(SparkBuildDictionary.java:386)
> at
> org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:367)
> at
> org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:325)
> at
> org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
> at
> org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
> at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
> at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:462)
> at scala.collection.Iterator$class.foreach(Iterator.scala:893)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
> at
> scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
> at
> scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
> at
> scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
> at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
> at scala.collection.AbstractIterator.to(Iterator.scala:1336)
> at
> scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
> at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
> at
> scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
> at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
> at
> org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:945)
> at
> org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:945)
> at
> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2074)
> at
> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2074)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] guangxuCheng commented on pull request #1225: KYLIN-4511 Support project admin user to calculate column cardinality…
guangxuCheng commented on pull request #1225: URL: https://github.com/apache/kylin/pull/1225#issuecomment-64777 @shaofengshi . Any other concerns? Thanks This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4511) Support project admin user to calculate column cardinality by web
[ https://issues.apache.org/jira/browse/KYLIN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115616#comment-17115616 ] ASF GitHub Bot commented on KYLIN-4511: --- guangxuCheng commented on pull request #1225: URL: https://github.com/apache/kylin/pull/1225#issuecomment-64777 @shaofengshi . Any other concerns? Thanks This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Support project admin user to calculate column cardinality by web > - > > Key: KYLIN-4511 > URL: https://issues.apache.org/jira/browse/KYLIN-4511 > Project: Kylin > Issue Type: Improvement > Components: Web >Reporter: Guangxu Cheng >Assignee: Guangxu Cheng >Priority: Major > Fix For: v3.1.0 > > Attachments: image-2020-05-21-13-56-19-962.png, > image-2020-05-21-13-57-29-350.png > > > Now only the administrator of kylin can recalculate the cardinality of the > hive table through the admin web, but the project administrator cannot. > Add an entry to calculate cardinality on the table detail web > # add calculate cardinality button > !image-2020-05-21-13-56-19-962.png|width=902,height=303! > # confirm !image-2020-05-21-13-57-29-350.png|width=901,height=280! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (KYLIN-4485) Create a self service interface for cube migration
[ https://issues.apache.org/jira/browse/KYLIN-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-4485: - Assignee: Zhong Yanghong (was: Zhichao Zhang) > Create a self service interface for cube migration > -- > > Key: KYLIN-4485 > URL: https://issues.apache.org/jira/browse/KYLIN-4485 > Project: Kylin > Issue Type: New Feature > Components: Tools, Build and Test >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v3.1.0 > > Attachments: cube-migration-new.png, cube-migration-old.png > > > Current cube migration process is as follows: > !cube-migration-old.png! > There're a few drawbacks: > * kylin admin has to manually check all related aspects to decide whether a > cube is good for migration. If cube design is not good, there'll be many > interaction between users & kylin admins > * kylin admin has to login to the backend server and then run a command to > do the migration, which is tricky and easy to make mistakes > * there's little compatibility check between source metadata & destination > cluster. > A self service interface will refine the migration process as follows: > !cube-migration-new.png! > We can see with the new migration process, there'll be few interactions > between users & kylin admins and much less work for kylin admins. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4493) On HDP3 using spark to build dimension dictionary, it throws NoSuchMethodError.
[
https://issues.apache.org/jira/browse/KYLIN-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhichao Zhang updated KYLIN-4493:
--
Fix Version/s: (was: v3.1.0)
Sprint: (was: Sprint 51)
> On HDP3 using spark to build dimension dictionary, it throws
> NoSuchMethodError.
> ---
>
> Key: KYLIN-4493
> URL: https://issues.apache.org/jira/browse/KYLIN-4493
> Project: Kylin
> Issue Type: Bug
> Components: Spark Engine
>Affects Versions: v3.0.1, v3.0.2
>Reporter: Zhichao Zhang
>Assignee: Zhichao Zhang
>Priority: Minor
>
> Test env:
> {code:java}
> HDP 3.0.1.0-187
> Hadoop 3.1.1
> Hive 3.1.0
> Kylin 3.0.2
> Spark 2.3.2{code}
>
> Problems:
> when use spark engine and turn on
> *'kylin.engine.spark-dimension-dictionary'*, it will throw error:
> {code:java}
> java.lang.NoSuchMethodError:
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V
> at
> org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:164)
> at
> org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78)
> at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:48)
> at
> org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68)
> at
> org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145)
> at
> org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.buildSnapshotTable(SparkBuildDictionary.java:386)
> at
> org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:367)
> at
> org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:325)
> at
> org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
> at
> org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
> at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
> at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:462)
> at scala.collection.Iterator$class.foreach(Iterator.scala:893)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
> at
> scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
> at
> scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
> at
> scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
> at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
> at scala.collection.AbstractIterator.to(Iterator.scala:1336)
> at
> scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
> at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
> at
> scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
> at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
> at
> org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:945)
> at
> org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$12.apply(RDD.scala:945)
> at
> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2074)
> at
> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2074)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KYLIN-4485) Create a self service interface for cube migration
[ https://issues.apache.org/jira/browse/KYLIN-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4485: -- Sprint: Sprint 51 > Create a self service interface for cube migration > -- > > Key: KYLIN-4485 > URL: https://issues.apache.org/jira/browse/KYLIN-4485 > Project: Kylin > Issue Type: New Feature > Components: Tools, Build and Test >Reporter: Zhong Yanghong >Assignee: Zhichao Zhang >Priority: Major > Fix For: v3.1.0 > > Attachments: cube-migration-new.png, cube-migration-old.png > > > Current cube migration process is as follows: > !cube-migration-old.png! > There're a few drawbacks: > * kylin admin has to manually check all related aspects to decide whether a > cube is good for migration. If cube design is not good, there'll be many > interaction between users & kylin admins > * kylin admin has to login to the backend server and then run a command to > do the migration, which is tricky and easy to make mistakes > * there's little compatibility check between source metadata & destination > cluster. > A self service interface will refine the migration process as follows: > !cube-migration-new.png! > We can see with the new migration process, there'll be few interactions > between users & kylin admins and much less work for kylin admins. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4485) Create a self service interface for cube migration
[ https://issues.apache.org/jira/browse/KYLIN-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4485: -- Fix Version/s: v3.1.0 > Create a self service interface for cube migration > -- > > Key: KYLIN-4485 > URL: https://issues.apache.org/jira/browse/KYLIN-4485 > Project: Kylin > Issue Type: New Feature > Components: Tools, Build and Test >Reporter: Zhong Yanghong >Assignee: Zhichao Zhang >Priority: Major > Fix For: v3.1.0 > > Attachments: cube-migration-new.png, cube-migration-old.png > > > Current cube migration process is as follows: > !cube-migration-old.png! > There're a few drawbacks: > * kylin admin has to manually check all related aspects to decide whether a > cube is good for migration. If cube design is not good, there'll be many > interaction between users & kylin admins > * kylin admin has to login to the backend server and then run a command to > do the migration, which is tricky and easy to make mistakes > * there's little compatibility check between source metadata & destination > cluster. > A self service interface will refine the migration process as follows: > !cube-migration-new.png! > We can see with the new migration process, there'll be few interactions > between users & kylin admins and much less work for kylin admins. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (KYLIN-4485) Create a self service interface for cube migration
[ https://issues.apache.org/jira/browse/KYLIN-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-4485: - Assignee: Zhichao Zhang (was: Zhong Yanghong) > Create a self service interface for cube migration > -- > > Key: KYLIN-4485 > URL: https://issues.apache.org/jira/browse/KYLIN-4485 > Project: Kylin > Issue Type: New Feature > Components: Tools, Build and Test >Reporter: Zhong Yanghong >Assignee: Zhichao Zhang >Priority: Major > Attachments: cube-migration-new.png, cube-migration-old.png > > > Current cube migration process is as follows: > !cube-migration-old.png! > There're a few drawbacks: > * kylin admin has to manually check all related aspects to decide whether a > cube is good for migration. If cube design is not good, there'll be many > interaction between users & kylin admins > * kylin admin has to login to the backend server and then run a command to > do the migration, which is tricky and easy to make mistakes > * there's little compatibility check between source metadata & destination > cluster. > A self service interface will refine the migration process as follows: > !cube-migration-new.png! > We can see with the new migration process, there'll be few interactions > between users & kylin admins and much less work for kylin admins. -- This message was sent by Atlassian Jira (v8.3.4#803005)
