[jira] [Updated] (KYLIN-4442) Kylin System Cube Hive tables not able to update
[ https://issues.apache.org/jira/browse/KYLIN-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sonu Singh updated KYLIN-4442: -- Fix Version/s: v3.1.1 > Kylin System Cube Hive tables not able to update > - > > Key: KYLIN-4442 > URL: https://issues.apache.org/jira/browse/KYLIN-4442 > Project: Kylin > Issue Type: Bug >Affects Versions: v3.0.0 >Reporter: Sonu Singh >Assignee: Sonu Singh >Priority: Minor > Fix For: v3.1.1 > > Attachments: image-2020-04-18-17-26-33-316.png, > kylin-metrics-reporter-hive-3.1.0-SNAPSHOT.jar > > > Kylin System Cube Hive table is not updating. I am using Kylin hadoop3 code > and running on vanilla hadoop3. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] codecov-commenter commented on pull request #1242: Upgrade calcite to 1.16.0-kylin-r5
codecov-commenter commented on pull request #1242: URL: https://github.com/apache/kylin/pull/1242#issuecomment-639245474 # [Codecov](https://codecov.io/gh/apache/kylin/pull/1242?src=pr=h1) Report > Merging [#1242](https://codecov.io/gh/apache/kylin/pull/1242?src=pr=desc) into [master](https://codecov.io/gh/apache/kylin/commit/b53ba2dd4e02a947d112c50fddf2c4685d078e71=desc) will **increase** coverage by `0.83%`. > The diff coverage is `27.76%`. [](https://codecov.io/gh/apache/kylin/pull/1242?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#1242 +/- ## + Coverage 24.87% 25.71% +0.83% - Complexity 6258 6626 +368 Files 1452 1484 +32 Lines 8903691182+2146 Branches 1243712725 +288 + Hits 2215123450+1299 - Misses6470965430 +721 - Partials 2176 2302 +126 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/1242?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...pache/kylin/cache/cachemanager/CacheConstants.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y2FjaGUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NhY2hlL2NhY2hlbWFuYWdlci9DYWNoZUNvbnN0YW50cy5qYXZh) | `0.00% <ø> (ø)` | `0.00 <0.00> (ø)` | | | [.../cachemanager/InstrumentedEhCacheCacheManager.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y2FjaGUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NhY2hlL2NhY2hlbWFuYWdlci9JbnN0cnVtZW50ZWRFaENhY2hlQ2FjaGVNYW5hZ2VyLmphdmE=) | `57.14% <ø> (ø)` | `5.00 <0.00> (ø)` | | | [.../cachemanager/RemoteLocalFailOverCacheManager.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y2FjaGUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NhY2hlL2NhY2hlbWFuYWdlci9SZW1vdGVMb2NhbEZhaWxPdmVyQ2FjaGVNYW5hZ2VyLmphdmE=) | `78.57% <0.00%> (-6.05%)` | `7.00 <0.00> (ø)` | | | [.../kylin/cache/memcached/MemcachedChunkingCache.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y2FjaGUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NhY2hlL21lbWNhY2hlZC9NZW1jYWNoZWRDaHVua2luZ0NhY2hlLmphdmE=) | `39.70% <ø> (-0.45%)` | `15.00 <0.00> (ø)` | | | [...apache/kylin/cache/memcached/MemcachedMetrics.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y2FjaGUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NhY2hlL21lbWNhY2hlZC9NZW1jYWNoZWRNZXRyaWNzLmphdmE=) | `0.00% <ø> (ø)` | `0.00 <0.00> (ø)` | | | [...ache/kylin/common/BackwardCompatibilityConfig.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9CYWNrd2FyZENvbXBhdGliaWxpdHlDb25maWcuamF2YQ==) | `41.81% <ø> (ø)` | `15.00 <0.00> (ø)` | | | [...main/java/org/apache/kylin/common/KylinConfig.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9LeWxpbkNvbmZpZy5qYXZh) | `40.37% <ø> (ø)` | `28.00 <0.00> (ø)` | | | [...ain/java/org/apache/kylin/common/KylinVersion.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9LeWxpblZlcnNpb24uamF2YQ==) | `35.06% <ø> (ø)` | `11.00 <0.00> (ø)` | | | [...ain/java/org/apache/kylin/common/QueryContext.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9RdWVyeUNvbnRleHQuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...va/org/apache/kylin/common/QueryContextFacade.java](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9RdWVyeUNvbnRleHRGYWNhZGUuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | ... and [362 more](https://codecov.io/gh/apache/kylin/pull/1242/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/1242?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/1242?src=pr=footer). Last update [1fce51e...dca9d97](https://codecov.io/gh/apache/kylin/pull/1242?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated
[jira] [Commented] (KYLIN-4477) Usage of "TLS" is insecure
[
https://issues.apache.org/jira/browse/KYLIN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126342#comment-17126342
]
ASF GitHub Bot commented on KYLIN-4477:
---
nichunen commented on pull request #1192:
URL: https://github.com/apache/kylin/pull/1192#issuecomment-639238200
Hi @Mahir92 , I found you have deleted your branch. Would you please open
another pr to fix?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Usage of "TLS" is insecure
> --
>
> Key: KYLIN-4477
> URL: https://issues.apache.org/jira/browse/KYLIN-4477
> Project: Kylin
> Issue Type: Improvement
>Reporter: Md Mahir Asef Kabir
>Assignee: Md Mahir Asef Kabir
>Priority: Major
> Fix For: v3.1.0
>
>
> *Vulnerability Description:* In
> “engine-mr/src/main/java/org/apache/kylin/engine/mr/common/DefaultSslProtocolSocketFactory.java”
> file the following code was written in
> {code:java}
> private static SSLContext createEasySSLContext()
> {code}
> method -
> {code:java}
> SSLContext context = SSLContext.getInstance("TLS");
> {code}
> The vulnerability is, using "TLS” as the argument to SSLContext.getInstance
> method.
> *Reason it’s vulnerable:* TLS 1.0 is vulnerable to man-in-the-middle attacks.
> For further reference, follow
> [this|https://www.comodo.com/e-commerce/ssl-certificates/tls-1-deprecation.php].
> *Suggested Fix:* Using
> {code:java}
> SSLContext.getInstance("TLSv1.3").
> {code}
> *Feedback:* Please select any of the options down below to help us get an
> idea about how you felt about the suggestion -
> # Liked it and will make the suggested changes
> # Liked it but happy with the existing version
> # Didn’t find the suggestion helpful
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] nichunen closed pull request #1192: KYLIN-4477 Resolve Issue: Use secure TLSv1.3 instead of insecure TLS
nichunen closed pull request #1192: URL: https://github.com/apache/kylin/pull/1192 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] nichunen commented on pull request #1192: KYLIN-4477 Resolve Issue: Use secure TLSv1.3 instead of insecure TLS
nichunen commented on pull request #1192: URL: https://github.com/apache/kylin/pull/1192#issuecomment-639238200 Hi @Mahir92 , I found you have deleted your branch. Would you please open another pr to fix? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4477) Usage of "TLS" is insecure
[
https://issues.apache.org/jira/browse/KYLIN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126343#comment-17126343
]
ASF GitHub Bot commented on KYLIN-4477:
---
nichunen closed pull request #1192:
URL: https://github.com/apache/kylin/pull/1192
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Usage of "TLS" is insecure
> --
>
> Key: KYLIN-4477
> URL: https://issues.apache.org/jira/browse/KYLIN-4477
> Project: Kylin
> Issue Type: Improvement
>Reporter: Md Mahir Asef Kabir
>Assignee: Md Mahir Asef Kabir
>Priority: Major
> Fix For: v3.1.0
>
>
> *Vulnerability Description:* In
> “engine-mr/src/main/java/org/apache/kylin/engine/mr/common/DefaultSslProtocolSocketFactory.java”
> file the following code was written in
> {code:java}
> private static SSLContext createEasySSLContext()
> {code}
> method -
> {code:java}
> SSLContext context = SSLContext.getInstance("TLS");
> {code}
> The vulnerability is, using "TLS” as the argument to SSLContext.getInstance
> method.
> *Reason it’s vulnerable:* TLS 1.0 is vulnerable to man-in-the-middle attacks.
> For further reference, follow
> [this|https://www.comodo.com/e-commerce/ssl-certificates/tls-1-deprecation.php].
> *Suggested Fix:* Using
> {code:java}
> SSLContext.getInstance("TLSv1.3").
> {code}
> *Feedback:* Please select any of the options down below to help us get an
> idea about how you felt about the suggestion -
> # Liked it and will make the suggested changes
> # Liked it but happy with the existing version
> # Didn’t find the suggestion helpful
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] zzcclp opened a new pull request #1242: Upgrade calcite to 1.16.0-kylin-r5
zzcclp opened a new pull request #1242: URL: https://github.com/apache/kylin/pull/1242 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature request, be sure to link to that issue. ## Types of changes What types of changes does your code introduce to Kylin? _Put an `x` in the boxes that apply_ - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected) - [ ] Documentation Update (if none of the other choices apply) ## Checklist _Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code._ - [ ] I have create an issue on [Kylin's jira](https://issues.apache.org/jira/browse/KYLIN), and have described the bug/feature there in detail - [ ] Commit messages in my PR start with the related jira ID, like "KYLIN- Make Kylin project open-source" - [ ] Compiling and unit tests pass locally with my changes - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] If this change need a document change, I will prepare another pr against the `document` branch - [ ] Any dependent changes have been merged ## Further comments If this is a relatively large or complex change, kick off the discussion at user@kylin or dev@kylin by explaining why you chose the solution you did and what alternatives you considered, etc... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4441) Add restart command to kylin.sh
[ https://issues.apache.org/jira/browse/KYLIN-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126307#comment-17126307 ] nichunen commented on KYLIN-4441: - Verified. > Add restart command to kylin.sh > --- > > Key: KYLIN-4441 > URL: https://issues.apache.org/jira/browse/KYLIN-4441 > Project: Kylin > Issue Type: Improvement > Components: Client - CLI >Affects Versions: all >Reporter: Yaqian Zhang >Assignee: Yaqian Zhang >Priority: Minor > Fix For: v3.1.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4377) Project's admin cannot operate Hybrid model
[ https://issues.apache.org/jira/browse/KYLIN-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126274#comment-17126274 ] nichunen commented on KYLIN-4377: - Verified. > Project's admin cannot operate Hybrid model > --- > > Key: KYLIN-4377 > URL: https://issues.apache.org/jira/browse/KYLIN-4377 > Project: Kylin > Issue Type: Bug >Reporter: ZhouKang >Assignee: ZhouKang >Priority: Major > Fix For: v3.1.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4312) Specified cube when querying by API
[ https://issues.apache.org/jira/browse/KYLIN-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126270#comment-17126270 ] nichunen commented on KYLIN-4312: - Verified. > Specified cube when querying by API > --- > > Key: KYLIN-4312 > URL: https://issues.apache.org/jira/browse/KYLIN-4312 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Reporter: langdamao >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: v3.1.0 > > > Support specified cube when using query API. > UseCase1: > For CubeA has dim a,b,c,d ,segments 12.01-now，CubeB has dim > b,c,e，segments 12.08-now， with same hive table and same measure. While > querying "select b,c,count(*) from db.table group by b,c; " , will hit CubeB, > so that result of 12.01-12.08 will disappear. > UseCase2: > For testing,build many cubes with different config, will need to > switch disable|enable all the time. > > See discussion here: > http://mail-archives.apache.org/mod_mbox/kylin-user/202001.mbox/%3c976a402f-3d7e-4b99-b87e-d6b39ff2f...@yidian-inc.com%3e -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4252) Fix the error "Cannot read property 'index' of null" in visualization page
[
https://issues.apache.org/jira/browse/KYLIN-4252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126269#comment-17126269
]
nichunen commented on KYLIN-4252:
-
Verified.
> Fix the error "Cannot read property 'index' of null" in visualization page
> --
>
> Key: KYLIN-4252
> URL: https://issues.apache.org/jira/browse/KYLIN-4252
> Project: Kylin
> Issue Type: Bug
> Components: Web
>Affects Versions: v3.0.0
>Reporter: wu.kehua
>Assignee: wu.kehua
>Priority: Major
> Fix For: v2.6.5, v3.1.0, v3.0.1
>
> Attachments: image-2019-12-18-10-07-19-107.png
>
>
> # Execute "select PART_DT,sum(PRICE) from KYLIN_SALES group by PART_DT"
> # Expand "Query String"
> # Then click "visualization" to show the chart
> # If we choose the "-- choose metrics --" firstly, then we reopen Metrics
> drop-down box, then we can't see full metric options.
> !image-2019-12-18-10-07-19-107.png!
>
> Then I analyse this operation will cause the error "Cannot read property
> 'index' of null" in visualization page, as follows:
> {code:java}
> message: "Cannot read property 'index' of null"
> stack: "TypeError: Cannot read property 'index' of null?at
> http://kylin_server:7070/kylin/js/scripts.min.20191108164741.js:55197:69?
> at Object.forEach
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4212) Add a user profile page
[ https://issues.apache.org/jira/browse/KYLIN-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126268#comment-17126268 ] nichunen commented on KYLIN-4212: - Verified. > Add a user profile page > --- > > Key: KYLIN-4212 > URL: https://issues.apache.org/jira/browse/KYLIN-4212 > Project: Kylin > Issue Type: Improvement >Reporter: Congling Xia >Assignee: Congling Xia >Priority: Major > Fix For: v3.1.0 > > Attachments: change_pass.png, entrance.png, profile.png > > > Kylin's user/group API has been extended since KYLIN-4122. User can get more > account details and change password by requesting the APIs. But there is no > webpage for a normal user to view such information or do such changes. > In this improvement, the following changes are desired: > # provide a user profile page to show his/her basic information, > # set a button on it to launch the change password dialog for the user -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4211) PartitionDesc support custom year、month、day partitions name
[
https://issues.apache.org/jira/browse/KYLIN-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126266#comment-17126266
]
nichunen commented on KYLIN-4211:
-
Verified.
> PartitionDesc support custom year、month、day partitions name
> ---
>
> Key: KYLIN-4211
> URL: https://issues.apache.org/jira/browse/KYLIN-4211
> Project: Kylin
> Issue Type: Improvement
>Reporter: chuxiao
>Assignee: chuxiao
>Priority: Major
> Fix For: v3.1.0
>
> Attachments: KYLIN-4211.master.001.patch
>
>
> YearMonthDayPartitionConditionBuilder supports partition named year, month,
> day, but can not support partition names like Y, M, D.
> Because there are user using fact table partitioned by Y, M, D, so add
> CustomYearMonthDayFieldPartitionConditionBuilder, support custom year, month,
> day partitions name.
> Partition metadata in model.json like:
> {
> "uuid" : "459d48c1-a8a6-cdf5-6ea7-e2ae48b248e9",
> "last_modified" : 1571652918478,
> "version" : "2.6.0.20500",
> "name" : "kylin_sales_ymd",
> "owner" : "admin",
> "is_draft" : false,
> "description" : "",
> "fact_table" : "BIGDATA_KYLIN.KYLIN_SALES_YMD",
> "lookups" : [ ],
> "dimensions" : [ {
> "table" : "KYLIN_SALES_YMD",
> "columns" : [ "LEAF_CATEG_ID", "TRANS_ID", "SLR_SEGMENT_CD", "SELLER_ID",
> "BUYER_ID", "OPS_USER_ID", "OPS_REGION", "Y", "M", "D" ]
> } ],
> "metrics" : [ "KYLIN_SALES_YMD.PRICE", "KYLIN_SALES_YMD.ITEM_COUNT" ],
> "filter_condition" : "",
> "partition_desc" : {
> "partition_date_column" : "KYLIN_SALES_YMD.Y, KYLIN_SALES_YMD.M,
> KYLIN_SALES_YMD.D",
> "partition_time_column" : null,
> "partition_date_start" : 0,
> "partition_date_format" : "-MM-dd",
> "partition_time_format" : "HH:mm:ss",
> "partition_type" : "APPEND",
> "partition_condition_builder" :
> "org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder"
> },
> "capacity" : "MEDIUM"
> }
> Partition_date_column is the year, month, and day partition field split by
> ','.， and Partition_condition_builder is
> org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder
> Web can create a normal model and "Edit JSON" on Kylin web
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-3698) check-env.sh should print more details about checking items
[ https://issues.apache.org/jira/browse/KYLIN-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126264#comment-17126264 ] nichunen commented on KYLIN-3698: - Verified. > check-env.sh should print more details about checking items > --- > > Key: KYLIN-3698 > URL: https://issues.apache.org/jira/browse/KYLIN-3698 > Project: Kylin > Issue Type: Improvement > Components: Tools, Build and Test >Affects Versions: v2.5.1 >Reporter: May Zhou >Assignee: Yaqian Zhang >Priority: Minor > Fix For: v3.1.0 > > Original Estimate: 8h > Remaining Estimate: 8h > > In the current version, when users run _check-env.sh_, if there's no error > message, it means everything is OK. > From my perspective, adding more details about the checking items when > executing check-env.sh is better. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4197) DiagnosisInfoCLI block forever at "beeline --version"
[
https://issues.apache.org/jira/browse/KYLIN-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126265#comment-17126265
]
nichunen commented on KYLIN-4197:
-
Verified.
> DiagnosisInfoCLI block forever at "beeline --version"
> -
>
> Key: KYLIN-4197
> URL: https://issues.apache.org/jira/browse/KYLIN-4197
> Project: Kylin
> Issue Type: Improvement
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Minor
> Fix For: v3.1.0, v3.0.1
>
>
> When using "sh bin/diag.sh xxx xxx" in CDH 5.7, it will blocked at "beeline
> --version" in HDP2.4 .
> Executing "beeline --version" will enter interactive shell in some hadoop
> distribution.
> h3. jstack 26111
> {code:java}
> "main" #1 prio=5 os_prio=0 tid=0x7fae18029800 nid=0x6672 waiting on
> condition [0x7fae1cefe000]
>java.lang.Thread.State: TIMED_WAITING (parking)
> at sun.misc.Unsafe.park(Native Method)
> - parking to wait for <0xf4d89348> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at
> java.util.concurrent.ThreadPoolExecutor.awaitTermination(ThreadPoolExecutor.java:1475)
> at
> org.apache.kylin.tool.DiagnosisInfoCLI.executeExtract(DiagnosisInfoCLI.java:266)
> at
> org.apache.kylin.tool.AbstractInfoExtractor.execute(AbstractInfoExtractor.java:117)
> at
> org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
> at
> org.apache.kylin.tool.DiagnosisInfoCLI.main(DiagnosisInfoCLI.java:102)
> {code}
> h3. jps -m
> {code:java}
> [root@cdh-client ~]# jps -m
> 4982 RunJar
> /root/wangrupeng/kylin-spark/KYLIN-4187-hbase/bin/../tomcat/bin/bootstrap.jar
> org.apache.catalina.startup.Bootstrap start
> 6823 ConsoleProducer --topic useraction_3 --broker-list
> cdh-master:9092,cdh-worker-1:9092,cdh-worker-2:9092
> 32408 Bootstrap start
> 26955 BeeLine --version
> 28796 Jps -m
> 26111 DiagnosisInfoCLI -project -all -destDir haha1
> {code}
> h3. std out
> {code:java}
> afb132f0e6f1/recovered.edits/2.seqid
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/root/xiaoxiang.yu/kylin-dist/apache-kylin-3.0.0-SNAPSHOT-bin-4081-master/tool/kylin-tool-3.0.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/opt/cloudera/parcels/CDH-5.7.6-1.cdh5.7.6.p0.6/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M;
> support was removed in 8.0
> Hive 1.1.0-cdh5.7.6
> Subversion
> file:///data/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hive-1.1.0-cdh5.7.6
> -r Unknown
> Compiled by jenkins on Tue Feb 21 14:49:03 PST 2017
> From source with checksum 2e88d4c1b4053829c847d58bf016afd1
> Beeline version 1.2.1.spark2 by Apache Hive
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4352) A empty segment will cause incomplete query result in Realtime OLAP
[ https://issues.apache.org/jira/browse/KYLIN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126070#comment-17126070 ] ASF GitHub Bot commented on KYLIN-4352: --- codecov-commenter commented on pull request #1241: URL: https://github.com/apache/kylin/pull/1241#issuecomment-638976568 # [Codecov](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=h1) Report > Merging [#1241](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=desc) into [master](https://codecov.io/gh/apache/kylin/commit/5731f43fcf350247e76fd7e36b0980d5cf9fc912=desc) will **decrease** coverage by `0.03%`. > The diff coverage is `15.34%`. [](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#1241 +/- ## - Coverage 25.75% 25.71% -0.04% - Complexity 6621 6625 +4 Files 1482 1484 +2 Lines 9094991184 +235 Branches 1268712726 +39 + Hits 2342323448 +25 - Misses6522765433 +206 - Partials 2299 2303 +4 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...in/java/org/apache/kylin/common/util/JsonUtil.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi91dGlsL0pzb25VdGlsLmphdmE=) | `30.43% <ø> (-1.71%)` | `3.00 <0.00> (ø)` | | | [...he/kylin/sdk/datasource/adaptor/PrestoAdaptor.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-ZGF0YXNvdXJjZS1zZGsvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Nkay9kYXRhc291cmNlL2FkYXB0b3IvUHJlc3RvQWRhcHRvci5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (?)` | | | [...k/datasource/framework/SourceConnectorFactory.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-ZGF0YXNvdXJjZS1zZGsvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Nkay9kYXRhc291cmNlL2ZyYW1ld29yay9Tb3VyY2VDb25uZWN0b3JGYWN0b3J5LmphdmE=) | `33.33% <0.00%> (-21.67%)` | `1.00 <1.00> (ø)` | | | [.../org/apache/kylin/query/util/PushDownExecutor.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-cXVlcnkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3F1ZXJ5L3V0aWwvUHVzaERvd25FeGVjdXRvci5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...java/org/apache/kylin/query/util/PushDownUtil.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-cXVlcnkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3F1ZXJ5L3V0aWwvUHVzaERvd25VdGlsLmphdmE=) | `80.48% <0.00%> (ø)` | `4.00 <0.00> (ø)` | | | [...va/org/apache/kylin/rest/service/QueryService.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3Qvc2VydmljZS9RdWVyeVNlcnZpY2UuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [.../apache/kylin/rest/service/StreamingV2Service.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3Qvc2VydmljZS9TdHJlYW1pbmdWMlNlcnZpY2UuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...pache/kylin/storage/stream/StreamStorageQuery.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c3RvcmFnZS1zdHJlYW0vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3N0b3JhZ2Uvc3RyZWFtL1N0cmVhbVN0b3JhZ2VRdWVyeS5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...storage/stream/rpc/HttpStreamDataSearchClient.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c3RvcmFnZS1zdHJlYW0vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3N0b3JhZ2Uvc3RyZWFtL3JwYy9IdHRwU3RyZWFtRGF0YVNlYXJjaENsaWVudC5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...rg/apache/kylin/stream/core/model/DataRequest.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c3RyZWFtLWNvcmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3N0cmVhbS9jb3JlL21vZGVsL0RhdGFSZXF1ZXN0LmphdmE=) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | ... and [13 more](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by
[GitHub] [kylin] codecov-commenter commented on pull request #1241: KYLIN-4352 maxHistorySegmentTime should be reasonable
codecov-commenter commented on pull request #1241: URL: https://github.com/apache/kylin/pull/1241#issuecomment-638976568 # [Codecov](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=h1) Report > Merging [#1241](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=desc) into [master](https://codecov.io/gh/apache/kylin/commit/5731f43fcf350247e76fd7e36b0980d5cf9fc912=desc) will **decrease** coverage by `0.03%`. > The diff coverage is `15.34%`. [](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#1241 +/- ## - Coverage 25.75% 25.71% -0.04% - Complexity 6621 6625 +4 Files 1482 1484 +2 Lines 9094991184 +235 Branches 1268712726 +39 + Hits 2342323448 +25 - Misses6522765433 +206 - Partials 2299 2303 +4 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...in/java/org/apache/kylin/common/util/JsonUtil.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi91dGlsL0pzb25VdGlsLmphdmE=) | `30.43% <ø> (-1.71%)` | `3.00 <0.00> (ø)` | | | [...he/kylin/sdk/datasource/adaptor/PrestoAdaptor.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-ZGF0YXNvdXJjZS1zZGsvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Nkay9kYXRhc291cmNlL2FkYXB0b3IvUHJlc3RvQWRhcHRvci5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (?)` | | | [...k/datasource/framework/SourceConnectorFactory.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-ZGF0YXNvdXJjZS1zZGsvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Nkay9kYXRhc291cmNlL2ZyYW1ld29yay9Tb3VyY2VDb25uZWN0b3JGYWN0b3J5LmphdmE=) | `33.33% <0.00%> (-21.67%)` | `1.00 <1.00> (ø)` | | | [.../org/apache/kylin/query/util/PushDownExecutor.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-cXVlcnkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3F1ZXJ5L3V0aWwvUHVzaERvd25FeGVjdXRvci5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...java/org/apache/kylin/query/util/PushDownUtil.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-cXVlcnkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3F1ZXJ5L3V0aWwvUHVzaERvd25VdGlsLmphdmE=) | `80.48% <0.00%> (ø)` | `4.00 <0.00> (ø)` | | | [...va/org/apache/kylin/rest/service/QueryService.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3Qvc2VydmljZS9RdWVyeVNlcnZpY2UuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [.../apache/kylin/rest/service/StreamingV2Service.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3Qvc2VydmljZS9TdHJlYW1pbmdWMlNlcnZpY2UuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...pache/kylin/storage/stream/StreamStorageQuery.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c3RvcmFnZS1zdHJlYW0vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3N0b3JhZ2Uvc3RyZWFtL1N0cmVhbVN0b3JhZ2VRdWVyeS5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...storage/stream/rpc/HttpStreamDataSearchClient.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c3RvcmFnZS1zdHJlYW0vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3N0b3JhZ2Uvc3RyZWFtL3JwYy9IdHRwU3RyZWFtRGF0YVNlYXJjaENsaWVudC5qYXZh) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | [...rg/apache/kylin/stream/core/model/DataRequest.java](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree#diff-c3RyZWFtLWNvcmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3N0cmVhbS9jb3JlL21vZGVsL0RhdGFSZXF1ZXN0LmphdmE=) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (ø)` | | | ... and [13 more](https://codecov.io/gh/apache/kylin/pull/1241/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=footer). Last update [cef1093...fa41cf9](https://codecov.io/gh/apache/kylin/pull/1241?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
[jira] [Commented] (KYLIN-4352) A empty segment will cause incomplete query result in Realtime OLAP
[ https://issues.apache.org/jira/browse/KYLIN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126041#comment-17126041 ] ASF GitHub Bot commented on KYLIN-4352: --- hit-lacus opened a new pull request #1241: URL: https://github.com/apache/kylin/pull/1241 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature request, be sure to link to that issue. ## Types of changes What types of changes does your code introduce to Kylin? _Put an `x` in the boxes that apply_ - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected) - [ ] Documentation Update (if none of the other choices apply) ## Checklist _Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code._ - [ ] I have create an issue on [Kylin's jira](https://issues.apache.org/jira/browse/KYLIN), and have described the bug/feature there in detail - [ ] Commit messages in my PR start with the related jira ID, like "KYLIN- Make Kylin project open-source" - [ ] Compiling and unit tests pass locally with my changes - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] If this change need a document change, I will prepare another pr against the `document` branch - [ ] Any dependent changes have been merged ## Further comments If this is a relatively large or complex change, kick off the discussion at user@kylin or dev@kylin by explaining why you chose the solution you did and what alternatives you considered, etc... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > A empty segment will cause incomplete query result in Realtime OLAP > --- > > Key: KYLIN-4352 > URL: https://issues.apache.org/jira/browse/KYLIN-4352 > Project: Kylin > Issue Type: Bug > Components: Real-time Streaming >Affects Versions: v3.0.0 >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: v3.1.0 > > > When you query hit a streaming cube, you query will divided into two part, > one historical part, one realtime part. > The boundary of two part is decided by the latest READY segment's *End Time* > . But when you have a segment which segment range is from future(created by > mistake), it will cause all following query get incomplete result. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] hit-lacus opened a new pull request #1241: KYLIN-4352 maxHistorySegmentTime should be reasonable
hit-lacus opened a new pull request #1241: URL: https://github.com/apache/kylin/pull/1241 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature request, be sure to link to that issue. ## Types of changes What types of changes does your code introduce to Kylin? _Put an `x` in the boxes that apply_ - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected) - [ ] Documentation Update (if none of the other choices apply) ## Checklist _Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code._ - [ ] I have create an issue on [Kylin's jira](https://issues.apache.org/jira/browse/KYLIN), and have described the bug/feature there in detail - [ ] Commit messages in my PR start with the related jira ID, like "KYLIN- Make Kylin project open-source" - [ ] Compiling and unit tests pass locally with my changes - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] If this change need a document change, I will prepare another pr against the `document` branch - [ ] Any dependent changes have been merged ## Further comments If this is a relatively large or complex change, kick off the discussion at user@kylin or dev@kylin by explaining why you chose the solution you did and what alternatives you considered, etc... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126029#comment-17126029
]
nichunen edited comment on KYLIN-4480 at 6/4/20, 3:58 PM:
--
Tested with sql
{code:java}
SELECT * FROM
(
SELECT PART_DT, TRANS_ID FROM KYLIN_SALES GROUP BY PART_DT, TRANS_ID
) FACT
LEFT JOIN
(
SELECT CAL_DT as DT_CAL_DT, WEEK_BEG_DT FROM KYLIN_CAL_DT
) DT
ON FACT.PART_DT = DT.DT_CAL_DT AND WEEK_BEG_DT != DATE'2013-03-24'
{code}
!image-2020-06-04-23-57-51-652.png!
was (Author: nichunen):
Tested with sql
{code:java}
SELECT * FROM
(
SELECT PART_DT, TRANS_ID FROM KYLIN_SALES GROUP BY PART_DT, TRANS_ID
) FACT
LEFT JOIN
(
SELECT CAL_DT as DT_CAL_DT, WEEK_BEG_DT FROM KYLIN_CAL_DT
) DT
ON FACT.PART_DT = DT.DT_CAL_DT AND WEEK_BEG_DT = DATE'2013-03-24'
{code}
!image-2020-06-04-23-57-51-652.png!
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
> Attachments: image-2020-06-04-23-57-32-114.png,
> image-2020-06-04-23-57-39-920.png, image-2020-06-04-23-57-51-652.png
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nichunen resolved KYLIN-4480.
-
Resolution: Fixed
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
> Attachments: image-2020-06-04-23-57-32-114.png,
> image-2020-06-04-23-57-39-920.png, image-2020-06-04-23-57-51-652.png
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nichunen updated KYLIN-4480:
Attachment: (was: screenshot-1.png)
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
> Attachments: image-2020-06-04-23-57-32-114.png,
> image-2020-06-04-23-57-39-920.png, image-2020-06-04-23-57-51-652.png
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126029#comment-17126029
]
nichunen edited comment on KYLIN-4480 at 6/4/20, 3:57 PM:
--
Tested with sql
{code:java}
SELECT * FROM
(
SELECT PART_DT, TRANS_ID FROM KYLIN_SALES GROUP BY PART_DT, TRANS_ID
) FACT
LEFT JOIN
(
SELECT CAL_DT as DT_CAL_DT, WEEK_BEG_DT FROM KYLIN_CAL_DT
) DT
ON FACT.PART_DT = DT.DT_CAL_DT AND WEEK_BEG_DT = DATE'2013-03-24'
{code}
!image-2020-06-04-23-57-51-652.png!
was (Author: nichunen):
Tested with sql
{code:java}
SELECT * FROM
(
SELECT PART_DT, TRANS_ID FROM KYLIN_SALES GROUP BY PART_DT, TRANS_ID
) FACT
LEFT JOIN
(
SELECT CAL_DT as DT_CAL_DT, WEEK_BEG_DT FROM KYLIN_CAL_DT
) DT
ON FACT.PART_DT = DT.DT_CAL_DT AND WEEK_BEG_DT = DATE'2013-03-24'
{code}
!screenshot-1.png!
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
> Attachments: image-2020-06-04-23-57-32-114.png,
> image-2020-06-04-23-57-39-920.png, image-2020-06-04-23-57-51-652.png,
> screenshot-1.png
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126029#comment-17126029
]
nichunen commented on KYLIN-4480:
-
Tested with sql
{code:java}
SELECT * FROM
(
SELECT PART_DT, TRANS_ID FROM KYLIN_SALES GROUP BY PART_DT, TRANS_ID
) FACT
LEFT JOIN
(
SELECT CAL_DT as DT_CAL_DT, WEEK_BEG_DT FROM KYLIN_CAL_DT
) DT
ON FACT.PART_DT = DT.DT_CAL_DT AND WEEK_BEG_DT = DATE'2013-03-24'
{code}
!screenshot-1.png!
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
> Attachments: screenshot-1.png
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nichunen updated KYLIN-4480:
Attachment: screenshot-1.png
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
> Attachments: screenshot-1.png
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126026#comment-17126026
]
ASF subversion and git services commented on KYLIN-4480:
Commit 1fce51edf5cfb687b77b2a3f41ca3ce382efd923 in kylin's branch
refs/heads/master from Xian Li
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1fce51e ]
KYLIN-4480 runtime non-equi join
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126027#comment-17126027
]
ASF GitHub Bot commented on KYLIN-4480:
---
nichunen merged pull request #1195:
URL: https://github.com/apache/kylin/pull/1195
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4480) Implement runtime non-equi join
[
https://issues.apache.org/jira/browse/KYLIN-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126025#comment-17126025
]
ASF GitHub Bot commented on KYLIN-4480:
---
nichunen commented on pull request #1195:
URL: https://github.com/apache/kylin/pull/1195#issuecomment-638944042
Reviewed and tested, fine to me.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Implement runtime non-equi join
> ---
>
> Key: KYLIN-4480
> URL: https://issues.apache.org/jira/browse/KYLIN-4480
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Reporter: Li Xian
>Assignee: Li Xian
>Priority: Minor
> Fix For: v3.1.0
>
>
> Currently Kylin does not support non-equi join. This issue is aim to add
> runtime non-equi join feature to Kylin so that queries like
> {code:java}
> select
> |
> non-equi join
> /\
>subquery1 subquery2
> {code}
> can now be executed like below. Kylin will read data from subquery cubes and
> do non-equi join during runtime
> {code:java}
> select
> |
> runtime non-equi join
> /\
>cube1 cube2
> {code}
> I have submitted a PR for this issue
> [https://github.com/apache/kylin/pull/1195]
> [https://github.com/Kyligence/calcite/pull/133]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] nichunen merged pull request #1195: [KYLIN-4480] runtime non-equi join
nichunen merged pull request #1195: URL: https://github.com/apache/kylin/pull/1195 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] nichunen commented on pull request #1195: [KYLIN-4480] runtime non-equi join
nichunen commented on pull request #1195: URL: https://github.com/apache/kylin/pull/1195#issuecomment-638944042 Reviewed and tested, fine to me. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4545) unable to load HiveMetaStore
[ https://issues.apache.org/jira/browse/KYLIN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125999#comment-17125999 ] Xiaoxiang Yu commented on KYLIN-4545: - Can you execute HQL such as "show tables" in hive CLI or beeline, I guess you hive metadata store is not in health state. > unable to load HiveMetaStore > > > Key: KYLIN-4545 > URL: https://issues.apache.org/jira/browse/KYLIN-4545 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v3.0.2 > Environment: hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > We are using the below software to setup kylin environment. > hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 > After configuring everything getting *message: Caused by: > javax.jdo.JDOException: Exception thrown when executing query : SELECT > `A0`.`NAME` FROM `DBS` `A0` WHERE `A0`.`CATALOG_NAME` = ?* this error message. > i have executed below query against hive Metastore to fix the issues. > USE metastore; >ALTER TABLE TBLS ADD REWRITE_ENABLED BIT(1) NOT NULL; >UPDATE TBLS SET REWRITE_ENABLED=IS_REWRITE_ENABLED; >ALTER TABLE DBS ADD CATALOG_NAME varchar(256) not Null; >UPDATE DBS SET CATALOG_NAME=CTLG_NAME; > After that i am able to see the hive tables in kylin model, but i am not able > to Sync the tables. Getting the "can not get Hive TableMeta" error message. > Please help us to fix the issues ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoxiang Yu resolved KYLIN-4491. - Resolution: Fixed > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125985#comment-17125985 ] Xiaoxiang Yu commented on KYLIN-4491: - Merge in https://github.com/apache/kylin/pull/1209 > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125976#comment-17125976 ] Xiaoxiang Yu commented on KYLIN-4491: - https://github.com/apache/kylin/pull/1209 > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125964#comment-17125964 ] ASF subversion and git services commented on KYLIN-4491: Commit cef10935b101d7aaf642ac3c62c196af523f512b in kylin's branch refs/heads/master from fanfanAlice [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cef1093 ] KYLIN-4491 Support presto pushdown (#1209) * KYLIN-4491 Support presto pushdown * KYLIN-4491 add function to default.xml * KYLIN-4491 modify default.xml config * KYLIN-4491 modify getJdbcConnector config Co-authored-by: fanfanAlice <18611532...@163.com> > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] shaofengshi merged pull request #1209: KYLIN-4491 Support presto pushdown
shaofengshi merged pull request #1209: URL: https://github.com/apache/kylin/pull/1209 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125965#comment-17125965 ] ASF subversion and git services commented on KYLIN-4491: Commit cef10935b101d7aaf642ac3c62c196af523f512b in kylin's branch refs/heads/master from fanfanAlice [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cef1093 ] KYLIN-4491 Support presto pushdown (#1209) * KYLIN-4491 Support presto pushdown * KYLIN-4491 add function to default.xml * KYLIN-4491 modify default.xml config * KYLIN-4491 modify getJdbcConnector config Co-authored-by: fanfanAlice <18611532...@163.com> > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125963#comment-17125963 ] ASF subversion and git services commented on KYLIN-4491: Commit cef10935b101d7aaf642ac3c62c196af523f512b in kylin's branch refs/heads/master from fanfanAlice [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cef1093 ] KYLIN-4491 Support presto pushdown (#1209) * KYLIN-4491 Support presto pushdown * KYLIN-4491 add function to default.xml * KYLIN-4491 modify default.xml config * KYLIN-4491 modify getJdbcConnector config Co-authored-by: fanfanAlice <18611532...@163.com> > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125960#comment-17125960 ] ASF GitHub Bot commented on KYLIN-4491: --- shaofengshi merged pull request #1209: URL: https://github.com/apache/kylin/pull/1209 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125961#comment-17125961 ] ASF subversion and git services commented on KYLIN-4491: Commit cef10935b101d7aaf642ac3c62c196af523f512b in kylin's branch refs/heads/master from fanfanAlice [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cef1093 ] KYLIN-4491 Support presto pushdown (#1209) * KYLIN-4491 Support presto pushdown * KYLIN-4491 add function to default.xml * KYLIN-4491 modify default.xml config * KYLIN-4491 modify getJdbcConnector config Co-authored-by: fanfanAlice <18611532...@163.com> > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4491) Query push down to Presto
[ https://issues.apache.org/jira/browse/KYLIN-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125962#comment-17125962 ] ASF subversion and git services commented on KYLIN-4491: Commit cef10935b101d7aaf642ac3c62c196af523f512b in kylin's branch refs/heads/master from fanfanAlice [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cef1093 ] KYLIN-4491 Support presto pushdown (#1209) * KYLIN-4491 Support presto pushdown * KYLIN-4491 add function to default.xml * KYLIN-4491 modify default.xml config * KYLIN-4491 modify getJdbcConnector config Co-authored-by: fanfanAlice <18611532...@163.com> > Query push down to Presto > - > > Key: KYLIN-4491 > URL: https://issues.apache.org/jira/browse/KYLIN-4491 > Project: Kylin > Issue Type: New Feature > Components: Integration, RDBMS Source >Reporter: Shao Feng Shi >Assignee: fanfanAlice >Priority: Major > Fix For: v3.1.0 > > > With the data source SDK, we can push down a query to Presto instead of Hive > or Spark to gain better performance; With the SDK, we can also convert > Kylin's SQL query to Presto SQL. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4545) unable to load HiveMetaStore
praveenece created KYLIN-4545: - Summary: unable to load HiveMetaStore Key: KYLIN-4545 URL: https://issues.apache.org/jira/browse/KYLIN-4545 Project: Kylin Issue Type: Test Components: Environment Affects Versions: v3.0.2 Environment: hadoop-3.2.0 hbase-2.2.0 hive-3.1.0 kylin-3.0.2-bin-hadoop3 Reporter: praveenece We are using the below software to setup kylin environment. hadoop-3.2.0 hbase-2.2.0 hive-3.1.0 kylin-3.0.2-bin-hadoop3 After configuring everything getting *message: Caused by: javax.jdo.JDOException: Exception thrown when executing query : SELECT `A0`.`NAME` FROM `DBS` `A0` WHERE `A0`.`CATALOG_NAME` = ?* this error message. i have executed below query against hive Metastore to fix the issues. USE metastore; ALTER TABLE TBLS ADD REWRITE_ENABLED BIT(1) NOT NULL; UPDATE TBLS SET REWRITE_ENABLED=IS_REWRITE_ENABLED; ALTER TABLE DBS ADD CATALOG_NAME varchar(256) not Null; UPDATE DBS SET CATALOG_NAME=CTLG_NAME; After that i am able to see the hive tables in kylin model, but i am not able to Sync the tables. Getting the "can not get Hive TableMeta" error message. Please help us to fix the issues ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4429) For LEAST_RESTRICTIVE consistency, which is the '=' operator, convert implicitly
[
https://issues.apache.org/jira/browse/KYLIN-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nichunen updated KYLIN-4429:
Fix Version/s: v3.1.0
> For LEAST_RESTRICTIVE consistency, which is the '=' operator, convert
> implicitly
>
>
> Key: KYLIN-4429
> URL: https://issues.apache.org/jira/browse/KYLIN-4429
> Project: Kylin
> Issue Type: Sub-task
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.1.0
>
>
> For the following sql,
> {code}
> select count(*)
> from TEST_KYLIN_FACT
> where cal_dt = date'2012-01-01'
> {code}
> , if the data type of *cal_dt* is varchar, the sql cannot run successfully
> due to no implicitly data type conversion.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (KYLIN-4539) Spark build failed due to com.codahale.metrics.json.MetricsModule loaded from kylin job jar
[
https://issues.apache.org/jira/browse/KYLIN-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nichunen resolved KYLIN-4539.
-
Resolution: Fixed
> Spark build failed due to com.codahale.metrics.json.MetricsModule loaded
> from kylin job jar
>
>
> Key: KYLIN-4539
> URL: https://issues.apache.org/jira/browse/KYLIN-4539
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v3.1.0
>
>
> {code:sh}
> [Loaded com.fasterxml.jackson.databind.Module from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/jackson-databind-2.9.4.jar]
> [Loaded org.apache.kylin.job.shaded.com.fasterxml.jackson.core.Versioned
> from file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded org.apache.kylin.job.shaded.com.fasterxml.jackson.databind.Module
> from file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded com.codahale.metrics.json.MetricsModule from
> file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded java.lang.VerifyError from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> scala.util.control.NonFatal$ from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/scala-library-2.11.8.jar]
> [Loaded org.apache.spark.SparkUserAppException from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/spark-core_2.11-3.12.0.jar]
> [Loaded
> org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4$$anonfun$run$11 from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/spark-yarn_2.11-3.12.0.jar]
> [Loaded org.apache.log4j.spi.ThrowableInformation from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded org.apache.log4j.spi.ThrowableRenderer from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded org.apache.log4j.DefaultThrowableRenderer from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded java.lang.Throwable$PrintStreamOrWriter from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> java.lang.Throwable$WrappedPrintWriter from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> java.io.LineNumberReader from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] User class threw
> exception: java.lang.VerifyError: Bad type on operand stack Exception
> Details: Location:
> org/apache/spark/metrics/sink/MetricsServlet.(Ljava/util/Properties;Lcom/codahale/metrics/MetricRegistry;Lorg/apache/spark/SecurityManager;)V
> @116: invokevirtual Reason: Type 'com/codahale/metrics/json/MetricsModule'
> (current frame, stack[2]) is not assignable to
> 'com/fasterxml/jackson/databind/Module' Current Frame: bci: @116 flags: \{ }
> locals: \{ 'org/apache/spark/metrics/sink/MetricsServlet',
> 'java/util/Properties', 'com/codahale/metrics/MetricRegistry',
> 'org/apache/spark/SecurityManager' } stack: \{
> 'org/apache/spark/metrics/sink/MetricsServlet',
> 'com/fasterxml/jackson/databind/ObjectMapper',
> 'com/codahale/metrics/json/MetricsModule' } Bytecode: 0x000: 2a2b b500
> 2a2a 2cb5 002f 2a2d b500 5c2a 0x010: b700 7e2a 1280 b500 322a 1282 b500
> 342a 0x020: 03b5 0037 2a2b 2ab6 0084 b600 8ab5 0039 0x030: 2ab2 008f
> 2b2a b600 91b6 008a b600 95bb 0x040: 0014 592a b700 96b6 009c bb00 1659
> 2ab7 0x050: 009d b600 a1b8 00a7 b500 3b2a bb00 7159 0x060: b700 a8bb
> 00aa 59b2 00b0 b200 b32a b600 0x070: b5b7 00b8 b600 bcb5 003e b1
> java.lang.VerifyError: Bad type on operand stack Exception Details: Location:
> org/apache/spark/metrics/sink/MetricsServlet.(Ljava/util/Properties;Lcom/codahale/metrics/MetricRegistry;Lorg/apache/spark/SecurityManager;)V
> @116: invokevirtual Reason: Type 'com/codahale/metrics/json/MetricsModule'
> (current frame, stack[2]) is not assignable to
> 'com/fasterxml/jackson/databind/Module' Current Frame: bci: @116 flags: \{ }
> locals: \{ 'org/apache/spark/metrics/sink/MetricsServlet',
> 'java/util/Properties', 'com/codahale/metrics/MetricRegistry',
> 'org/apache/spark/SecurityManager' } stack: \{
> 'org/apache/spark/metrics/sink/MetricsServlet',
> 'com/fasterxml/jackson/databind/ObjectMapper',
> 'com/codahale/metrics/json/MetricsModule' } Bytecode: 0x000: 2a2b b500
> 2a2a 2cb5 002f 2a2d b500 5c2a 0x010: b700 7e2a 1280 b500 322a 1282 b500
> 342a 0x020: 03b5 0037 2a2b 2ab6 0084 b600 8ab5 0039 0x030: 2ab2 008f
> 2b2a b600 91b6 008a b600 95bb 0x040: 0014 592a b700 96b6 009c bb00 1659
> 2ab7 0x050: 009d b600 a1b8 00a7 b500 3b2a bb00 7159 0x060: b700 a8bb
> 00aa 59b2 00b0 b200 b32a b600 0x070: b5b7 00b8 b600 bcb5 003e b1 at
>
[jira] [Commented] (KYLIN-4539) Spark build failed due to com.codahale.metrics.json.MetricsModule loaded from kylin job jar
[
https://issues.apache.org/jira/browse/KYLIN-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125679#comment-17125679
]
ASF subversion and git services commented on KYLIN-4539:
Commit c844743acbf6ffbab46937bded3ac4e0fafa5130 in kylin's branch
refs/heads/master from Guangxu Cheng
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=c844743 ]
KYLIN-4539 Spark build failed due to com.codahale.metrics.json.MetricsModule
loaded from kylin job jar
> Spark build failed due to com.codahale.metrics.json.MetricsModule loaded
> from kylin job jar
>
>
> Key: KYLIN-4539
> URL: https://issues.apache.org/jira/browse/KYLIN-4539
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v3.1.0
>
>
> {code:sh}
> [Loaded com.fasterxml.jackson.databind.Module from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/jackson-databind-2.9.4.jar]
> [Loaded org.apache.kylin.job.shaded.com.fasterxml.jackson.core.Versioned
> from file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded org.apache.kylin.job.shaded.com.fasterxml.jackson.databind.Module
> from file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded com.codahale.metrics.json.MetricsModule from
> file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded java.lang.VerifyError from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> scala.util.control.NonFatal$ from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/scala-library-2.11.8.jar]
> [Loaded org.apache.spark.SparkUserAppException from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/spark-core_2.11-3.12.0.jar]
> [Loaded
> org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4$$anonfun$run$11 from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/spark-yarn_2.11-3.12.0.jar]
> [Loaded org.apache.log4j.spi.ThrowableInformation from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded org.apache.log4j.spi.ThrowableRenderer from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded org.apache.log4j.DefaultThrowableRenderer from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded java.lang.Throwable$PrintStreamOrWriter from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> java.lang.Throwable$WrappedPrintWriter from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> java.io.LineNumberReader from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] User class threw
> exception: java.lang.VerifyError: Bad type on operand stack Exception
> Details: Location:
> org/apache/spark/metrics/sink/MetricsServlet.(Ljava/util/Properties;Lcom/codahale/metrics/MetricRegistry;Lorg/apache/spark/SecurityManager;)V
> @116: invokevirtual Reason: Type 'com/codahale/metrics/json/MetricsModule'
> (current frame, stack[2]) is not assignable to
> 'com/fasterxml/jackson/databind/Module' Current Frame: bci: @116 flags: \{ }
> locals: \{ 'org/apache/spark/metrics/sink/MetricsServlet',
> 'java/util/Properties', 'com/codahale/metrics/MetricRegistry',
> 'org/apache/spark/SecurityManager' } stack: \{
> 'org/apache/spark/metrics/sink/MetricsServlet',
> 'com/fasterxml/jackson/databind/ObjectMapper',
> 'com/codahale/metrics/json/MetricsModule' } Bytecode: 0x000: 2a2b b500
> 2a2a 2cb5 002f 2a2d b500 5c2a 0x010: b700 7e2a 1280 b500 322a 1282 b500
> 342a 0x020: 03b5 0037 2a2b 2ab6 0084 b600 8ab5 0039 0x030: 2ab2 008f
> 2b2a b600 91b6 008a b600 95bb 0x040: 0014 592a b700 96b6 009c bb00 1659
> 2ab7 0x050: 009d b600 a1b8 00a7 b500 3b2a bb00 7159 0x060: b700 a8bb
> 00aa 59b2 00b0 b200 b32a b600 0x070: b5b7 00b8 b600 bcb5 003e b1
> java.lang.VerifyError: Bad type on operand stack Exception Details: Location:
> org/apache/spark/metrics/sink/MetricsServlet.(Ljava/util/Properties;Lcom/codahale/metrics/MetricRegistry;Lorg/apache/spark/SecurityManager;)V
> @116: invokevirtual Reason: Type 'com/codahale/metrics/json/MetricsModule'
> (current frame, stack[2]) is not assignable to
> 'com/fasterxml/jackson/databind/Module' Current Frame: bci: @116 flags: \{ }
> locals: \{ 'org/apache/spark/metrics/sink/MetricsServlet',
> 'java/util/Properties', 'com/codahale/metrics/MetricRegistry',
> 'org/apache/spark/SecurityManager' } stack: \{
> 'org/apache/spark/metrics/sink/MetricsServlet',
> 'com/fasterxml/jackson/databind/ObjectMapper',
> 'com/codahale/metrics/json/MetricsModule' } Bytecode: 0x000: 2a2b b500
> 2a2a 2cb5 002f 2a2d b500 5c2a 0x010: b700 7e2a 1280 b500 322a 1282
[jira] [Commented] (KYLIN-4539) Spark build failed due to com.codahale.metrics.json.MetricsModule loaded from kylin job jar
[
https://issues.apache.org/jira/browse/KYLIN-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125680#comment-17125680
]
ASF GitHub Bot commented on KYLIN-4539:
---
nichunen merged pull request #1237:
URL: https://github.com/apache/kylin/pull/1237
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Spark build failed due to com.codahale.metrics.json.MetricsModule loaded
> from kylin job jar
>
>
> Key: KYLIN-4539
> URL: https://issues.apache.org/jira/browse/KYLIN-4539
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v3.1.0
>
>
> {code:sh}
> [Loaded com.fasterxml.jackson.databind.Module from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/jackson-databind-2.9.4.jar]
> [Loaded org.apache.kylin.job.shaded.com.fasterxml.jackson.core.Versioned
> from file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded org.apache.kylin.job.shaded.com.fasterxml.jackson.databind.Module
> from file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded com.codahale.metrics.json.MetricsModule from
> file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded java.lang.VerifyError from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> scala.util.control.NonFatal$ from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/scala-library-2.11.8.jar]
> [Loaded org.apache.spark.SparkUserAppException from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/spark-core_2.11-3.12.0.jar]
> [Loaded
> org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4$$anonfun$run$11 from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/spark-yarn_2.11-3.12.0.jar]
> [Loaded org.apache.log4j.spi.ThrowableInformation from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded org.apache.log4j.spi.ThrowableRenderer from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded org.apache.log4j.DefaultThrowableRenderer from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded java.lang.Throwable$PrintStreamOrWriter from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> java.lang.Throwable$WrappedPrintWriter from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> java.io.LineNumberReader from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] User class threw
> exception: java.lang.VerifyError: Bad type on operand stack Exception
> Details: Location:
> org/apache/spark/metrics/sink/MetricsServlet.(Ljava/util/Properties;Lcom/codahale/metrics/MetricRegistry;Lorg/apache/spark/SecurityManager;)V
> @116: invokevirtual Reason: Type 'com/codahale/metrics/json/MetricsModule'
> (current frame, stack[2]) is not assignable to
> 'com/fasterxml/jackson/databind/Module' Current Frame: bci: @116 flags: \{ }
> locals: \{ 'org/apache/spark/metrics/sink/MetricsServlet',
> 'java/util/Properties', 'com/codahale/metrics/MetricRegistry',
> 'org/apache/spark/SecurityManager' } stack: \{
> 'org/apache/spark/metrics/sink/MetricsServlet',
> 'com/fasterxml/jackson/databind/ObjectMapper',
> 'com/codahale/metrics/json/MetricsModule' } Bytecode: 0x000: 2a2b b500
> 2a2a 2cb5 002f 2a2d b500 5c2a 0x010: b700 7e2a 1280 b500 322a 1282 b500
> 342a 0x020: 03b5 0037 2a2b 2ab6 0084 b600 8ab5 0039 0x030: 2ab2 008f
> 2b2a b600 91b6 008a b600 95bb 0x040: 0014 592a b700 96b6 009c bb00 1659
> 2ab7 0x050: 009d b600 a1b8 00a7 b500 3b2a bb00 7159 0x060: b700 a8bb
> 00aa 59b2 00b0 b200 b32a b600 0x070: b5b7 00b8 b600 bcb5 003e b1
> java.lang.VerifyError: Bad type on operand stack Exception Details: Location:
> org/apache/spark/metrics/sink/MetricsServlet.(Ljava/util/Properties;Lcom/codahale/metrics/MetricRegistry;Lorg/apache/spark/SecurityManager;)V
> @116: invokevirtual Reason: Type 'com/codahale/metrics/json/MetricsModule'
> (current frame, stack[2]) is not assignable to
> 'com/fasterxml/jackson/databind/Module' Current Frame: bci: @116 flags: \{ }
> locals: \{ 'org/apache/spark/metrics/sink/MetricsServlet',
> 'java/util/Properties', 'com/codahale/metrics/MetricRegistry',
> 'org/apache/spark/SecurityManager' } stack: \{
> 'org/apache/spark/metrics/sink/MetricsServlet',
> 'com/fasterxml/jackson/databind/ObjectMapper',
> 'com/codahale/metrics/json/MetricsModule' }
[GitHub] [kylin] nichunen merged pull request #1237: KYLIN-4539 Spark build failed due to com.codahale.metrics.json.Metric…
nichunen merged pull request #1237: URL: https://github.com/apache/kylin/pull/1237 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4539) Spark build failed due to com.codahale.metrics.json.MetricsModule loaded from kylin job jar
[
https://issues.apache.org/jira/browse/KYLIN-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125678#comment-17125678
]
ASF GitHub Bot commented on KYLIN-4539:
---
nichunen commented on pull request #1237:
URL: https://github.com/apache/kylin/pull/1237#issuecomment-638692522
Approved
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Spark build failed due to com.codahale.metrics.json.MetricsModule loaded
> from kylin job jar
>
>
> Key: KYLIN-4539
> URL: https://issues.apache.org/jira/browse/KYLIN-4539
> Project: Kylin
> Issue Type: Bug
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
> Fix For: v3.1.0
>
>
> {code:sh}
> [Loaded com.fasterxml.jackson.databind.Module from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/jackson-databind-2.9.4.jar]
> [Loaded org.apache.kylin.job.shaded.com.fasterxml.jackson.core.Versioned
> from file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded org.apache.kylin.job.shaded.com.fasterxml.jackson.databind.Module
> from file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded com.codahale.metrics.json.MetricsModule from
> file:/data8/yarnenv/local/filecache/533839/kylin-job-3.1.0-SNAPSHOT.jar]
> [Loaded java.lang.VerifyError from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> scala.util.control.NonFatal$ from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/scala-library-2.11.8.jar]
> [Loaded org.apache.spark.SparkUserAppException from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/spark-core_2.11-3.12.0.jar]
> [Loaded
> org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4$$anonfun$run$11 from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/spark-yarn_2.11-3.12.0.jar]
> [Loaded org.apache.log4j.spi.ThrowableInformation from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded org.apache.log4j.spi.ThrowableRenderer from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded org.apache.log4j.DefaultThrowableRenderer from
> file:/data6/yarnenv/local/filecache/533549/spark-jars.zip/log4j-1.2.17.jar]
> [Loaded java.lang.Throwable$PrintStreamOrWriter from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> java.lang.Throwable$WrappedPrintWriter from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] [Loaded
> java.io.LineNumberReader from
> /data/gaiaadmin/gaiaenv/jdk1.8.0_181/jre/lib/rt.jar] User class threw
> exception: java.lang.VerifyError: Bad type on operand stack Exception
> Details: Location:
> org/apache/spark/metrics/sink/MetricsServlet.(Ljava/util/Properties;Lcom/codahale/metrics/MetricRegistry;Lorg/apache/spark/SecurityManager;)V
> @116: invokevirtual Reason: Type 'com/codahale/metrics/json/MetricsModule'
> (current frame, stack[2]) is not assignable to
> 'com/fasterxml/jackson/databind/Module' Current Frame: bci: @116 flags: \{ }
> locals: \{ 'org/apache/spark/metrics/sink/MetricsServlet',
> 'java/util/Properties', 'com/codahale/metrics/MetricRegistry',
> 'org/apache/spark/SecurityManager' } stack: \{
> 'org/apache/spark/metrics/sink/MetricsServlet',
> 'com/fasterxml/jackson/databind/ObjectMapper',
> 'com/codahale/metrics/json/MetricsModule' } Bytecode: 0x000: 2a2b b500
> 2a2a 2cb5 002f 2a2d b500 5c2a 0x010: b700 7e2a 1280 b500 322a 1282 b500
> 342a 0x020: 03b5 0037 2a2b 2ab6 0084 b600 8ab5 0039 0x030: 2ab2 008f
> 2b2a b600 91b6 008a b600 95bb 0x040: 0014 592a b700 96b6 009c bb00 1659
> 2ab7 0x050: 009d b600 a1b8 00a7 b500 3b2a bb00 7159 0x060: b700 a8bb
> 00aa 59b2 00b0 b200 b32a b600 0x070: b5b7 00b8 b600 bcb5 003e b1
> java.lang.VerifyError: Bad type on operand stack Exception Details: Location:
> org/apache/spark/metrics/sink/MetricsServlet.(Ljava/util/Properties;Lcom/codahale/metrics/MetricRegistry;Lorg/apache/spark/SecurityManager;)V
> @116: invokevirtual Reason: Type 'com/codahale/metrics/json/MetricsModule'
> (current frame, stack[2]) is not assignable to
> 'com/fasterxml/jackson/databind/Module' Current Frame: bci: @116 flags: \{ }
> locals: \{ 'org/apache/spark/metrics/sink/MetricsServlet',
> 'java/util/Properties', 'com/codahale/metrics/MetricRegistry',
> 'org/apache/spark/SecurityManager' } stack: \{
> 'org/apache/spark/metrics/sink/MetricsServlet',
> 'com/fasterxml/jackson/databind/ObjectMapper',
>
[GitHub] [kylin] nichunen commented on pull request #1237: KYLIN-4539 Spark build failed due to com.codahale.metrics.json.Metric…
nichunen commented on pull request #1237: URL: https://github.com/apache/kylin/pull/1237#issuecomment-638692522 Approved This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
