[jira] [Created] (KYLIN-3530) All cubes disabled but table still can be seen in Insight page
Na Zhai created KYLIN-3530: -- Summary: All cubes disabled but table still can be seen in Insight page Key: KYLIN-3530 URL: https://issues.apache.org/jira/browse/KYLIN-3530 Project: Kylin Issue Type: Bug Reporter: Na Zhai When I disable all cubes with table KYLIN_SALES,KYLIN_SALES still can be seen in Insight page -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (KYLIN-3529) Prompt not friendly
[ https://issues.apache.org/jira/browse/KYLIN-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Zhai reassigned KYLIN-3529: -- Assignee: Chao Long > Prompt not friendly > --- > > Key: KYLIN-3529 > URL: https://issues.apache.org/jira/browse/KYLIN-3529 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: Na Zhai >Assignee: Chao Long >Priority: Major > > *Scene 1:*When I create a hybrid with duplicate name, then I click submit, > the error message "error execute org.apache.kylin.rest.job.HybridCubeCLI" > will pop up. > > *Scene 2:*When I create a hybrid with duplicate date/time cube, then I click > submit, the error message "error execute > org.apache.kylin.rest.job.HybridCubeCLI" will pop up. > > I think the error message should be more friendly. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3529) Prompt not friendly
Na Zhai created KYLIN-3529: -- Summary: Prompt not friendly Key: KYLIN-3529 URL: https://issues.apache.org/jira/browse/KYLIN-3529 Project: Kylin Issue Type: Bug Components: Web Reporter: Na Zhai *Scene 1:*When I create a hybrid with duplicate name, then I click submit, the error message "error execute org.apache.kylin.rest.job.HybridCubeCLI" will pop up. *Scene 2:*When I create a hybrid with duplicate date/time cube, then I click submit, the error message "error execute org.apache.kylin.rest.job.HybridCubeCLI" will pop up. I think the error message should be more friendly. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube
[ https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602569#comment-16602569 ] ASF GitHub Bot commented on KYLIN-3527: --- luguosheng1314 closed pull request #220: KYLIN-3527 fix grunt script - font build URL: https://github.com/apache/kylin/pull/220 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/webapp/Gruntfile.js b/webapp/Gruntfile.js index d871f4f934..a977a7321e 100644 --- a/webapp/Gruntfile.js +++ b/webapp/Gruntfile.js @@ -105,6 +105,12 @@ module.exports = function (grunt) { src: ['fonts/*'], dest: 'dist/' }, + { +expand: true, +cwd: 'app', +src: ['fonts/*'], +dest: 'dist/' + }, { expand: true, cwd: 'app/components/ace/', This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Hybrid couldn't save when there is only 1 cube > -- > > Key: KYLIN-3527 > URL: https://issues.apache.org/jira/browse/KYLIN-3527 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Roger >Priority: Minor > Fix For: v2.5.0 > > Attachments: hybrid-not-saved.png, move-in-out-icons.png > > > I created a hybrid with two cubes; Later I want to remove one cube from it, > but I found when there is only 1 cube, the "Submit" button was disabled. > > The hybrid should allows 0, 1 or more cubes. > > Besides, I found the move in and out icons were not properly displayed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube
[ https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602563#comment-16602563 ] ASF GitHub Bot commented on KYLIN-3527: --- Emiya0306 opened a new pull request #220: KYLIN-3527 fix grunt script - font build URL: https://github.com/apache/kylin/pull/220 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Hybrid couldn't save when there is only 1 cube > -- > > Key: KYLIN-3527 > URL: https://issues.apache.org/jira/browse/KYLIN-3527 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Roger >Priority: Minor > Fix For: v2.5.0 > > Attachments: hybrid-not-saved.png, move-in-out-icons.png > > > I created a hybrid with two cubes; Later I want to remove one cube from it, > but I found when there is only 1 cube, the "Submit" button was disabled. > > The hybrid should allows 0, 1 or more cubes. > > Besides, I found the move in and out icons were not properly displayed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube
[ https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602564#comment-16602564 ] ASF GitHub Bot commented on KYLIN-3527: --- asfgit commented on issue #220: KYLIN-3527 fix grunt script - font build URL: https://github.com/apache/kylin/pull/220#issuecomment-418227622 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Hybrid couldn't save when there is only 1 cube > -- > > Key: KYLIN-3527 > URL: https://issues.apache.org/jira/browse/KYLIN-3527 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Roger >Priority: Minor > Fix For: v2.5.0 > > Attachments: hybrid-not-saved.png, move-in-out-icons.png > > > I created a hybrid with two cubes; Later I want to remove one cube from it, > but I found when there is only 1 cube, the "Submit" button was disabled. > > The hybrid should allows 0, 1 or more cubes. > > Besides, I found the move in and out icons were not properly displayed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (KYLIN-3528) No details page for hybrid
[ https://issues.apache.org/jira/browse/KYLIN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Zhai reassigned KYLIN-3528: -- Assignee: Roger > No details page for hybrid > -- > > Key: KYLIN-3528 > URL: https://issues.apache.org/jira/browse/KYLIN-3528 > Project: Kylin > Issue Type: Improvement > Components: Web >Reporter: Na Zhai >Assignee: Roger >Priority: Major > > When I click hybrid name, there is no detail page for that hybrid. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3528) No details page for hybrid
Na Zhai created KYLIN-3528: -- Summary: No details page for hybrid Key: KYLIN-3528 URL: https://issues.apache.org/jira/browse/KYLIN-3528 Project: Kylin Issue Type: Improvement Components: Web Reporter: Na Zhai When I click hybrid name, there is no detail page for that hybrid. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (KYLIN-3526) No check for hybrid name with special character
[ https://issues.apache.org/jira/browse/KYLIN-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Zhai reassigned KYLIN-3526: -- Assignee: Roger > No check for hybrid name with special character > --- > > Key: KYLIN-3526 > URL: https://issues.apache.org/jira/browse/KYLIN-3526 > Project: Kylin > Issue Type: Improvement > Components: Web >Reporter: Na Zhai >Assignee: Roger >Priority: Major > Attachments: 名称没做限制.png > > > When create hybrid,there is no check for hybrid name with special character. > Such as !@&. > Hybrid can be created successfully with name like hy! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube
[ https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI reassigned KYLIN-3527: --- Assignee: Roger Fix Version/s: v2.5.0 > Hybrid couldn't save when there is only 1 cube > -- > > Key: KYLIN-3527 > URL: https://issues.apache.org/jira/browse/KYLIN-3527 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Roger >Priority: Minor > Fix For: v2.5.0 > > Attachments: hybrid-not-saved.png, move-in-out-icons.png > > > I created a hybrid with two cubes; Later I want to remove one cube from it, > but I found when there is only 1 cube, the "Submit" button was disabled. > > The hybrid should allows 0, 1 or more cubes. > > Besides, I found the move in and out icons were not properly displayed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube
[ https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3527: Attachment: move-in-out-icons.png > Hybrid couldn't save when there is only 1 cube > -- > > Key: KYLIN-3527 > URL: https://issues.apache.org/jira/browse/KYLIN-3527 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Priority: Minor > Fix For: v2.5.0 > > Attachments: hybrid-not-saved.png, move-in-out-icons.png > > > I created a hybrid with two cubes; Later I want to remove one cube from it, > but I found when there is only 1 cube, the "Submit" button was disabled. > > The hybrid should allows 0, 1 or more cubes. > > Besides, I found the move in and out icons were not properly displayed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube
[ https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3527: Attachment: hybrid-not-saved.png > Hybrid couldn't save when there is only 1 cube > -- > > Key: KYLIN-3527 > URL: https://issues.apache.org/jira/browse/KYLIN-3527 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Priority: Minor > Attachments: hybrid-not-saved.png > > > I created a hybrid with two cubes; Later I want to remove one cube from it, > but I found when there is only 1 cube, the "Submit" button was disabled. > > The hybrid should allows 0, 1 or more cubes. > > Besides, I found the move in and out icons were not properly displayed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube
Shaofeng SHI created KYLIN-3527: --- Summary: Hybrid couldn't save when there is only 1 cube Key: KYLIN-3527 URL: https://issues.apache.org/jira/browse/KYLIN-3527 Project: Kylin Issue Type: Bug Components: Web Affects Versions: v2.5.0 Reporter: Shaofeng SHI Attachments: hybrid-not-saved.png I created a hybrid with two cubes; Later I want to remove one cube from it, but I found when there is only 1 cube, the "Submit" button was disabled. The hybrid should allows 0, 1 or more cubes. Besides, I found the move in and out icons were not properly displayed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3521) Enable Cube Planner by default
[ https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602516#comment-16602516 ] ASF subversion and git services commented on KYLIN-3521: Commit 94afb6b9ca1beb26ca3d5a8238a0a9a499e61813 in kylin's branch refs/heads/master from Ma,Gang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=94afb6b ] KYLIN-3521 Enable Cube Planner by default > Enable Cube Planner by default > -- > > Key: KYLIN-3521 > URL: https://issues.apache.org/jira/browse/KYLIN-3521 > Project: Kylin > Issue Type: Improvement >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3521_V2.patch > > > Cube planner can significantly reduce the cuboid number that to build. As it > wasn't enabled by default in 2.3 and 2.4, many users don't know that. > > To let more user to start using it, I suggest to enable it by default. > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3521) Enable Cube Planner by default
[ https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3521: Attachment: (was: KYLIN-3521.patch) > Enable Cube Planner by default > -- > > Key: KYLIN-3521 > URL: https://issues.apache.org/jira/browse/KYLIN-3521 > Project: Kylin > Issue Type: Improvement >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3521_V2.patch > > > Cube planner can significantly reduce the cuboid number that to build. As it > wasn't enabled by default in 2.3 and 2.4, many users don't know that. > > To let more user to start using it, I suggest to enable it by default. > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3526) No check for hybrid name with special character
Na Zhai created KYLIN-3526: -- Summary: No check for hybrid name with special character Key: KYLIN-3526 URL: https://issues.apache.org/jira/browse/KYLIN-3526 Project: Kylin Issue Type: Improvement Components: Web Reporter: Na Zhai Attachments: 名称没做限制.png When create hybrid,there is no check for hybrid name with special character. Such as !@&. Hybrid can be created successfully with name like hy! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3504) Release 2.4.1
[ https://issues.apache.org/jira/browse/KYLIN-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602134#comment-16602134 ] ASF subversion and git services commented on KYLIN-3504: Commit 175e30d09af118b7813c4045603589fb41d2b255 in kylin's branch refs/heads/v2.4.1-release from root [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=175e30d ] KYLIN-3504 update Yanghong Zhong public keys to KEYS > Release 2.4.1 > - > > Key: KYLIN-3504 > URL: https://issues.apache.org/jira/browse/KYLIN-3504 > Project: Kylin > Issue Type: Task >Reporter: Shaofeng SHI >Assignee: Zhong Yanghong >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3521) Enable Cube Planner by default
[ https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602126#comment-16602126 ] ASF subversion and git services commented on KYLIN-3521: Commit 41b4ffe27c20521bf0c676935b34a6bbcdbf2d51 in kylin's branch refs/heads/2.5.x from Ma,Gang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=41b4ffe ] KYLIN-3521 Enable Cube Planner by default > Enable Cube Planner by default > -- > > Key: KYLIN-3521 > URL: https://issues.apache.org/jira/browse/KYLIN-3521 > Project: Kylin > Issue Type: Improvement >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3521.patch, KYLIN-3521_V2.patch > > > Cube planner can significantly reduce the cuboid number that to build. As it > wasn't enabled by default in 2.3 and 2.4, many users don't know that. > > To let more user to start using it, I suggest to enable it by default. > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3521) Enable Cube Planner by default
[ https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602041#comment-16602041 ] Ma Gang commented on KYLIN-3521: Thanks [~Shaofengshi], upload the new patch, please review, also set the "kylin.cube.cubeplanner.enabled-for-existing-cube" to true. > Enable Cube Planner by default > -- > > Key: KYLIN-3521 > URL: https://issues.apache.org/jira/browse/KYLIN-3521 > Project: Kylin > Issue Type: Improvement >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3521.patch, KYLIN-3521_V2.patch > > > Cube planner can significantly reduce the cuboid number that to build. As it > wasn't enabled by default in 2.3 and 2.4, many users don't know that. > > To let more user to start using it, I suggest to enable it by default. > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3521) Enable Cube Planner by default
[ https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ma Gang updated KYLIN-3521: --- Attachment: KYLIN-3521_V2.patch > Enable Cube Planner by default > -- > > Key: KYLIN-3521 > URL: https://issues.apache.org/jira/browse/KYLIN-3521 > Project: Kylin > Issue Type: Improvement >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3521.patch, KYLIN-3521_V2.patch > > > Cube planner can significantly reduce the cuboid number that to build. As it > wasn't enabled by default in 2.3 and 2.4, many users don't know that. > > To let more user to start using it, I suggest to enable it by default. > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (KYLIN-3491) Improve the cube building process when using global dictionary
[ https://issues.apache.org/jira/browse/KYLIN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI resolved KYLIN-3491. - Resolution: Fixed > Improve the cube building process when using global dictionary > -- > > Key: KYLIN-3491 > URL: https://issues.apache.org/jira/browse/KYLIN-3491 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v2.5.0 > > Attachments: APACHE-KYLIN-3491-with-fix.patch, APACHE-KYLIN-3491.patch > > > By current cubing process, if the global dictionary is very large, since the > raw data records are unsorted, it's hard to encode raw values into ids for > the input of bitmap due to frequent swap of the dictionary slices. We need a > refined process. The idea is as follows: > # for each source data block, there will be a mapper generating the distinct > values & sort them > # encode the sorted distinct values and generate a shrunken dict for each > source data block. > # when building base cuboid, use the shrunken dict for each source data > block for encoding. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3299) When a column in int data type and encoding as date may will lead build wrong value
[ https://issues.apache.org/jira/browse/KYLIN-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3299: Fix Version/s: (was: v2.5.0) Future > When a column in int data type and encoding as date may will lead build wrong > value > --- > > Key: KYLIN-3299 > URL: https://issues.apache.org/jira/browse/KYLIN-3299 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Reporter: jiatao.tao >Assignee: jiatao.tao >Priority: Major > Fix For: Future > > > When the year is less than 1000, build and query will result 1970. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3140) Auto merge jobs should not block user build jobs
[ https://issues.apache.org/jira/browse/KYLIN-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3140: Fix Version/s: (was: v2.5.0) Backlog > Auto merge jobs should not block user build jobs > > > Key: KYLIN-3140 > URL: https://issues.apache.org/jira/browse/KYLIN-3140 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Reporter: Wang, Gang >Assignee: Shaofeng SHI >Priority: Major > Fix For: Backlog > > > Although in the latest version, Kylin support concurrent jobs. If the > concurrency is set to 1, there is some possibility that cube build job will > have dead lock. Say, when there is some issue which causes merge job failed, > even when you discard the job, another job will be launched and failed again > due to auto merge policy. And this failed merge job blocks user to build > incremental segment. > Even if the concurrency is set to larger than 1, the auto merge jobs occupy > some concurrency quota. > While, from user perspective, they don't care much about the auto merge jobs, > and the auto merge jobs should not block the building/refresh jobs they > submit manually. > A better way may be separating the auto merge jobs from the job queue, > parameter max-building-segments only limit jobs submitted by users. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3253) Enabling DEBUG in kylin-server-log4j.properties results in NPE in Calcite layer during query execution
[ https://issues.apache.org/jira/browse/KYLIN-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3253: Fix Version/s: (was: v2.5.0) Backlog > Enabling DEBUG in kylin-server-log4j.properties results in NPE in Calcite > layer during query execution > -- > > Key: KYLIN-3253 > URL: https://issues.apache.org/jira/browse/KYLIN-3253 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: v2.2.0 > Environment: HDP 2.5.6, Kylin 2.2 >Reporter: Vsevolod Ostapenko >Assignee: Yifei Wu >Priority: Major > Fix For: Backlog > > > If log4j root logger is set to DEBUG level in the > kylin-server-log4j.properties attempt to run a query after that results in a > failure with an NPE being triggered in the calcite layer (see stack trace > below). > The issue was fixed in Calcite 1.14 as > https://issues.apache.org/jira/browse/CALCITE-1859 > It's a one line change to > core/src/main/java/org/apache/calcite/plan/volcano/VolcanoPlanner.java > Since Kylin is packaging it's own fork of Calcite from > [http://repository.kyligence.io|http://repository.kyligence.io/], the fix > need to be ported to 1.13.0-kylin-r-SPANSHOT.jar by someone who has access > to this forked repo. > {quote} at > org.apache.calcite.avatica.Helper.createException(Helper.java:56) > at > org.apache.calcite.avatica.Helper.createException(Helper.java:41) > at > org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156) > at > org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218) > at > org.apache.kylin.rest.service.QueryService.execute(QueryService.java:834) > at > org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:561) > at > org.apache.kylin.rest.service.QueryService.query(QueryService.java:181) > at > org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:415) > at > org.apache.kylin.rest.controller.QueryController.query(QueryController.java:78) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) > at > org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85) > at > org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967) > at > org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901) > at > org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970) > at > org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872) > at > javax.servlet.http.HttpServlet.service(HttpServlet.java:650) > at > org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846) > at > javax.servlet.http.HttpServlet.service(HttpServlet.java:731) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > at > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at >
[jira] [Updated] (KYLIN-2973) Potential issue of not atomically update cube instance map
[ https://issues.apache.org/jira/browse/KYLIN-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-2973: Fix Version/s: (was: v2.5.0) Backlog > Potential issue of not atomically update cube instance map > -- > > Key: KYLIN-2973 > URL: https://issues.apache.org/jira/browse/KYLIN-2973 > Project: Kylin > Issue Type: Bug >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: Backlog > > > P1 > {code} > try { > getStore().putResource(cube.getResourcePath(), cube, > CUBE_SERIALIZER); > } catch (IllegalStateException ise) { > logger.warn("Write conflict to update cube " + cube.getName() + " > at try " + retry + ", will retry..."); > if (retry >= 7) { > logger.error("Retried 7 times till got error, abandoning...", > ise); > throw ise; > } > cube = reloadCubeLocal(cube.getName()); > update.setCubeInstance(cube); > retry++; > cube = updateCubeWithRetry(update, retry); > } > {code} > P2 > {code} > if (toRemoveResources.size() > 0) { > for (String resource : toRemoveResources) { > try { > getStore().deleteResource(resource); > } catch (IOException ioe) { > logger.error("Failed to delete resource " + > toRemoveResources.toString()); > } > } > } > {code} > P3 > {code} > cubeMap.put(cube.getName(), cube); > {code} > There's a chance like: > # Thread t1, goes into P2; > # Then Thread t2, goes into P1, P2, P3; the cube instance in the map will be > updated by t2 > # Then Thread t1 goes into P3; the cube instance in the map will be updated > by t1, which is not correct -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-2744) Should return correct type for SUM measure in web
[ https://issues.apache.org/jira/browse/KYLIN-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-2744: Fix Version/s: (was: v2.5.0) Backlog > Should return correct type for SUM measure in web > - > > Key: KYLIN-2744 > URL: https://issues.apache.org/jira/browse/KYLIN-2744 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.0.0 >Reporter: kangkaisen >Assignee: kangkaisen >Priority: Major > Fix For: Backlog > > Attachments: KYLIN-2744.patch > > > Currently, Kylin return decimal type for the sum measure of double type, > which will result in wrong result. So, We should return correct type for SUM > measure in web. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3133) Fix KYLIN-2717 compatibility issue
[ https://issues.apache.org/jira/browse/KYLIN-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3133: Fix Version/s: (was: v2.5.0) Backlog > Fix KYLIN-2717 compatibility issue > -- > > Key: KYLIN-3133 > URL: https://issues.apache.org/jira/browse/KYLIN-3133 > Project: Kylin > Issue Type: Bug > Components: Metadata, Tools, Build and Test >Affects Versions: v2.2.0 >Reporter: kangkaisen >Assignee: kangkaisen >Priority: Major > Fix For: Backlog > > Attachments: KYLIN-2717-compatibility.patch > > > Fix KYLIN-2717 compatibility issue: > 1 keep old getTableDesc api so that user could rolling upgrade to v2.2.0 when > user have dozens of QueryServer. > 2 Use tableRef.getTableDesc().getProject() not modelDesc.getProject() to be > compatible with old table resource path format. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (KYLIN-3454) Fix potential thread-safe problem in ResourceTool
[ https://issues.apache.org/jira/browse/KYLIN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI resolved KYLIN-3454. - Resolution: Fixed > Fix potential thread-safe problem in ResourceTool > - > > Key: KYLIN-3454 > URL: https://issues.apache.org/jira/browse/KYLIN-3454 > Project: Kylin > Issue Type: Improvement >Reporter: Xinbei Fu >Assignee: Xinbei Fu >Priority: Major > Fix For: v2.5.0 > > Attachments: Screen Shot 2018-07-16 at 2.36.39 PM.png > > > Class org.apache.kylin.common.persistence.ResourceTool are called by other > methods, not only by command lines, so it got this potential thread-safe > problem regarding the static variable pathsSkipChildrenCheck if multiple > threads are trying to modify this variable. > !Screen Shot 2018-07-16 at 2.36.39 PM.png! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (KYLIN-3482) Unclosed SetAndUnsetThreadLocalConfig in SparkCubingByLayer
[ https://issues.apache.org/jira/browse/KYLIN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI resolved KYLIN-3482. - Resolution: Fixed > Unclosed SetAndUnsetThreadLocalConfig in SparkCubingByLayer > --- > > Key: KYLIN-3482 > URL: https://issues.apache.org/jira/browse/KYLIN-3482 > Project: Kylin > Issue Type: Bug >Reporter: Ted Yu >Assignee: jiatao.tao >Priority: Minor > Fix For: v2.5.0 > > > Here is related code: > {code} > KylinConfig kylinConfig = > AbstractHadoopJob.loadKylinConfigFromHdfs(sConf, metaUrl); > > KylinConfig.setAndUnsetThreadLocalConfig(kylinConfig); > {code} > The return value from setAndUnsetThreadLocalConfig should be closed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3521) Enable Cube Planner by default
[ https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602008#comment-16602008 ] Shaofeng SHI commented on KYLIN-3521: - Hi Gang, this patch didn't cover the kylin-defaults.properties, in which they are still old values: kylin.cube.cubeplanner.enabled=false kylin.cube.cubeplanner.enabled-for-existing-cube=false kylin.cube.cubeplanner.expansion-threshold=15.0 kylin.cube.cubeplanner.recommend-cache-max-size=200 kylin.cube.cubeplanner.mandatory-rollup-threshold=1000 kylin.cube.cubeplanner.algorithm-threshold-greedy=10 kylin.cube.cubeplanner.algorithm-threshold-genetic=23 Please update kylin-defaults.properties as well. Besides, do you think can "kylin.cube.cubeplanner.enabled-for-existing-cube" be true? Thanks! > Enable Cube Planner by default > -- > > Key: KYLIN-3521 > URL: https://issues.apache.org/jira/browse/KYLIN-3521 > Project: Kylin > Issue Type: Improvement >Affects Versions: v2.5.0 >Reporter: Shaofeng SHI >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3521.patch > > > Cube planner can significantly reduce the cuboid number that to build. As it > wasn't enabled by default in 2.3 and 2.4, many users don't know that. > > To let more user to start using it, I suggest to enable it by default. > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3488) Support MySQL as Kylin metadata storage
[ https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601963#comment-16601963 ] ASF GitHub Bot commented on KYLIN-3488: --- shaofengshi closed pull request #216: KYLIN-3488 Support MySQL as Kylin metadata storage URL: https://github.com/apache/kylin/pull/216 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/core-common/pom.xml b/core-common/pom.xml index 6b48d656e0..2f1c8e21e5 100644 --- a/core-common/pom.xml +++ b/core-common/pom.xml @@ -91,5 +91,44 @@ dropwizard-metrics-hadoop-metrics2-reporter 0.1.2 + +commons-dbcp +commons-dbcp +1.4 + + +mysql +mysql-connector-java +provided + + + + +org.apache.maven.plugins +maven-dependency-plugin + + +copy +package + +copy + + + + +mysql + mysql-connector-java +true + ${project.basedir}/../../build/ext + + +false +true + + + + + + diff --git a/core-common/src/main/java/org/apache/kylin/common/KylinConfig.java b/core-common/src/main/java/org/apache/kylin/common/KylinConfig.java index e09ce26149..468bef7f04 100644 --- a/core-common/src/main/java/org/apache/kylin/common/KylinConfig.java +++ b/core-common/src/main/java/org/apache/kylin/common/KylinConfig.java @@ -534,4 +534,26 @@ public boolean equals(Object another) { return this.base() == ((KylinConfig) another).base(); } +public String getMetadataDialect() { +return SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.dialect", "mysql"); +} + +public boolean isJsonAlwaysSmallCell() { +return Boolean.valueOf(SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.json-always-small-cell", "true")); +} + +public int getSmallCellMetadataWarningThreshold() { +return Integer.parseInt(SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.small-cell-meta-size-warning-threshold", +String.valueOf(100 << 20))); +} + +public int getSmallCellMetadataErrorThreshold() { +return Integer.parseInt( + SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.small-cell-meta-size-error-threshold", String.valueOf(1 << 30))); +} + +public int getJdbcResourceStoreMaxCellSize() { +return Integer.parseInt(SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.max-cell-size", "262144")); //256k +} + } diff --git a/core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java b/core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java index 4895bf0745..b8d87bc349 100644 --- a/core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java +++ b/core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java @@ -226,6 +226,7 @@ public String getDeployEnv() { } private String cachedHdfsWorkingDirectory; +private String cachedBigCellDirectory; public String getHdfsWorkingDirectory() { if (cachedHdfsWorkingDirectory != null) @@ -260,6 +261,94 @@ public String getHdfsWorkingDirectory() { return cachedHdfsWorkingDirectory; } +public String getMetastoreBigCellHdfsDirectory() { + +if (cachedBigCellDirectory != null) +return cachedBigCellDirectory; + + +String root = getOptional("kylin.env.hdfs-metastore-bigcell-dir"); + +if (root == null) { +return getJdbcHdfsWorkingDirectory(); +} + +Path path = new Path(root); +if (!path.isAbsolute()) +throw new IllegalArgumentException( +"kylin.env.hdfs-metastore-bigcell-dir must be absolute, but got " + root); + +// make sure path is qualified +try { +FileSystem fs = HadoopUtil.getReadFileSystem(); +path = fs.makeQualified(path); +} catch (IOException e) { +throw new RuntimeException(e); +} + +root = new Path(path, StringUtils.replaceChars(getMetadataUrlPrefix(), ':', '-')).toString(); + +if
[jira] [Commented] (KYLIN-3488) Support MySQL as Kylin metadata storage
[ https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601962#comment-16601962 ] ASF GitHub Bot commented on KYLIN-3488: --- shaofengshi commented on issue #216: KYLIN-3488 Support MySQL as Kylin metadata storage URL: https://github.com/apache/kylin/pull/216#issuecomment-418066280 Merged by patch with code review commit. Close this PR. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Support MySQL as Kylin metadata storage > --- > > Key: KYLIN-3488 > URL: https://issues.apache.org/jira/browse/KYLIN-3488 > Project: Kylin > Issue Type: New Feature > Components: Metadata >Reporter: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Kylin uses HBase as the metastore; But in some cases user expects the > metadata not in HBase. > Sonny Heer from mailing list mentioned: > "I'm fairly certain anyone using Kylin with AWS EMR will benefit from this. > Having multiple hbase clusters across AZs is a huge benefit. BTW only thing > blocking at the moment is write operations happening from kylin query nodes." -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3488) Support MySQL as Kylin metadata storage
[ https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3488: Fix Version/s: v2.5.0 > Support MySQL as Kylin metadata storage > --- > > Key: KYLIN-3488 > URL: https://issues.apache.org/jira/browse/KYLIN-3488 > Project: Kylin > Issue Type: New Feature > Components: Metadata >Reporter: Shaofeng SHI >Priority: Major > Fix For: v2.5.0 > > > Kylin uses HBase as the metastore; But in some cases user expects the > metadata not in HBase. > Sonny Heer from mailing list mentioned: > "I'm fairly certain anyone using Kylin with AWS EMR will benefit from this. > Having multiple hbase clusters across AZs is a huge benefit. BTW only thing > blocking at the moment is write operations happening from kylin query nodes." -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3488) Support MySQL as Kylin metadata storage
[ https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601879#comment-16601879 ] ASF subversion and git services commented on KYLIN-3488: Commit 210719296973214bff7dcaf9a076d535ae7f7ddc in kylin's branch refs/heads/2.5.x from GinaZhai [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2107192 ] KYLIN-3488 Support Mysql as Kylin metadata storage > Support MySQL as Kylin metadata storage > --- > > Key: KYLIN-3488 > URL: https://issues.apache.org/jira/browse/KYLIN-3488 > Project: Kylin > Issue Type: New Feature > Components: Metadata >Reporter: Shaofeng SHI >Priority: Major > > Kylin uses HBase as the metastore; But in some cases user expects the > metadata not in HBase. > Sonny Heer from mailing list mentioned: > "I'm fairly certain anyone using Kylin with AWS EMR will benefit from this. > Having multiple hbase clusters across AZs is a huge benefit. BTW only thing > blocking at the moment is write operations happening from kylin query nodes." -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3488) Support MySQL as Kylin metadata storage
[ https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601880#comment-16601880 ] ASF subversion and git services commented on KYLIN-3488: Commit 854ac500e25a4c4e7da98b27abbeb3d43eef6889 in kylin's branch refs/heads/2.5.x from shaofengshi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=854ac50 ] KYLIN-3488 code review > Support MySQL as Kylin metadata storage > --- > > Key: KYLIN-3488 > URL: https://issues.apache.org/jira/browse/KYLIN-3488 > Project: Kylin > Issue Type: New Feature > Components: Metadata >Reporter: Shaofeng SHI >Priority: Major > > Kylin uses HBase as the metastore; But in some cases user expects the > metadata not in HBase. > Sonny Heer from mailing list mentioned: > "I'm fairly certain anyone using Kylin with AWS EMR will benefit from this. > Having multiple hbase clusters across AZs is a huge benefit. BTW only thing > blocking at the moment is write operations happening from kylin query nodes." -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (KYLIN-3522) PrepareStatement cache issue
[ https://issues.apache.org/jira/browse/KYLIN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI resolved KYLIN-3522. - Resolution: Fixed > PrepareStatement cache issue > > > Key: KYLIN-3522 > URL: https://issues.apache.org/jira/browse/KYLIN-3522 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: v2.5.0 >Reporter: Ma Gang >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3522.patch > > > When enable server side prepareStatement cache, OLAPContext is cached with > prepareStatement object, because filter is also in the OLAPContext, so the > condition values in the comparedFilter is also cached, that may cause problem > in some cases. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3522) PrepareStatement cache issue
[ https://issues.apache.org/jira/browse/KYLIN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601843#comment-16601843 ] Shaofeng SHI commented on KYLIN-3522: - +1 > PrepareStatement cache issue > > > Key: KYLIN-3522 > URL: https://issues.apache.org/jira/browse/KYLIN-3522 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: v2.5.0 >Reporter: Ma Gang >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3522.patch > > > When enable server side prepareStatement cache, OLAPContext is cached with > prepareStatement object, because filter is also in the OLAPContext, so the > condition values in the comparedFilter is also cached, that may cause problem > in some cases. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3522) PrepareStatement cache issue
[ https://issues.apache.org/jira/browse/KYLIN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601842#comment-16601842 ] ASF subversion and git services commented on KYLIN-3522: Commit 95a311bbea3f707329f53a24de1cd5973c0debea in kylin's branch refs/heads/2.5.x from Ma,Gang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=95a311b ] KYLIN-3522 PrepareStatement cache issue > PrepareStatement cache issue > > > Key: KYLIN-3522 > URL: https://issues.apache.org/jira/browse/KYLIN-3522 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: v2.5.0 >Reporter: Ma Gang >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3522.patch > > > When enable server side prepareStatement cache, OLAPContext is cached with > prepareStatement object, because filter is also in the OLAPContext, so the > condition values in the comparedFilter is also cached, that may cause problem > in some cases. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3522) PrepareStatement cache issue
[ https://issues.apache.org/jira/browse/KYLIN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3522: Affects Version/s: v2.5.0 Fix Version/s: v2.5.0 Issue Type: Bug (was: Improvement) > PrepareStatement cache issue > > > Key: KYLIN-3522 > URL: https://issues.apache.org/jira/browse/KYLIN-3522 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: v2.5.0 >Reporter: Ma Gang >Assignee: Ma Gang >Priority: Minor > Fix For: v2.5.0 > > Attachments: KYLIN-3522.patch > > > When enable server side prepareStatement cache, OLAPContext is cached with > prepareStatement object, because filter is also in the OLAPContext, so the > condition values in the comparedFilter is also cached, that may cause problem > in some cases. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3515) Cubing jobs may interfere with each other if use same hive view
[ https://issues.apache.org/jira/browse/KYLIN-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601825#comment-16601825 ] ASF GitHub Bot commented on KYLIN-3515: --- nichunen opened a new pull request #219: KYLIN-3515 Add uuid for materialized table of hive view URL: https://github.com/apache/kylin/pull/219 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Cubing jobs may interfere with each other if use same hive view > > > Key: KYLIN-3515 > URL: https://issues.apache.org/jira/browse/KYLIN-3515 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.4.0 >Reporter: nichunen >Assignee: nichunen >Priority: Major > Fix For: Future > > Attachments: Getting started > > > The root cause is for hive view, during cubing, kylin will materialize the > view by creating an intermediate table(drop intermediate table first). The > intermediate tables' name is like kylin_intermediate_\{view_name}, that means > jobs will create tables with the same name if the same view is referenced. So > one job's intermediate table may be dropped by another job, in such cases, > error like "table not found" will happen -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3525) kylin.source.hive.keep-flat-table参数问题
[ https://issues.apache.org/jira/browse/KYLIN-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3525: Fix Version/s: v2.6.0 > kylin.source.hive.keep-flat-table参数问题 > - > > Key: KYLIN-3525 > URL: https://issues.apache.org/jira/browse/KYLIN-3525 > Project: Kylin > Issue Type: Improvement > Components: Streaming >Affects Versions: v2.4.0 >Reporter: wlxie >Priority: Major > Fix For: v2.6.0 > > Attachments: 1535534470(1).png, HiveMRInput.java > > > kylin.source.hive.keep-flat-table这个参数设置为true后,只是保留了hive表结构,但是数据还是被清除了,查看了源码,这个参数确实只是对表结构进行控制。如果希望数据也保存下来,并且是一个cube下面所有作业的数据都保存到一个表里面(目前是一个作业会产生一个表),是否有什么好的解决方案。 > 附件为v2.4.0源码 > 谢谢。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3515) Cubing jobs may interfere with each other if use same hive view
[ https://issues.apache.org/jira/browse/KYLIN-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601826#comment-16601826 ] ASF GitHub Bot commented on KYLIN-3515: --- asfgit commented on issue #219: KYLIN-3515 Add uuid for materialized table of hive view URL: https://github.com/apache/kylin/pull/219#issuecomment-418021421 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Cubing jobs may interfere with each other if use same hive view > > > Key: KYLIN-3515 > URL: https://issues.apache.org/jira/browse/KYLIN-3515 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.4.0 >Reporter: nichunen >Assignee: nichunen >Priority: Major > Fix For: Future > > Attachments: Getting started > > > The root cause is for hive view, during cubing, kylin will materialize the > view by creating an intermediate table(drop intermediate table first). The > intermediate tables' name is like kylin_intermediate_\{view_name}, that means > jobs will create tables with the same name if the same view is referenced. So > one job's intermediate table may be dropped by another job, in such cases, > error like "table not found" will happen -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3504) Release 2.4.1
[ https://issues.apache.org/jira/browse/KYLIN-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601807#comment-16601807 ] ASF subversion and git services commented on KYLIN-3504: Commit 3528db3f4bfe20b07129049913ba65af48320951 in kylin's branch refs/heads/v2.4.1-release from Zhong [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3528db3 ] KYLIN-3504 update Yanghong Zhong public keys to KEYS > Release 2.4.1 > - > > Key: KYLIN-3504 > URL: https://issues.apache.org/jira/browse/KYLIN-3504 > Project: Kylin > Issue Type: Task >Reporter: Shaofeng SHI >Assignee: Zhong Yanghong >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)