[jira] [Created] (KYLIN-3530) All cubes disabled but table still can be seen in Insight page

2018-09-03 Thread Na Zhai (JIRA)
Na Zhai created KYLIN-3530:
--

 Summary: All cubes disabled but table still can be seen in Insight 
page
 Key: KYLIN-3530
 URL: https://issues.apache.org/jira/browse/KYLIN-3530
 Project: Kylin
  Issue Type: Bug
Reporter: Na Zhai


When I disable all cubes with table KYLIN_SALES,KYLIN_SALES still can be seen 
in Insight page



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (KYLIN-3529) Prompt not friendly

2018-09-03 Thread Na Zhai (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Na Zhai reassigned KYLIN-3529:
--

Assignee: Chao Long

> Prompt not friendly
> ---
>
> Key: KYLIN-3529
> URL: https://issues.apache.org/jira/browse/KYLIN-3529
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Reporter: Na Zhai
>Assignee: Chao Long
>Priority: Major
>
>  *Scene 1:*When I create a hybrid with duplicate name, then I click submit, 
> the error message "error execute org.apache.kylin.rest.job.HybridCubeCLI" 
> will pop up.
>  
> *Scene 2:*When I create a hybrid with duplicate date/time cube, then I click 
> submit, the error message "error execute 
> org.apache.kylin.rest.job.HybridCubeCLI" will pop up.
>  
> I think the error message should be more friendly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (KYLIN-3529) Prompt not friendly

2018-09-03 Thread Na Zhai (JIRA)
Na Zhai created KYLIN-3529:
--

 Summary: Prompt not friendly
 Key: KYLIN-3529
 URL: https://issues.apache.org/jira/browse/KYLIN-3529
 Project: Kylin
  Issue Type: Bug
  Components: Web 
Reporter: Na Zhai


 *Scene 1:*When I create a hybrid with duplicate name, then I click submit, the 
error message "error execute org.apache.kylin.rest.job.HybridCubeCLI" will pop 
up.
 
*Scene 2:*When I create a hybrid with duplicate date/time cube, then I click 
submit, the error message "error execute 
org.apache.kylin.rest.job.HybridCubeCLI" will pop up.
 
I think the error message should be more friendly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube

2018-09-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602569#comment-16602569
 ] 

ASF GitHub Bot commented on KYLIN-3527:
---

luguosheng1314 closed pull request #220: KYLIN-3527 fix grunt script - font 
build
URL: https://github.com/apache/kylin/pull/220
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/webapp/Gruntfile.js b/webapp/Gruntfile.js
index d871f4f934..a977a7321e 100644
--- a/webapp/Gruntfile.js
+++ b/webapp/Gruntfile.js
@@ -105,6 +105,12 @@ module.exports = function (grunt) {
 src: ['fonts/*'],
 dest: 'dist/'
   },
+  {
+expand: true,
+cwd: 'app',
+src: ['fonts/*'],
+dest: 'dist/'
+  },
   {
 expand: true,
 cwd: 'app/components/ace/',


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Hybrid couldn't save when there is only 1 cube
> --
>
> Key: KYLIN-3527
> URL: https://issues.apache.org/jira/browse/KYLIN-3527
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Roger
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: hybrid-not-saved.png, move-in-out-icons.png
>
>
> I created a hybrid with two cubes; Later I want to remove one cube from it, 
> but I found when there is only 1 cube, the "Submit" button was disabled.
>  
> The hybrid should allows 0, 1 or more cubes.
>  
> Besides, I found the move in and out icons were not properly displayed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube

2018-09-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602563#comment-16602563
 ] 

ASF GitHub Bot commented on KYLIN-3527:
---

Emiya0306 opened a new pull request #220: KYLIN-3527 fix grunt script - font 
build
URL: https://github.com/apache/kylin/pull/220
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Hybrid couldn't save when there is only 1 cube
> --
>
> Key: KYLIN-3527
> URL: https://issues.apache.org/jira/browse/KYLIN-3527
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Roger
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: hybrid-not-saved.png, move-in-out-icons.png
>
>
> I created a hybrid with two cubes; Later I want to remove one cube from it, 
> but I found when there is only 1 cube, the "Submit" button was disabled.
>  
> The hybrid should allows 0, 1 or more cubes.
>  
> Besides, I found the move in and out icons were not properly displayed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube

2018-09-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602564#comment-16602564
 ] 

ASF GitHub Bot commented on KYLIN-3527:
---

asfgit commented on issue #220: KYLIN-3527 fix grunt script - font build
URL: https://github.com/apache/kylin/pull/220#issuecomment-418227622
 
 
   Can one of the admins verify this patch?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Hybrid couldn't save when there is only 1 cube
> --
>
> Key: KYLIN-3527
> URL: https://issues.apache.org/jira/browse/KYLIN-3527
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Roger
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: hybrid-not-saved.png, move-in-out-icons.png
>
>
> I created a hybrid with two cubes; Later I want to remove one cube from it, 
> but I found when there is only 1 cube, the "Submit" button was disabled.
>  
> The hybrid should allows 0, 1 or more cubes.
>  
> Besides, I found the move in and out icons were not properly displayed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (KYLIN-3528) No details page for hybrid

2018-09-03 Thread Na Zhai (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Na Zhai reassigned KYLIN-3528:
--

Assignee: Roger

> No details page for hybrid
> --
>
> Key: KYLIN-3528
> URL: https://issues.apache.org/jira/browse/KYLIN-3528
> Project: Kylin
>  Issue Type: Improvement
>  Components: Web 
>Reporter: Na Zhai
>Assignee: Roger
>Priority: Major
>
> When I click hybrid name, there is no detail page for that hybrid.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (KYLIN-3528) No details page for hybrid

2018-09-03 Thread Na Zhai (JIRA)
Na Zhai created KYLIN-3528:
--

 Summary: No details page for hybrid
 Key: KYLIN-3528
 URL: https://issues.apache.org/jira/browse/KYLIN-3528
 Project: Kylin
  Issue Type: Improvement
  Components: Web 
Reporter: Na Zhai


When I click hybrid name, there is no detail page for that hybrid.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (KYLIN-3526) No check for hybrid name with special character

2018-09-03 Thread Na Zhai (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Na Zhai reassigned KYLIN-3526:
--

Assignee: Roger

> No check for hybrid name with special character
> ---
>
> Key: KYLIN-3526
> URL: https://issues.apache.org/jira/browse/KYLIN-3526
> Project: Kylin
>  Issue Type: Improvement
>  Components: Web 
>Reporter: Na Zhai
>Assignee: Roger
>Priority: Major
> Attachments: 名称没做限制.png
>
>
> When create hybrid,there is no check for hybrid name with special character. 
> Such as !@&.
> Hybrid can be created successfully with name like hy!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI reassigned KYLIN-3527:
---

 Assignee: Roger
Fix Version/s: v2.5.0

> Hybrid couldn't save when there is only 1 cube
> --
>
> Key: KYLIN-3527
> URL: https://issues.apache.org/jira/browse/KYLIN-3527
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Roger
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: hybrid-not-saved.png, move-in-out-icons.png
>
>
> I created a hybrid with two cubes; Later I want to remove one cube from it, 
> but I found when there is only 1 cube, the "Submit" button was disabled.
>  
> The hybrid should allows 0, 1 or more cubes.
>  
> Besides, I found the move in and out icons were not properly displayed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3527:

Attachment: move-in-out-icons.png

> Hybrid couldn't save when there is only 1 cube
> --
>
> Key: KYLIN-3527
> URL: https://issues.apache.org/jira/browse/KYLIN-3527
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: hybrid-not-saved.png, move-in-out-icons.png
>
>
> I created a hybrid with two cubes; Later I want to remove one cube from it, 
> but I found when there is only 1 cube, the "Submit" button was disabled.
>  
> The hybrid should allows 0, 1 or more cubes.
>  
> Besides, I found the move in and out icons were not properly displayed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3527:

Attachment: hybrid-not-saved.png

> Hybrid couldn't save when there is only 1 cube
> --
>
> Key: KYLIN-3527
> URL: https://issues.apache.org/jira/browse/KYLIN-3527
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Priority: Minor
> Attachments: hybrid-not-saved.png
>
>
> I created a hybrid with two cubes; Later I want to remove one cube from it, 
> but I found when there is only 1 cube, the "Submit" button was disabled.
>  
> The hybrid should allows 0, 1 or more cubes.
>  
> Besides, I found the move in and out icons were not properly displayed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube

2018-09-03 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3527:
---

 Summary: Hybrid couldn't save when there is only 1 cube
 Key: KYLIN-3527
 URL: https://issues.apache.org/jira/browse/KYLIN-3527
 Project: Kylin
  Issue Type: Bug
  Components: Web 
Affects Versions: v2.5.0
Reporter: Shaofeng SHI
 Attachments: hybrid-not-saved.png

I created a hybrid with two cubes; Later I want to remove one cube from it, but 
I found when there is only 1 cube, the "Submit" button was disabled.

 

The hybrid should allows 0, 1 or more cubes.

 

Besides, I found the move in and out icons were not properly displayed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3521) Enable Cube Planner by default

2018-09-03 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602516#comment-16602516
 ] 

ASF subversion and git services commented on KYLIN-3521:


Commit 94afb6b9ca1beb26ca3d5a8238a0a9a499e61813 in kylin's branch 
refs/heads/master from Ma,Gang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=94afb6b ]

KYLIN-3521 Enable Cube Planner by default


> Enable Cube Planner by default
> --
>
> Key: KYLIN-3521
> URL: https://issues.apache.org/jira/browse/KYLIN-3521
> Project: Kylin
>  Issue Type: Improvement
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3521_V2.patch
>
>
> Cube planner can significantly reduce the cuboid number that to build. As it 
> wasn't enabled by default in 2.3 and 2.4, many users don't know that.
>  
> To let more user to start using it, I suggest to enable it by default. 
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3521) Enable Cube Planner by default

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3521:

Attachment: (was: KYLIN-3521.patch)

> Enable Cube Planner by default
> --
>
> Key: KYLIN-3521
> URL: https://issues.apache.org/jira/browse/KYLIN-3521
> Project: Kylin
>  Issue Type: Improvement
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3521_V2.patch
>
>
> Cube planner can significantly reduce the cuboid number that to build. As it 
> wasn't enabled by default in 2.3 and 2.4, many users don't know that.
>  
> To let more user to start using it, I suggest to enable it by default. 
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (KYLIN-3526) No check for hybrid name with special character

2018-09-03 Thread Na Zhai (JIRA)
Na Zhai created KYLIN-3526:
--

 Summary: No check for hybrid name with special character
 Key: KYLIN-3526
 URL: https://issues.apache.org/jira/browse/KYLIN-3526
 Project: Kylin
  Issue Type: Improvement
  Components: Web 
Reporter: Na Zhai
 Attachments: 名称没做限制.png

When create hybrid,there is no check for hybrid name with special character. 
Such as !@&.

Hybrid can be created successfully with name like hy!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3504) Release 2.4.1

2018-09-03 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602134#comment-16602134
 ] 

ASF subversion and git services commented on KYLIN-3504:


Commit 175e30d09af118b7813c4045603589fb41d2b255 in kylin's branch 
refs/heads/v2.4.1-release from root
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=175e30d ]

KYLIN-3504 update Yanghong Zhong public keys to KEYS


> Release 2.4.1
> -
>
> Key: KYLIN-3504
> URL: https://issues.apache.org/jira/browse/KYLIN-3504
> Project: Kylin
>  Issue Type: Task
>Reporter: Shaofeng SHI
>Assignee: Zhong Yanghong
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3521) Enable Cube Planner by default

2018-09-03 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602126#comment-16602126
 ] 

ASF subversion and git services commented on KYLIN-3521:


Commit 41b4ffe27c20521bf0c676935b34a6bbcdbf2d51 in kylin's branch 
refs/heads/2.5.x from Ma,Gang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=41b4ffe ]

KYLIN-3521 Enable Cube Planner by default


> Enable Cube Planner by default
> --
>
> Key: KYLIN-3521
> URL: https://issues.apache.org/jira/browse/KYLIN-3521
> Project: Kylin
>  Issue Type: Improvement
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3521.patch, KYLIN-3521_V2.patch
>
>
> Cube planner can significantly reduce the cuboid number that to build. As it 
> wasn't enabled by default in 2.3 and 2.4, many users don't know that.
>  
> To let more user to start using it, I suggest to enable it by default. 
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3521) Enable Cube Planner by default

2018-09-03 Thread Ma Gang (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602041#comment-16602041
 ] 

Ma Gang commented on KYLIN-3521:


Thanks [~Shaofengshi], upload the new patch, please review, also set the 
"kylin.cube.cubeplanner.enabled-for-existing-cube" to true.

> Enable Cube Planner by default
> --
>
> Key: KYLIN-3521
> URL: https://issues.apache.org/jira/browse/KYLIN-3521
> Project: Kylin
>  Issue Type: Improvement
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3521.patch, KYLIN-3521_V2.patch
>
>
> Cube planner can significantly reduce the cuboid number that to build. As it 
> wasn't enabled by default in 2.3 and 2.4, many users don't know that.
>  
> To let more user to start using it, I suggest to enable it by default. 
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3521) Enable Cube Planner by default

2018-09-03 Thread Ma Gang (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ma Gang updated KYLIN-3521:
---
Attachment: KYLIN-3521_V2.patch

> Enable Cube Planner by default
> --
>
> Key: KYLIN-3521
> URL: https://issues.apache.org/jira/browse/KYLIN-3521
> Project: Kylin
>  Issue Type: Improvement
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3521.patch, KYLIN-3521_V2.patch
>
>
> Cube planner can significantly reduce the cuboid number that to build. As it 
> wasn't enabled by default in 2.3 and 2.4, many users don't know that.
>  
> To let more user to start using it, I suggest to enable it by default. 
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (KYLIN-3491) Improve the cube building process when using global dictionary

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI resolved KYLIN-3491.
-
Resolution: Fixed

> Improve the cube building process when using global dictionary
> --
>
> Key: KYLIN-3491
> URL: https://issues.apache.org/jira/browse/KYLIN-3491
> Project: Kylin
>  Issue Type: Improvement
>  Components: Job Engine
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v2.5.0
>
> Attachments: APACHE-KYLIN-3491-with-fix.patch, APACHE-KYLIN-3491.patch
>
>
> By current cubing process, if the global dictionary is very large, since the 
> raw data records are unsorted, it's hard to encode raw values into ids for 
> the input of bitmap due to frequent swap of the dictionary slices. We need a 
> refined process. The idea is as follows:
>  # for each source data block, there will be a mapper generating the distinct 
> values & sort them
>  # encode the sorted distinct values and generate a shrunken dict for each 
> source data block.
>  # when building base cuboid, use the shrunken dict for each source data 
> block for encoding.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3299) When a column in int data type and encoding as date may will lead build wrong value

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3299:

Fix Version/s: (was: v2.5.0)
   Future

> When a column in int data type and encoding as date may will lead build wrong 
> value
> ---
>
> Key: KYLIN-3299
> URL: https://issues.apache.org/jira/browse/KYLIN-3299
> Project: Kylin
>  Issue Type: Bug
>  Components: Job Engine
>Reporter: jiatao.tao
>Assignee: jiatao.tao
>Priority: Major
> Fix For: Future
>
>
> When the year is less than 1000, build and query will result 1970.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3140) Auto merge jobs should not block user build jobs

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3140:

Fix Version/s: (was: v2.5.0)
   Backlog

> Auto merge jobs should not block user build jobs
> 
>
> Key: KYLIN-3140
> URL: https://issues.apache.org/jira/browse/KYLIN-3140
> Project: Kylin
>  Issue Type: Improvement
>  Components: Job Engine
>Reporter: Wang, Gang
>Assignee: Shaofeng SHI
>Priority: Major
> Fix For: Backlog
>
>
> Although in the latest version, Kylin support concurrent jobs. If the 
> concurrency is set to 1, there is some possibility that cube build job will 
> have dead lock. Say, when there is some issue which causes merge job failed, 
> even when you discard the job, another job will be launched and failed again 
> due to auto merge policy. And this failed merge job blocks user to build 
> incremental segment.
> Even if the concurrency is set to larger than 1, the auto merge jobs occupy 
> some concurrency quota. 
> While, from user perspective, they don't care much about the auto merge jobs, 
> and the auto merge jobs should not block the building/refresh jobs they 
> submit manually.
> A better way may be separating the auto merge jobs from the job queue, 
> parameter max-building-segments only limit jobs submitted by users.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3253) Enabling DEBUG in kylin-server-log4j.properties results in NPE in Calcite layer during query execution

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3253:

Fix Version/s: (was: v2.5.0)
   Backlog

> Enabling DEBUG in kylin-server-log4j.properties results in NPE in Calcite 
> layer during query execution
> --
>
> Key: KYLIN-3253
> URL: https://issues.apache.org/jira/browse/KYLIN-3253
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v2.2.0
> Environment: HDP 2.5.6, Kylin 2.2
>Reporter: Vsevolod Ostapenko
>Assignee: Yifei Wu
>Priority: Major
> Fix For: Backlog
>
>
> If log4j root logger is set to DEBUG level in the 
> kylin-server-log4j.properties attempt to run a query after that results in a 
> failure with an NPE being triggered in the calcite layer (see stack trace 
> below).
> The issue was fixed in Calcite 1.14 as 
> https://issues.apache.org/jira/browse/CALCITE-1859
> It's a one line change to 
> core/src/main/java/org/apache/calcite/plan/volcano/VolcanoPlanner.java
> Since Kylin is packaging it's own fork of Calcite from 
> [http://repository.kyligence.io|http://repository.kyligence.io/], the fix 
> need to be ported to 1.13.0-kylin-r-SPANSHOT.jar by someone who has access 
> to this forked repo.
> {quote}    at 
> org.apache.calcite.avatica.Helper.createException(Helper.java:56)
>     at 
> org.apache.calcite.avatica.Helper.createException(Helper.java:41)
>     at 
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
>     at 
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
>     at 
> org.apache.kylin.rest.service.QueryService.execute(QueryService.java:834)
>     at 
> org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:561)
>     at 
> org.apache.kylin.rest.service.QueryService.query(QueryService.java:181)
>     at 
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:415)
>     at 
> org.apache.kylin.rest.controller.QueryController.query(QueryController.java:78)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at 
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
>     at 
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
>     at 
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
>     at 
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
>     at 
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
>     at 
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
>     at 
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
>     at 
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
>     at 
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
>     at 
> org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
>     at 
> javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
>     at 
> org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
>     at 
> javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
>     at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
>     at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
>     at 
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
>     at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
>     at 
> 

[jira] [Updated] (KYLIN-2973) Potential issue of not atomically update cube instance map

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-2973:

Fix Version/s: (was: v2.5.0)
   Backlog

> Potential issue of not atomically update cube instance map
> --
>
> Key: KYLIN-2973
> URL: https://issues.apache.org/jira/browse/KYLIN-2973
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: Backlog
>
>
> P1
> {code}
> try {
> getStore().putResource(cube.getResourcePath(), cube, 
> CUBE_SERIALIZER);
> } catch (IllegalStateException ise) {
> logger.warn("Write conflict to update cube " + cube.getName() + " 
> at try " + retry + ", will retry...");
> if (retry >= 7) {
> logger.error("Retried 7 times till got error, abandoning...", 
> ise);
> throw ise;
> }
> cube = reloadCubeLocal(cube.getName());
> update.setCubeInstance(cube);
> retry++;
> cube = updateCubeWithRetry(update, retry);
> }
> {code}
> P2
> {code}
> if (toRemoveResources.size() > 0) {
> for (String resource : toRemoveResources) {
> try {
> getStore().deleteResource(resource);
> } catch (IOException ioe) {
> logger.error("Failed to delete resource " + 
> toRemoveResources.toString());
> }
> }
> }
> {code}
> P3
> {code}
> cubeMap.put(cube.getName(), cube);
> {code}
> There's a chance like:
> # Thread t1, goes into P2;
> # Then Thread t2, goes into P1, P2, P3; the cube instance in the map will be 
> updated by t2
> # Then Thread t1 goes into P3; the cube instance in the map will be updated 
> by t1, which is not correct



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-2744) Should return correct type for SUM measure in web

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-2744:

Fix Version/s: (was: v2.5.0)
   Backlog

> Should return correct type for SUM measure in web
> -
>
> Key: KYLIN-2744
> URL: https://issues.apache.org/jira/browse/KYLIN-2744
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.0.0
>Reporter: kangkaisen
>Assignee: kangkaisen
>Priority: Major
> Fix For: Backlog
>
> Attachments: KYLIN-2744.patch
>
>
> Currently, Kylin return decimal type for the  sum measure of double type, 
> which will result in wrong result. So, We should return correct type for SUM 
> measure in web.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3133) Fix KYLIN-2717 compatibility issue

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3133:

Fix Version/s: (was: v2.5.0)
   Backlog

> Fix KYLIN-2717 compatibility issue
> --
>
> Key: KYLIN-3133
> URL: https://issues.apache.org/jira/browse/KYLIN-3133
> Project: Kylin
>  Issue Type: Bug
>  Components: Metadata, Tools, Build and Test
>Affects Versions: v2.2.0
>Reporter: kangkaisen
>Assignee: kangkaisen
>Priority: Major
> Fix For: Backlog
>
> Attachments: KYLIN-2717-compatibility.patch
>
>
> Fix KYLIN-2717 compatibility issue:
> 1 keep old getTableDesc api so that user could rolling upgrade to v2.2.0 when 
> user have dozens of QueryServer.
> 2 Use tableRef.getTableDesc().getProject() not modelDesc.getProject() to be 
> compatible with old table resource path format.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (KYLIN-3454) Fix potential thread-safe problem in ResourceTool

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI resolved KYLIN-3454.
-
Resolution: Fixed

> Fix potential thread-safe problem in ResourceTool
> -
>
> Key: KYLIN-3454
> URL: https://issues.apache.org/jira/browse/KYLIN-3454
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Xinbei Fu
>Assignee: Xinbei Fu
>Priority: Major
> Fix For: v2.5.0
>
> Attachments: Screen Shot 2018-07-16 at 2.36.39 PM.png
>
>
> Class org.apache.kylin.common.persistence.ResourceTool are called by other 
> methods, not only by command lines, so it got this potential thread-safe 
> problem regarding the static variable pathsSkipChildrenCheck if multiple 
> threads are trying to modify this variable.
>  !Screen Shot 2018-07-16 at 2.36.39 PM.png! 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (KYLIN-3482) Unclosed SetAndUnsetThreadLocalConfig in SparkCubingByLayer

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI resolved KYLIN-3482.
-
Resolution: Fixed

> Unclosed SetAndUnsetThreadLocalConfig in SparkCubingByLayer
> ---
>
> Key: KYLIN-3482
> URL: https://issues.apache.org/jira/browse/KYLIN-3482
> Project: Kylin
>  Issue Type: Bug
>Reporter: Ted Yu
>Assignee: jiatao.tao
>Priority: Minor
> Fix For: v2.5.0
>
>
> Here is related code:
> {code}
> KylinConfig kylinConfig = 
> AbstractHadoopJob.loadKylinConfigFromHdfs(sConf, metaUrl);
> 
> KylinConfig.setAndUnsetThreadLocalConfig(kylinConfig);
> {code}
> The return value from setAndUnsetThreadLocalConfig should be closed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3521) Enable Cube Planner by default

2018-09-03 Thread Shaofeng SHI (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602008#comment-16602008
 ] 

Shaofeng SHI commented on KYLIN-3521:
-

Hi Gang, this patch didn't cover the kylin-defaults.properties, in which they 
are still old values:

kylin.cube.cubeplanner.enabled=false
kylin.cube.cubeplanner.enabled-for-existing-cube=false
kylin.cube.cubeplanner.expansion-threshold=15.0
kylin.cube.cubeplanner.recommend-cache-max-size=200
kylin.cube.cubeplanner.mandatory-rollup-threshold=1000
kylin.cube.cubeplanner.algorithm-threshold-greedy=10
kylin.cube.cubeplanner.algorithm-threshold-genetic=23

 

Please update kylin-defaults.properties as well. Besides, do you think can 
"kylin.cube.cubeplanner.enabled-for-existing-cube" be true? Thanks!

 

> Enable Cube Planner by default
> --
>
> Key: KYLIN-3521
> URL: https://issues.apache.org/jira/browse/KYLIN-3521
> Project: Kylin
>  Issue Type: Improvement
>Affects Versions: v2.5.0
>Reporter: Shaofeng SHI
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3521.patch
>
>
> Cube planner can significantly reduce the cuboid number that to build. As it 
> wasn't enabled by default in 2.3 and 2.4, many users don't know that.
>  
> To let more user to start using it, I suggest to enable it by default. 
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3488) Support MySQL as Kylin metadata storage

2018-09-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601963#comment-16601963
 ] 

ASF GitHub Bot commented on KYLIN-3488:
---

shaofengshi closed pull request #216: KYLIN-3488 Support MySQL as Kylin 
metadata storage
URL: https://github.com/apache/kylin/pull/216
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/core-common/pom.xml b/core-common/pom.xml
index 6b48d656e0..2f1c8e21e5 100644
--- a/core-common/pom.xml
+++ b/core-common/pom.xml
@@ -91,5 +91,44 @@
 
dropwizard-metrics-hadoop-metrics2-reporter
 0.1.2
 
+
+commons-dbcp
+commons-dbcp
+1.4
+
+
+mysql
+mysql-connector-java
+provided
+
 
+
+
+
+org.apache.maven.plugins
+maven-dependency-plugin
+
+
+copy
+package
+
+copy
+
+
+
+
+mysql
+
mysql-connector-java
+true
+
${project.basedir}/../../build/ext
+
+
+false
+true
+
+
+
+
+
+
 
diff --git a/core-common/src/main/java/org/apache/kylin/common/KylinConfig.java 
b/core-common/src/main/java/org/apache/kylin/common/KylinConfig.java
index e09ce26149..468bef7f04 100644
--- a/core-common/src/main/java/org/apache/kylin/common/KylinConfig.java
+++ b/core-common/src/main/java/org/apache/kylin/common/KylinConfig.java
@@ -534,4 +534,26 @@ public boolean equals(Object another) {
 return this.base() == ((KylinConfig) another).base();
 }
 
+public String getMetadataDialect() {
+return SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.dialect", 
"mysql");
+}
+
+public boolean isJsonAlwaysSmallCell() {
+return 
Boolean.valueOf(SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.json-always-small-cell",
 "true"));
+}
+
+public int getSmallCellMetadataWarningThreshold() {
+return 
Integer.parseInt(SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.small-cell-meta-size-warning-threshold",
+String.valueOf(100 << 20)));
+}
+
+public int getSmallCellMetadataErrorThreshold() {
+return Integer.parseInt(
+
SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.small-cell-meta-size-error-threshold",
 String.valueOf(1 << 30)));
+}
+
+public int getJdbcResourceStoreMaxCellSize() {
+return 
Integer.parseInt(SYS_ENV_INSTANCE.getOptional("kylin.metadata.jdbc.max-cell-size",
 "262144")); //256k
+}
+
 }
diff --git 
a/core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java 
b/core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java
index 4895bf0745..b8d87bc349 100644
--- a/core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java
+++ b/core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java
@@ -226,6 +226,7 @@ public String getDeployEnv() {
 }
 
 private String cachedHdfsWorkingDirectory;
+private String cachedBigCellDirectory;
 
 public String getHdfsWorkingDirectory() {
 if (cachedHdfsWorkingDirectory != null)
@@ -260,6 +261,94 @@ public String getHdfsWorkingDirectory() {
 return cachedHdfsWorkingDirectory;
 }
 
+public String getMetastoreBigCellHdfsDirectory() {
+
+if (cachedBigCellDirectory != null)
+return cachedBigCellDirectory;
+
+
+String root = getOptional("kylin.env.hdfs-metastore-bigcell-dir");
+
+if (root == null) {
+return getJdbcHdfsWorkingDirectory();
+}
+
+Path path = new Path(root);
+if (!path.isAbsolute())
+throw new IllegalArgumentException(
+"kylin.env.hdfs-metastore-bigcell-dir must be absolute, 
but got " + root);
+
+// make sure path is qualified
+try {
+FileSystem fs = HadoopUtil.getReadFileSystem();
+path = fs.makeQualified(path);
+} catch (IOException e) {
+throw new RuntimeException(e);
+}
+
+root = new Path(path, StringUtils.replaceChars(getMetadataUrlPrefix(), 
':', '-')).toString();
+
+if 

[jira] [Commented] (KYLIN-3488) Support MySQL as Kylin metadata storage

2018-09-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601962#comment-16601962
 ] 

ASF GitHub Bot commented on KYLIN-3488:
---

shaofengshi commented on issue #216: KYLIN-3488 Support MySQL as Kylin metadata 
storage
URL: https://github.com/apache/kylin/pull/216#issuecomment-418066280
 
 
   Merged by patch with code review commit. Close this PR.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Support MySQL as Kylin metadata storage
> ---
>
> Key: KYLIN-3488
> URL: https://issues.apache.org/jira/browse/KYLIN-3488
> Project: Kylin
>  Issue Type: New Feature
>  Components: Metadata
>Reporter: Shaofeng SHI
>Priority: Major
> Fix For: v2.5.0
>
>
> Kylin uses HBase as the metastore; But in some cases user expects the 
> metadata not in HBase.
> Sonny Heer from mailing list mentioned:
> "I'm fairly certain anyone using Kylin with AWS EMR will benefit from this.   
> Having multiple hbase clusters across AZs is a huge benefit.  BTW only thing 
> blocking at the moment is write operations happening from kylin query nodes."



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3488) Support MySQL as Kylin metadata storage

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3488:

Fix Version/s: v2.5.0

> Support MySQL as Kylin metadata storage
> ---
>
> Key: KYLIN-3488
> URL: https://issues.apache.org/jira/browse/KYLIN-3488
> Project: Kylin
>  Issue Type: New Feature
>  Components: Metadata
>Reporter: Shaofeng SHI
>Priority: Major
> Fix For: v2.5.0
>
>
> Kylin uses HBase as the metastore; But in some cases user expects the 
> metadata not in HBase.
> Sonny Heer from mailing list mentioned:
> "I'm fairly certain anyone using Kylin with AWS EMR will benefit from this.   
> Having multiple hbase clusters across AZs is a huge benefit.  BTW only thing 
> blocking at the moment is write operations happening from kylin query nodes."



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3488) Support MySQL as Kylin metadata storage

2018-09-03 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601879#comment-16601879
 ] 

ASF subversion and git services commented on KYLIN-3488:


Commit 210719296973214bff7dcaf9a076d535ae7f7ddc in kylin's branch 
refs/heads/2.5.x from GinaZhai
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2107192 ]

KYLIN-3488 Support Mysql as Kylin metadata storage


> Support MySQL as Kylin metadata storage
> ---
>
> Key: KYLIN-3488
> URL: https://issues.apache.org/jira/browse/KYLIN-3488
> Project: Kylin
>  Issue Type: New Feature
>  Components: Metadata
>Reporter: Shaofeng SHI
>Priority: Major
>
> Kylin uses HBase as the metastore; But in some cases user expects the 
> metadata not in HBase.
> Sonny Heer from mailing list mentioned:
> "I'm fairly certain anyone using Kylin with AWS EMR will benefit from this.   
> Having multiple hbase clusters across AZs is a huge benefit.  BTW only thing 
> blocking at the moment is write operations happening from kylin query nodes."



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3488) Support MySQL as Kylin metadata storage

2018-09-03 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601880#comment-16601880
 ] 

ASF subversion and git services commented on KYLIN-3488:


Commit 854ac500e25a4c4e7da98b27abbeb3d43eef6889 in kylin's branch 
refs/heads/2.5.x from shaofengshi
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=854ac50 ]

KYLIN-3488 code review


> Support MySQL as Kylin metadata storage
> ---
>
> Key: KYLIN-3488
> URL: https://issues.apache.org/jira/browse/KYLIN-3488
> Project: Kylin
>  Issue Type: New Feature
>  Components: Metadata
>Reporter: Shaofeng SHI
>Priority: Major
>
> Kylin uses HBase as the metastore; But in some cases user expects the 
> metadata not in HBase.
> Sonny Heer from mailing list mentioned:
> "I'm fairly certain anyone using Kylin with AWS EMR will benefit from this.   
> Having multiple hbase clusters across AZs is a huge benefit.  BTW only thing 
> blocking at the moment is write operations happening from kylin query nodes."



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (KYLIN-3522) PrepareStatement cache issue

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI resolved KYLIN-3522.
-
Resolution: Fixed

> PrepareStatement cache issue
> 
>
> Key: KYLIN-3522
> URL: https://issues.apache.org/jira/browse/KYLIN-3522
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v2.5.0
>Reporter: Ma Gang
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3522.patch
>
>
> When enable server side prepareStatement cache, OLAPContext is cached with 
> prepareStatement object, because filter is also in the OLAPContext, so the 
> condition values in the comparedFilter is also cached, that may cause problem 
> in some cases.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3522) PrepareStatement cache issue

2018-09-03 Thread Shaofeng SHI (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601843#comment-16601843
 ] 

Shaofeng SHI commented on KYLIN-3522:
-

+1

> PrepareStatement cache issue
> 
>
> Key: KYLIN-3522
> URL: https://issues.apache.org/jira/browse/KYLIN-3522
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v2.5.0
>Reporter: Ma Gang
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3522.patch
>
>
> When enable server side prepareStatement cache, OLAPContext is cached with 
> prepareStatement object, because filter is also in the OLAPContext, so the 
> condition values in the comparedFilter is also cached, that may cause problem 
> in some cases.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3522) PrepareStatement cache issue

2018-09-03 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601842#comment-16601842
 ] 

ASF subversion and git services commented on KYLIN-3522:


Commit 95a311bbea3f707329f53a24de1cd5973c0debea in kylin's branch 
refs/heads/2.5.x from Ma,Gang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=95a311b ]

KYLIN-3522 PrepareStatement cache issue


> PrepareStatement cache issue
> 
>
> Key: KYLIN-3522
> URL: https://issues.apache.org/jira/browse/KYLIN-3522
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v2.5.0
>Reporter: Ma Gang
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3522.patch
>
>
> When enable server side prepareStatement cache, OLAPContext is cached with 
> prepareStatement object, because filter is also in the OLAPContext, so the 
> condition values in the comparedFilter is also cached, that may cause problem 
> in some cases.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3522) PrepareStatement cache issue

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3522:

Affects Version/s: v2.5.0
Fix Version/s: v2.5.0
   Issue Type: Bug  (was: Improvement)

> PrepareStatement cache issue
> 
>
> Key: KYLIN-3522
> URL: https://issues.apache.org/jira/browse/KYLIN-3522
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v2.5.0
>Reporter: Ma Gang
>Assignee: Ma Gang
>Priority: Minor
> Fix For: v2.5.0
>
> Attachments: KYLIN-3522.patch
>
>
> When enable server side prepareStatement cache, OLAPContext is cached with 
> prepareStatement object, because filter is also in the OLAPContext, so the 
> condition values in the comparedFilter is also cached, that may cause problem 
> in some cases.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3515) Cubing jobs may interfere with each other if use same hive view

2018-09-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601825#comment-16601825
 ] 

ASF GitHub Bot commented on KYLIN-3515:
---

nichunen opened a new pull request #219: KYLIN-3515 Add uuid for materialized 
table of hive view
URL: https://github.com/apache/kylin/pull/219
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Cubing jobs may interfere with each other if use same hive view
> 
>
> Key: KYLIN-3515
> URL: https://issues.apache.org/jira/browse/KYLIN-3515
> Project: Kylin
>  Issue Type: Bug
>  Components: Job Engine
>Affects Versions: v2.4.0
>Reporter: nichunen
>Assignee: nichunen
>Priority: Major
> Fix For: Future
>
> Attachments: Getting started
>
>
> The root cause is for hive view, during cubing, kylin will materialize the 
> view by creating an intermediate table(drop intermediate table first). The 
> intermediate tables' name is like kylin_intermediate_\{view_name}, that means 
> jobs will create tables with the same name if the same view is referenced. So 
> one job's intermediate table may be dropped by another job, in such cases, 
> error like "table not found" will happen



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3525) kylin.source.hive.keep-flat-table参数问题

2018-09-03 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3525:

Fix Version/s: v2.6.0

> kylin.source.hive.keep-flat-table参数问题
> -
>
> Key: KYLIN-3525
> URL: https://issues.apache.org/jira/browse/KYLIN-3525
> Project: Kylin
>  Issue Type: Improvement
>  Components: Streaming
>Affects Versions: v2.4.0
>Reporter: wlxie
>Priority: Major
> Fix For: v2.6.0
>
> Attachments: 1535534470(1).png, HiveMRInput.java
>
>
> kylin.source.hive.keep-flat-table这个参数设置为true后,只是保留了hive表结构,但是数据还是被清除了,查看了源码,这个参数确实只是对表结构进行控制。如果希望数据也保存下来,并且是一个cube下面所有作业的数据都保存到一个表里面(目前是一个作业会产生一个表),是否有什么好的解决方案。
> 附件为v2.4.0源码
> 谢谢。



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3515) Cubing jobs may interfere with each other if use same hive view

2018-09-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601826#comment-16601826
 ] 

ASF GitHub Bot commented on KYLIN-3515:
---

asfgit commented on issue #219: KYLIN-3515 Add uuid for materialized table of 
hive view
URL: https://github.com/apache/kylin/pull/219#issuecomment-418021421
 
 
   Can one of the admins verify this patch?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Cubing jobs may interfere with each other if use same hive view
> 
>
> Key: KYLIN-3515
> URL: https://issues.apache.org/jira/browse/KYLIN-3515
> Project: Kylin
>  Issue Type: Bug
>  Components: Job Engine
>Affects Versions: v2.4.0
>Reporter: nichunen
>Assignee: nichunen
>Priority: Major
> Fix For: Future
>
> Attachments: Getting started
>
>
> The root cause is for hive view, during cubing, kylin will materialize the 
> view by creating an intermediate table(drop intermediate table first). The 
> intermediate tables' name is like kylin_intermediate_\{view_name}, that means 
> jobs will create tables with the same name if the same view is referenced. So 
> one job's intermediate table may be dropped by another job, in such cases, 
> error like "table not found" will happen



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3504) Release 2.4.1

2018-09-03 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601807#comment-16601807
 ] 

ASF subversion and git services commented on KYLIN-3504:


Commit 3528db3f4bfe20b07129049913ba65af48320951 in kylin's branch 
refs/heads/v2.4.1-release from Zhong
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3528db3 ]

KYLIN-3504 update Yanghong Zhong public keys to KEYS


> Release 2.4.1
> -
>
> Key: KYLIN-3504
> URL: https://issues.apache.org/jira/browse/KYLIN-3504
> Project: Kylin
>  Issue Type: Task
>Reporter: Shaofeng SHI
>Assignee: Zhong Yanghong
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)