[GitHub] [kylin] zzcclp commented on a change in pull request #1360: KYLIN-4688 Too many tmp files in HDFS tmp dictionary

2020-08-18 Thread GitBox


zzcclp commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472731647



##
File path: 
storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHFileJob.java
##
@@ -101,6 +102,7 @@ public int run(String[] args) throws Exception {
 
 // Automatic config !
 HFileOutputFormat3.configureIncrementalLoad(job, htable);
+tmpPartitionFilePath = new 
Path(TotalOrderPartitioner.getPartitionFile(job.getConfiguration()));

Review comment:
   Got it.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

2020-08-18 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180270#comment-17180270
 ] 

ASF GitHub Bot commented on KYLIN-4688:
---

zzcclp commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472731647



##
File path: 
storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHFileJob.java
##
@@ -101,6 +102,7 @@ public int run(String[] args) throws Exception {
 
 // Automatic config !
 HFileOutputFormat3.configureIncrementalLoad(job, htable);
+tmpPartitionFilePath = new 
Path(TotalOrderPartitioner.getPartitionFile(job.getConfiguration()));

Review comment:
   Got it.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Too many tmp files in HDFS tmp dictionary
> -
>
> Key: KYLIN-4688
> URL: https://issues.apache.org/jira/browse/KYLIN-4688
> Project: Kylin
>  Issue Type: Bug
>  Components: Others
>Affects Versions: all
>Reporter: QiangZhang
>Priority: Major
> Attachments: image-2020-08-06-18-07-00-377.png, 
> image-2020-08-06-18-29-28-503.png, image-2020-08-06-18-58-00-355.png, 
> image-2020-08-06-19-34-22-515.png, image-2020-08-10-19-38-28-913.png, 
> image-2020-08-10-20-06-01-526.png, image-2020-08-10-20-14-53-854.png, 
> image-2020-08-10-20-18-10-513.png, image-2020-08-10-20-20-07-899.png, 
> image-2020-08-10-20-21-44-137.png, image-2020-08-10-20-49-46-354.png
>
>
> Too many tmp files in HDFS tmp dictionary,and Kylin doesn't clean up 
> automatically
> !image-2020-08-06-18-07-00-377.png!
>   2. when I debug ,I found : !image-2020-08-06-18-29-28-503.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

2020-08-18 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180264#comment-17180264
 ] 

ASF GitHub Bot commented on KYLIN-4688:
---

ITzhangqiang commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472617186



##
File path: 
storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHFileJob.java
##
@@ -101,6 +102,7 @@ public int run(String[] args) throws Exception {
 
 // Automatic config !
 HFileOutputFormat3.configureIncrementalLoad(job, htable);
+tmpPartitionFilePath = new 
Path(TotalOrderPartitioner.getPartitionFile(job.getConfiguration()));

Review comment:
   I‘m sure,that‘s why I put  'TotalOrderPartitioner.getPartitionFile' up 
on the 'reconfigurePartitions'.

##
File path: 
core-common/src/main/java/org/apache/kylin/common/util/HadoopUtil.java
##
@@ -69,13 +68,6 @@ public static Configuration getCurrentConfiguration() {
 }
 
 public static Configuration healSickConfig(Configuration conf) {
-// https://issues.apache.org/jira/browse/KYLIN-953

Review comment:
   I checked,there is no affects on others.Because these two configurations 
belong to Hbase, where Hbase is used, HbaseConnection is used to get the 
configuration.And in HBaseConnection#newHBaseConfiguration,special treatment is 
given to these two configurations in this method.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Too many tmp files in HDFS tmp dictionary
> -
>
> Key: KYLIN-4688
> URL: https://issues.apache.org/jira/browse/KYLIN-4688
> Project: Kylin
>  Issue Type: Bug
>  Components: Others
>Affects Versions: all
>Reporter: QiangZhang
>Priority: Major
> Attachments: image-2020-08-06-18-07-00-377.png, 
> image-2020-08-06-18-29-28-503.png, image-2020-08-06-18-58-00-355.png, 
> image-2020-08-06-19-34-22-515.png, image-2020-08-10-19-38-28-913.png, 
> image-2020-08-10-20-06-01-526.png, image-2020-08-10-20-14-53-854.png, 
> image-2020-08-10-20-18-10-513.png, image-2020-08-10-20-20-07-899.png, 
> image-2020-08-10-20-21-44-137.png, image-2020-08-10-20-49-46-354.png
>
>
> Too many tmp files in HDFS tmp dictionary,and Kylin doesn't clean up 
> automatically
> !image-2020-08-06-18-07-00-377.png!
>   2. when I debug ,I found : !image-2020-08-06-18-29-28-503.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [kylin] xuekaiqi opened a new pull request #1367: Improve Development part in the website

2020-08-18 Thread GitBox


xuekaiqi opened a new pull request #1367:
URL: https://github.com/apache/kylin/pull/1367


   ## Proposed changes
   
   Describe the big picture of your changes here to communicate to the 
maintainers why we should accept this pull request. If it fixes a bug or 
resolves a feature request, be sure to link to that issue.
   
   ## Types of changes
   
   What types of changes does your code introduce to Kylin?
   _Put an `x` in the boxes that apply_
   
   - [ ] Bugfix (non-breaking change which fixes an issue)
   - [ ] New feature (non-breaking change which adds functionality)
   - [ ] Breaking change (fix or feature that would cause existing 
functionality to not work as expected)
   - [x] Documentation Update (if none of the other choices apply)
   
   ## Checklist
   
   _Put an `x` in the boxes that apply. You can also fill these out after 
creating the PR. If you're unsure about any of them, don't hesitate to ask. 
We're here to help! This is simply a reminder of what we are going to look for 
before merging your code._
   
   - [ ] I have create an issue on [Kylin's 
jira](https://issues.apache.org/jira/browse/KYLIN), and have described the 
bug/feature there in detail
   - [ ] Commit messages in my PR start with the related jira ID, like 
"KYLIN- Make Kylin project open-source"
   - [ ] Compiling and unit tests pass locally with my changes
   - [ ] I have added tests that prove my fix is effective or that my feature 
works
   - [ ] If this change need a document change, I will prepare another pr 
against the `document` branch
   - [ ] Any dependent changes have been merged
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
user@kylin or dev@kylin by explaining why you chose the solution you did and 
what alternatives you considered, etc...
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [kylin] ITzhangqiang commented on a change in pull request #1360: KYLIN-4688 Too many tmp files in HDFS tmp dictionary

2020-08-18 Thread GitBox


ITzhangqiang commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472617186



##
File path: 
storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHFileJob.java
##
@@ -101,6 +102,7 @@ public int run(String[] args) throws Exception {
 
 // Automatic config !
 HFileOutputFormat3.configureIncrementalLoad(job, htable);
+tmpPartitionFilePath = new 
Path(TotalOrderPartitioner.getPartitionFile(job.getConfiguration()));

Review comment:
   I‘m sure,that‘s why I put  'TotalOrderPartitioner.getPartitionFile' up 
on the 'reconfigurePartitions'.

##
File path: 
core-common/src/main/java/org/apache/kylin/common/util/HadoopUtil.java
##
@@ -69,13 +68,6 @@ public static Configuration getCurrentConfiguration() {
 }
 
 public static Configuration healSickConfig(Configuration conf) {
-// https://issues.apache.org/jira/browse/KYLIN-953

Review comment:
   I checked,there is no affects on others.Because these two configurations 
belong to Hbase, where Hbase is used, HbaseConnection is used to get the 
configuration.And in HBaseConnection#newHBaseConfiguration,special treatment is 
given to these two configurations in this method.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Assigned] (KYLIN-4708) Improve Development part in the website

2020-08-18 Thread xuekaiqi (Jira)


 [ 
https://issues.apache.org/jira/browse/KYLIN-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

xuekaiqi reassigned KYLIN-4708:
---

Assignee: xuekaiqi

> Improve Development part in the website
> ---
>
> Key: KYLIN-4708
> URL: https://issues.apache.org/jira/browse/KYLIN-4708
> Project: Kylin
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: xuekaiqi
>Assignee: xuekaiqi
>Priority: Minor
>
> In the development par of the website:
>  * We have released v3.1, so the roadmap should be updated 
> [http://kylin.apache.org/development/index.html]
>  * There is no English version for Kylin doc writing specification
>  * There are some format error, for example, use English punctuation in 
> Chinese document
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (KYLIN-4708) Improve Development part in the website

2020-08-18 Thread xuekaiqi (Jira)
xuekaiqi created KYLIN-4708:
---

 Summary: Improve Development part in the website
 Key: KYLIN-4708
 URL: https://issues.apache.org/jira/browse/KYLIN-4708
 Project: Kylin
  Issue Type: Improvement
  Components: Documentation
Reporter: xuekaiqi


In the development par of the website:
 * We have released v3.1, so the roadmap should be updated 
[http://kylin.apache.org/development/index.html]
 * There is no English version for Kylin doc writing specification
 * There are some format error, for example, use English punctuation in Chinese 
document

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (KYLIN-4707) Add one config to disable mapper side combiner especially when there's topn measure

2020-08-18 Thread Zhong Yanghong (Jira)


 [ 
https://issues.apache.org/jira/browse/KYLIN-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhong Yanghong updated KYLIN-4707:
--
Summary: Add one config to disable mapper side combiner especially when 
there's topn measure  (was: Add one config to disable mapper side combiner 
especially there's topn measure)

> Add one config to disable mapper side combiner especially when there's topn 
> measure
> ---
>
> Key: KYLIN-4707
> URL: https://issues.apache.org/jira/browse/KYLIN-4707
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
>
> Since mapper side combiner is only using one single thread to do measure 
> merge. If there's some topn measure defined in cube, it will become very slow 
> to finish a mapper task. It's better to provide an option to disable it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (KYLIN-4707) Add one config to disable mapper side combiner especially there's topn measure

2020-08-18 Thread Zhong Yanghong (Jira)
Zhong Yanghong created KYLIN-4707:
-

 Summary: Add one config to disable mapper side combiner especially 
there's topn measure
 Key: KYLIN-4707
 URL: https://issues.apache.org/jira/browse/KYLIN-4707
 Project: Kylin
  Issue Type: Improvement
Reporter: Zhong Yanghong
Assignee: Zhong Yanghong


Since mapper side combiner is only using one single thread to do measure merge. 
If there's some topn measure defined in cube, it will become very slow to 
finish a mapper task. It's better to provide an option to disable it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-4706) when use hive to build global dict get wrong value when the dict dim is also a count distinct measure

2020-08-18 Thread kaishen (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180219#comment-17180219
 ] 

kaishen commented on KYLIN-4706:


I found that ,The query use global_dict table's dict_val column to execute 
"group by" action , dict_key should be use.

> when use hive to build global dict get wrong value when the dict dim is also 
> a count distinct measure
> -
>
> Key: KYLIN-4706
> URL: https://issues.apache.org/jira/browse/KYLIN-4706
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v3.1.0
>Reporter: kaishen
>Priority: Major
> Attachments: dim_tbill_code.png, hive_dic.png, 
> measure_tbill_code.png, no_hive_dic.png
>
>
> I have a cube , with a count distinct measure which is also a dimension. When 
> I use hive to build global dict, then when I query the cube I can't  get the 
> global dict colume real value .



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

2020-08-18 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180206#comment-17180206
 ] 

ASF GitHub Bot commented on KYLIN-4688:
---

zzcclp commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472589799



##
File path: 
core-common/src/main/java/org/apache/kylin/common/util/HadoopUtil.java
##
@@ -69,13 +68,6 @@ public static Configuration getCurrentConfiguration() {
 }
 
 public static Configuration healSickConfig(Configuration conf) {
-// https://issues.apache.org/jira/browse/KYLIN-953

Review comment:
   There are some places calling this method, please check whether impact 
others.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Too many tmp files in HDFS tmp dictionary
> -
>
> Key: KYLIN-4688
> URL: https://issues.apache.org/jira/browse/KYLIN-4688
> Project: Kylin
>  Issue Type: Bug
>  Components: Others
>Affects Versions: all
>Reporter: QiangZhang
>Priority: Major
> Attachments: image-2020-08-06-18-07-00-377.png, 
> image-2020-08-06-18-29-28-503.png, image-2020-08-06-18-58-00-355.png, 
> image-2020-08-06-19-34-22-515.png, image-2020-08-10-19-38-28-913.png, 
> image-2020-08-10-20-06-01-526.png, image-2020-08-10-20-14-53-854.png, 
> image-2020-08-10-20-18-10-513.png, image-2020-08-10-20-20-07-899.png, 
> image-2020-08-10-20-21-44-137.png, image-2020-08-10-20-49-46-354.png
>
>
> Too many tmp files in HDFS tmp dictionary,and Kylin doesn't clean up 
> automatically
> !image-2020-08-06-18-07-00-377.png!
>   2. when I debug ,I found : !image-2020-08-06-18-29-28-503.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [kylin] zzcclp commented on a change in pull request #1360: KYLIN-4688 Too many tmp files in HDFS tmp dictionary

2020-08-18 Thread GitBox


zzcclp commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472589799



##
File path: 
core-common/src/main/java/org/apache/kylin/common/util/HadoopUtil.java
##
@@ -69,13 +68,6 @@ public static Configuration getCurrentConfiguration() {
 }
 
 public static Configuration healSickConfig(Configuration conf) {
-// https://issues.apache.org/jira/browse/KYLIN-953

Review comment:
   There are some places calling this method, please check whether impact 
others.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

2020-08-18 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180204#comment-17180204
 ] 

ASF GitHub Bot commented on KYLIN-4688:
---

zzcclp commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472589173



##
File path: 
storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHFileJob.java
##
@@ -101,6 +102,7 @@ public int run(String[] args) throws Exception {
 
 // Automatic config !
 HFileOutputFormat3.configureIncrementalLoad(job, htable);
+tmpPartitionFilePath = new 
Path(TotalOrderPartitioner.getPartitionFile(job.getConfiguration()));

Review comment:
   The value get from 'TotalOrderPartitioner.getPartitionFile' will be 
changed in method 'reconfigurePartitions', are you sure that the value of  
'tmpPartitionFilePath' is right?





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Too many tmp files in HDFS tmp dictionary
> -
>
> Key: KYLIN-4688
> URL: https://issues.apache.org/jira/browse/KYLIN-4688
> Project: Kylin
>  Issue Type: Bug
>  Components: Others
>Affects Versions: all
>Reporter: QiangZhang
>Priority: Major
> Attachments: image-2020-08-06-18-07-00-377.png, 
> image-2020-08-06-18-29-28-503.png, image-2020-08-06-18-58-00-355.png, 
> image-2020-08-06-19-34-22-515.png, image-2020-08-10-19-38-28-913.png, 
> image-2020-08-10-20-06-01-526.png, image-2020-08-10-20-14-53-854.png, 
> image-2020-08-10-20-18-10-513.png, image-2020-08-10-20-20-07-899.png, 
> image-2020-08-10-20-21-44-137.png, image-2020-08-10-20-49-46-354.png
>
>
> Too many tmp files in HDFS tmp dictionary,and Kylin doesn't clean up 
> automatically
> !image-2020-08-06-18-07-00-377.png!
>   2. when I debug ,I found : !image-2020-08-06-18-29-28-503.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [kylin] zzcclp commented on a change in pull request #1360: KYLIN-4688 Too many tmp files in HDFS tmp dictionary

2020-08-18 Thread GitBox


zzcclp commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472589173



##
File path: 
storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHFileJob.java
##
@@ -101,6 +102,7 @@ public int run(String[] args) throws Exception {
 
 // Automatic config !
 HFileOutputFormat3.configureIncrementalLoad(job, htable);
+tmpPartitionFilePath = new 
Path(TotalOrderPartitioner.getPartitionFile(job.getConfiguration()));

Review comment:
   The value get from 'TotalOrderPartitioner.getPartitionFile' will be 
changed in method 'reconfigurePartitions', are you sure that the value of  
'tmpPartitionFilePath' is right?





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (KYLIN-4696) The result is wrong when using multiple dimension with in filter which including multiple filter value

2020-08-18 Thread Zhichao Zhang (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180198#comment-17180198
 ] 

Zhichao  Zhang commented on KYLIN-4696:
---

[~fengwenduo], can you add my wx account: xm_zzc? I can't reproduce this issue.

> The result is wrong when using multiple dimension with in filter which 
> including multiple filter value
> --
>
> Key: KYLIN-4696
> URL: https://issues.apache.org/jira/browse/KYLIN-4696
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine, Storage - HBase
>Affects Versions: v3.1.0, v3.0.1
>Reporter: fengwenduo
>Priority: Major
> Attachments: correct01.png, correct02.png, order_cube_desc.json, 
> orders_cube.json, orders_model.json, query_from_cube.sql, test_data.sql, 
> wrong.png
>
>
> I have a cube with 17 dimensions, when I query from the cube using multiple 
> dimension with in filter which including multiple filter value, the result is 
> not correct. 
> But if i query the cube first, then filter outside the result in another 
> query, the result is correct.
> Or if i add trim on the dimension when query the cube directly, the result is 
> correct too.
> Till now, I do not find other cube have this question. I do not know why?
> I attach the snapshot of the query and result.
> Thank you!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (KYLIN-4706) when use hive to build global dict get wrong value when the dict dim is also a count distinct measure

2020-08-18 Thread kaishen (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180195#comment-17180195
 ] 

kaishen commented on KYLIN-4706:


from the pictures well can see :  the column tbill_code is a dimension which 
also is a count-distinct measure  with bitmap , it's real value like 
"baitai_200817000854782914" ,when I use "hive to build global dict" then when I 
query , look at the picture "hive_dic.png" , when I use normal action to bulid 
global dict , the query result look at the picture "no_hive_dic.png"

> when use hive to build global dict get wrong value when the dict dim is also 
> a count distinct measure
> -
>
> Key: KYLIN-4706
> URL: https://issues.apache.org/jira/browse/KYLIN-4706
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v3.1.0
>Reporter: kaishen
>Priority: Major
> Attachments: dim_tbill_code.png, hive_dic.png, 
> measure_tbill_code.png, no_hive_dic.png
>
>
> I have a cube , with a count distinct measure which is also a dimension. When 
> I use hive to build global dict, then when I query the cube I can't  get the 
> global dict colume real value .



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (KYLIN-4706) when use hive to build global dict get wrong value when the dict dim is also a count distinct measure

2020-08-18 Thread kaishen (Jira)
kaishen created KYLIN-4706:
--

 Summary: when use hive to build global dict get wrong value when 
the dict dim is also a count distinct measure
 Key: KYLIN-4706
 URL: https://issues.apache.org/jira/browse/KYLIN-4706
 Project: Kylin
  Issue Type: Bug
  Components: Query Engine
Affects Versions: v3.1.0
Reporter: kaishen
 Attachments: dim_tbill_code.png, hive_dic.png, measure_tbill_code.png, 
no_hive_dic.png

I have a cube , with a count distinct measure which is also a dimension. When I 
use hive to build global dict, then when I query the cube I can't  get the 
global dict colume real value .



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [kylin] hit-lacus merged pull request #1362: minor, fix sonar reported bugs

2020-08-18 Thread GitBox


hit-lacus merged pull request #1362:
URL: https://github.com/apache/kylin/pull/1362


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [kylin] hit-lacus commented on pull request #1362: minor, fix sonar reported bugs

2020-08-18 Thread GitBox


hit-lacus commented on pull request #1362:
URL: https://github.com/apache/kylin/pull/1362#issuecomment-675522417


   This looks good to me.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [kylin] hit-lacus merged pull request #1363: Fix sonar vulunerability issues

2020-08-18 Thread GitBox


hit-lacus merged pull request #1363:
URL: https://github.com/apache/kylin/pull/1363


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [kylin] hit-lacus commented on pull request #1363: Fix sonar vulunerability issues

2020-08-18 Thread GitBox


hit-lacus commented on pull request #1363:
URL: https://github.com/apache/kylin/pull/1363#issuecomment-675515654


   LGTM , thank you.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (KYLIN-4701) Upgrade front-end from HBase Storage to Parquet Storage

2020-08-18 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/KYLIN-4701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179411#comment-17179411
 ] 

ASF GitHub Bot commented on KYLIN-4701:
---

lgtm-com[bot] commented on pull request #1364:
URL: https://github.com/apache/kylin/pull/1364#issuecomment-675298087


   This pull request **fixes 1 alert** when merging 
07d90aaed128b6cb306825fae45270abcac060ce into 
1b4e4c245e620f1c2ccfc1267c5f7bd9a382aa83 - [view on 
LGTM.com](https://lgtm.com/projects/g/apache/kylin/rev/pr-22b86ed2084de3c1d5fcb61e100af275391228b5)
   
   **fixed alerts:**
   
   * 1 for Duplicate HTML element attributes



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Upgrade front-end from HBase Storage to Parquet Storage
> ---
>
> Key: KYLIN-4701
> URL: https://issues.apache.org/jira/browse/KYLIN-4701
> Project: Kylin
>  Issue Type: Sub-task
>  Components: Web 
>Reporter: Xiaoxiang Yu
>Priority: Major
> Fix For: v4.0.0-beta
>
>
> In Parquet Storage, some previous/advanced features are not supported in new 
> implementation, so we have to change front-end. Including 
>  
>  * Advanced setting in Cube design 
>  * Data source 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [kylin] lgtm-com[bot] commented on pull request #1364: KYLIN-4701 Front end change for Parquet Storage

2020-08-18 Thread GitBox


lgtm-com[bot] commented on pull request #1364:
URL: https://github.com/apache/kylin/pull/1364#issuecomment-675298087


   This pull request **fixes 1 alert** when merging 
07d90aaed128b6cb306825fae45270abcac060ce into 
1b4e4c245e620f1c2ccfc1267c5f7bd9a382aa83 - [view on 
LGTM.com](https://lgtm.com/projects/g/apache/kylin/rev/pr-22b86ed2084de3c1d5fcb61e100af275391228b5)
   
   **fixed alerts:**
   
   * 1 for Duplicate HTML element attributes



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Created] (KYLIN-4705) Monitor Spark's AppMaster for QueryServer

2020-08-18 Thread Xiaoxiang Yu (Jira)
Xiaoxiang Yu created KYLIN-4705:
---

 Summary: Monitor Spark's AppMaster for QueryServer
 Key: KYLIN-4705
 URL: https://issues.apache.org/jira/browse/KYLIN-4705
 Project: Kylin
  Issue Type: Sub-task
Reporter: Xiaoxiang Yu


In Parquet Storage, we have a long-running Spark Application which we call it 
"sparder-context", it is create automatically. It is used to scan and read 
parquet files. I guess if we should manage it in Kylin Web UI.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (KYLIN-4704) Upgrade sample metadata

2020-08-18 Thread Xiaoxiang Yu (Jira)
Xiaoxiang Yu created KYLIN-4704:
---

 Summary: Upgrade sample metadata
 Key: KYLIN-4704
 URL: https://issues.apache.org/jira/browse/KYLIN-4704
 Project: Kylin
  Issue Type: Sub-task
Reporter: Xiaoxiang Yu


I guess if we should add more measures for Cube kylin_sales .



--
This message was sent by Atlassian Jira
(v8.3.4#803005)