[jira] [Comment Edited] (KYLIN-3311) Segments overlap error

2018-03-24 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412880#comment-16412880
 ] 

liyang edited comment on KYLIN-3311 at 3/25/18 5:26 AM:


Thanks for reporting. I'm not sure of the root cause yet. It seems the first 
update was actually successful, however an IllegalStateException was thrown 
after that, caused a retry, and caused the same segment being added twice.

We need to enhance the code to produce more logs first. Then if the problem 
re-occurs, we can hunt down the root cause.


was (Author: liyang.g...@gmail.com):
Thanks for reporting. I'm not sure of the root cause yet. It seems the first 
update was actually successfully, but however an IllegalStateException was 
thrown after that, caused a retry, and caused the same segment being added 
twice.

I guess we need to enhance the code to produce more logs first. Then if the 
problem re-occurs, we can hunt down the root cause.

> Segments overlap error
> --
>
> Key: KYLIN-3311
> URL: https://issues.apache.org/jira/browse/KYLIN-3311
> Project: Kylin
>  Issue Type: Bug
>  Components: Metadata
>Affects Versions: v2.3.0
>Reporter: xujing
>Priority: Major
>  Labels: build
> Attachments: Segments_Overlap_ErrorLog.txt
>
>
> when "updateCubeWithRetry" method be called at first time ,
> line newSegs.validate();was passed .
> then 
> cube = crud.save(cube);seem with error throw exception
> write conflict to update cube  at try 0 ,will retry...
> while retry "updateCubeWithRetry" start
> line newSegs.validate();was not passed .
> throw exception 
> Segments overlap: [2018031800_2018031900] and 
> sales_order_channel[2018031800_201803
> 1900]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3311) Segments overlap error

2018-03-24 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412880#comment-16412880
 ] 

liyang commented on KYLIN-3311:
---

Thanks for reporting. I'm not sure of the root cause yet. It seems the first 
update was actually successfully, but however an IllegalStateException was 
thrown after that, caused a retry, and caused the same segment being added 
twice.

I guess we need to enhance the code to produce more logs first. Then if the 
problem re-occurs, we can hunt down the root cause.

> Segments overlap error
> --
>
> Key: KYLIN-3311
> URL: https://issues.apache.org/jira/browse/KYLIN-3311
> Project: Kylin
>  Issue Type: Bug
>  Components: Metadata
>Affects Versions: v2.3.0
>Reporter: xujing
>Priority: Major
>  Labels: build
> Attachments: Segments_Overlap_ErrorLog.txt
>
>
> when "updateCubeWithRetry" method be called at first time ,
> line newSegs.validate();was passed .
> then 
> cube = crud.save(cube);seem with error throw exception
> write conflict to update cube  at try 0 ,will retry...
> while retry "updateCubeWithRetry" start
> line newSegs.validate();was not passed .
> throw exception 
> Segments overlap: [2018031800_2018031900] and 
> sales_order_channel[2018031800_201803
> 1900]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3276) Fix the query cache bug with dynamic parameter

2018-03-24 Thread Billy Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Billy Liu updated KYLIN-3276:
-
Summary: Fix the query cache bug with dynamic parameter  (was: query with 
dynamic parameter get the same query result)

> Fix the query cache bug with dynamic parameter
> --
>
> Key: KYLIN-3276
> URL: https://issues.apache.org/jira/browse/KYLIN-3276
> Project: Kylin
>  Issue Type: Bug
>  Components: Driver - JDBC, Query Engine
>Affects Versions: v2.2.0
> Environment: Kylin 2.2.0, JDK 1.8
>Reporter: ZHAOXIXIN
>Assignee: nichunen
>Priority: Major
> Fix For: v2.3.1
>
>
> sql:"select distinct uid from table where daytime=? limit 70" 
> ps.setString(1,"2018-01-03") 
> store the result to ArrayList, and print the size of ArrayList. 
> when I set the daytime to different dates, the same result I got. 
> I changed the sql, just change limit value for example 
> sql:"select distinct uid from table where daytime=? limit 60" 
> then I got the right value the same like query from GUI:count (distinct uid) 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3270) Fix the blocking issue in Cube optimizing job

2018-03-24 Thread Billy Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Billy Liu updated KYLIN-3270:
-
Summary: Fix the blocking issue in Cube optimizing job  (was: Add 
integration test for Optimize Job)

> Fix the blocking issue in Cube optimizing job
> -
>
> Key: KYLIN-3270
> URL: https://issues.apache.org/jira/browse/KYLIN-3270
> Project: Kylin
>  Issue Type: Sub-task
>  Components: Tools, Build and Test
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Critical
> Fix For: v2.3.1
>
> Attachments: APACHE-KYLIN-3270-fix-for-2.3.1.patch, 
> APACHE-KYLIN-3270-master.patch, APACHE-KYLIN-3270.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3277) Kylin should override hiveconf settings when connecting to hive using jdbc

2018-03-24 Thread Billy Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Billy Liu updated KYLIN-3277:
-
Fix Version/s: (was: v2.3.1)

> Kylin should override hiveconf settings when connecting to hive using jdbc
> --
>
> Key: KYLIN-3277
> URL: https://issues.apache.org/jira/browse/KYLIN-3277
> Project: Kylin
>  Issue Type: Bug
>Reporter: Chuqian Yu
>Priority: Major
>  Labels: patch
> Attachments: 0001-KYLIN-3277.patch
>
>
> Hi, kylin developers. My cube building procedure failing at Step 2 
> "Redistribute Flat Hive Table" because Kylin always trying to submit a mr job 
> to the default yarn queue.
>  
> I have overrided the mapred.job.queue.name property in both 
> kylin_hive_conf.xml and kylin.properties but it doesn't work. 
>  
> kylin.properties
> ```
> kylin.source.hive.beeline-params=-n hive -p hive --hiveconf 
> mapred.job.queue.name=myQueue  -u 
> "jdbc:hive2://myZk:2181/;serviceDiscoveryMode=zooKeeper;" 
> ```
>  
> kylin_hive_conf.xml
> ```
>    
>    mapred.job.queue.name
>    myQueue
>    
> ```
>  
> After digging into the source code ,I found that kylin try to get the row 
> count of hive table before redistributing it. But it dose not override the 
> hive configuration when using jdbc to connect to hive server.
>  
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (KYLIN-3288) "Sqoop To Flat Hive Table" step should specify "mapreduce.queue.name"

2018-03-24 Thread Dong Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dong Li resolved KYLIN-3288.

Resolution: Fixed

> "Sqoop To Flat Hive Table" step should specify "mapreduce.queue.name"
> -
>
> Key: KYLIN-3288
> URL: https://issues.apache.org/jira/browse/KYLIN-3288
> Project: Kylin
>  Issue Type: Bug
>  Components: RDBMS Source
>Reporter: Shaoxiong Zhan
>Assignee: Shaoxiong Zhan
>Priority: Major
> Fix For: v2.3.1
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)