[jira] [Commented] (KYLIN-3404) Last optimized time detail was not showing after cube optimization
[
https://issues.apache.org/jira/browse/KYLIN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509773#comment-16509773
]
Chuqian Yu commented on KYLIN-3404:
---
Sure, the patch was re-generated and attached
> Last optimized time detail was not showing after cube optimization
> --
>
> Key: KYLIN-3404
> URL: https://issues.apache.org/jira/browse/KYLIN-3404
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: v2.3.0, v2.3.1
>Reporter: Chuqian Yu
>Assignee: Chuqian Yu
>Priority: Major
> Fix For: v2.4.0, v2.3.2
>
> Attachments:
> 0001-KYLIN-3404-The-last-optimized-time-not-showing-up-on.patch
>
>
> There are two reasons for last optimized time detail not showing after cube
> optimization.
> 1. CheckpointExecutable try to update last optimization time of a cube
> without copying it.
>
> {code:java}
> 2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
> bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
> 1th retries for onExecuteFinished fails due to {}
> java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-06-12 20:53:37,063 ERROR [pool-9-thread-7]
> threadpool.DefaultScheduler:302 : ExecuteException
> job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.IllegalArgumentException
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> ... 4 more
> {code}
> 2. CubeInstanceResponse did not copy the field 'cuboid_last_optimized' from
> CubeInstance
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3404) Last optimized time detail was not showing after cube optimization
[
https://issues.apache.org/jira/browse/KYLIN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chuqian Yu updated KYLIN-3404:
--
Attachment: (was: KYLIN-3404.patch)
> Last optimized time detail was not showing after cube optimization
> --
>
> Key: KYLIN-3404
> URL: https://issues.apache.org/jira/browse/KYLIN-3404
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: v2.3.0, v2.3.1
>Reporter: Chuqian Yu
>Assignee: Chuqian Yu
>Priority: Major
> Fix For: v2.4.0, v2.3.2
>
> Attachments:
> 0001-KYLIN-3404-The-last-optimized-time-not-showing-up-on.patch
>
>
> There are two reasons for last optimized time detail not showing after cube
> optimization.
> 1. CheckpointExecutable try to update last optimization time of a cube
> without copying it.
>
> {code:java}
> 2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
> bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
> 1th retries for onExecuteFinished fails due to {}
> java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-06-12 20:53:37,063 ERROR [pool-9-thread-7]
> threadpool.DefaultScheduler:302 : ExecuteException
> job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.IllegalArgumentException
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> ... 4 more
> {code}
> 2. CubeInstanceResponse did not copy the field 'cuboid_last_optimized' from
> CubeInstance
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3404) Last optimized time detail was not showing after cube optimization
[
https://issues.apache.org/jira/browse/KYLIN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chuqian Yu updated KYLIN-3404:
--
Attachment: 0001-KYLIN-3404-The-last-optimized-time-not-showing-up-on.patch
> Last optimized time detail was not showing after cube optimization
> --
>
> Key: KYLIN-3404
> URL: https://issues.apache.org/jira/browse/KYLIN-3404
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: v2.3.0, v2.3.1
>Reporter: Chuqian Yu
>Assignee: Chuqian Yu
>Priority: Major
> Fix For: v2.4.0, v2.3.2
>
> Attachments:
> 0001-KYLIN-3404-The-last-optimized-time-not-showing-up-on.patch,
> KYLIN-3404.patch
>
>
> There are two reasons for last optimized time detail not showing after cube
> optimization.
> 1. CheckpointExecutable try to update last optimization time of a cube
> without copying it.
>
> {code:java}
> 2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
> bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
> 1th retries for onExecuteFinished fails due to {}
> java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-06-12 20:53:37,063 ERROR [pool-9-thread-7]
> threadpool.DefaultScheduler:302 : ExecuteException
> job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.IllegalArgumentException
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> ... 4 more
> {code}
> 2. CubeInstanceResponse did not copy the field 'cuboid_last_optimized' from
> CubeInstance
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509720#comment-16509720 ] Chuqian Yu commented on KYLIN-3351: --- Hi, [~praveenece] . Sorry for replying late . I have reproduced this bug in v2.3.1 and open a new [issues|https://issues.apache.org/jira/browse/KYLIN-3404] to solve it. Hope it helps. > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > Attachments: image 1.png, image 2.png > > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3404) Last optimized time detail was not showing after cube optimization
[
https://issues.apache.org/jira/browse/KYLIN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509713#comment-16509713
]
Chuqian Yu commented on KYLIN-3404:
---
Hi [~Shaofengshi] , patch attached. Would you have a look ?
> Last optimized time detail was not showing after cube optimization
> --
>
> Key: KYLIN-3404
> URL: https://issues.apache.org/jira/browse/KYLIN-3404
> Project: Kylin
> Issue Type: Bug
>Reporter: Chuqian Yu
>Priority: Major
> Attachments: KYLIN-3404.patch
>
>
> There are two reasons for last optimized time detail not showing after cube
> optimization.
> 1. CheckpointExecutable try to update last optimization time of a cube
> without copying it.
>
> {code:java}
> 2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
> bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
> 1th retries for onExecuteFinished fails due to {}
> java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-06-12 20:53:37,063 ERROR [pool-9-thread-7]
> threadpool.DefaultScheduler:302 : ExecuteException
> job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.IllegalArgumentException
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> ... 4 more
> {code}
> 2. CubeInstanceResponse did not copy the field 'cuboid_last_optimized' from
> CubeInstance
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3404) Last optimized time detail was not showing after cube optimization
[
https://issues.apache.org/jira/browse/KYLIN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chuqian Yu updated KYLIN-3404:
--
Description:
There are two reasons for last optimized time detail not showing after cube
optimization.
1. CheckpointExecutable try to update last optimization time of a cube without
copying it.
{code:java}
2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
1th retries for onExecuteFinished fails due to {}
java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2018-06-12 20:53:37,063 ERROR [pool-9-thread-7] threadpool.DefaultScheduler:302
: ExecuteException job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
org.apache.kylin.job.exception.ExecuteException:
java.lang.IllegalArgumentException
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
... 4 more
{code}
2. CubeInstanceResponse did not copy the field 'cuboid_last_optimized' from
CubeInstance
was:
There two reason which maks
1. CheckpointExecutable try to update last optimization time of a cube without
copying it.
2. CubeInstanceResponse did not copy the field 'cuboid_last_optimized' from
CubeInstance
{code:java}
2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
1th retries for onExecuteFinished fails due to {}
java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2018-06-12 20:53:37,063 ERROR [pool-9-thread-7] threadpool.DefaultScheduler:302
: ExecuteException job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
org.apache.kylin.job.exception.ExecuteException:
java.lang.IllegalArgumentException
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
... 4 more
{code}
> Last optimized time detail was not showing after cube optimization
>
[jira] [Updated] (KYLIN-3404) Last optimized time detail was not showing after cube optimization
[
https://issues.apache.org/jira/browse/KYLIN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chuqian Yu updated KYLIN-3404:
--
Description:
There two reason which maks
1. CheckpointExecutable try to update last optimization time of a cube without
copying it.
2. CubeInstanceResponse did not copy the field 'cuboid_last_optimized' from
CubeInstance
{code:java}
2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
1th retries for onExecuteFinished fails due to {}
java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2018-06-12 20:53:37,063 ERROR [pool-9-thread-7] threadpool.DefaultScheduler:302
: ExecuteException job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
org.apache.kylin.job.exception.ExecuteException:
java.lang.IllegalArgumentException
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
... 4 more
{code}
was:
{code:java}
2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
1th retries for onExecuteFinished fails due to {}
java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2018-06-12 20:53:37,063 ERROR [pool-9-thread-7] threadpool.DefaultScheduler:302
: ExecuteException job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
org.apache.kylin.job.exception.ExecuteException:
java.lang.IllegalArgumentException
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
... 4 more
{code}
> Last optimized time detail was not showing after cube optimization
> --
>
> Key: KYLIN-3404
> URL: https://issues.apache.org/jira/browse/KYLIN-3404
> Project: Kylin
> Issue Type: Bug
>Reporter: Chuqian Yu
>Priority: Major
>
[jira] [Updated] (KYLIN-3404) IllegalArgumentException throw during cube optimization
[
https://issues.apache.org/jira/browse/KYLIN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chuqian Yu updated KYLIN-3404:
--
Attachment: KYLIN-3404.patch
> IllegalArgumentException throw during cube optimization
> -
>
> Key: KYLIN-3404
> URL: https://issues.apache.org/jira/browse/KYLIN-3404
> Project: Kylin
> Issue Type: Bug
>Reporter: Chuqian Yu
>Priority: Major
> Attachments: KYLIN-3404.patch
>
>
> {code:java}
> 2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
> bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
> 1th retries for onExecuteFinished fails due to {}
> java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-06-12 20:53:37,063 ERROR [pool-9-thread-7]
> threadpool.DefaultScheduler:302 : ExecuteException
> job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.IllegalArgumentException
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
> at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
> at
> org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
> at
> org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
> ... 4 more
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3404) IllegalArgumentException throw during cube optimization
Chuqian Yu created KYLIN-3404:
-
Summary: IllegalArgumentException throw during cube optimization
Key: KYLIN-3404
URL: https://issues.apache.org/jira/browse/KYLIN-3404
Project: Kylin
Issue Type: Bug
Reporter: Chuqian Yu
{code:java}
2018-06-12 20:53:37,062 ERROR [Scheduler 2088456043 Job
bea409fd-bf7d-49d6-a52a-7fed0919cf96-376] execution.AbstractExecutable:100 :
1th retries for onExecuteFinished fails due to {}
java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2018-06-12 20:53:37,063 ERROR [pool-9-thread-7] threadpool.DefaultScheduler:302
: ExecuteException job:bea409fd-bf7d-49d6-a52a-7fed0919cf96
org.apache.kylin.job.exception.ExecuteException:
java.lang.IllegalArgumentException
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at org.apache.kylin.cube.CubeUpdate.setCubeInstance(CubeUpdate.java:50)
at org.apache.kylin.cube.CubeUpdate.(CubeUpdate.java:41)
at
org.apache.kylin.job.execution.CheckpointExecutable.onExecuteFinished(CheckpointExecutable.java:88)
at
org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
... 4 more
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[
https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469877#comment-16469877
]
Chuqian Yu commented on KYLIN-3351:
---
System cube uses HIVE table as data source, so you should use HiveSink to
store all these metrics. Try this way:
1. add configs to kylin.properties
```
kylin.server.query-metrics2-enabled=true
kylin.metrics.reporter-query-enabled=true
kylin.metrics.reporter-job-enabled=true
kylin.metrics.monitor-enabled=true
```
2. Use hivesink in ./tomcat/webapps/kylin/WEB-INF/classes/kylinMetrics.xml
{code:java}
// code placeholder
http://www.w3.org/2001/XMLSchema-instance;
xmlns="http://www.springframework.org/schema/beans;
xsi:schemaLocation="http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans-3.1.xsd;>
Kylin Metrics Related Configuration
10
10
10
{code}
3. restart kylin
4. test a query
5. update system cube
> Cube Planner not working in apche kylin 2.3.0(open Source)
> --
>
> Key: KYLIN-3351
> URL: https://issues.apache.org/jira/browse/KYLIN-3351
> Project: Kylin
> Issue Type: Task
>Reporter: praveenece
>Priority: Major
>
> Hi Team
> i want test Cube planner in apache-kylin(2.3.0),So i created cube with
> segment, and i hit query to cube many times more than thousands but the cube
> planner there is no change in cuboid level like color changing and not get
> COUNT in exactly row count and other items.can u please guide me.
> Note:
> Could u tell me?
> Cube Planner Working only old Cube (like 3 month before) or new Cube also.
> Configuration(kylin.Properties)
> kylin.cube.cubeplanner.enabled=true
> Kylin Version=2.3.0(SINGLE NODE)
> MyCube creation =10days before
> I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3278) Kylin should not distribute hive table by random at Step1
Chuqian Yu created KYLIN-3278: - Summary: Kylin should not distribute hive table by random at Step1 Key: KYLIN-3278 URL: https://issues.apache.org/jira/browse/KYLIN-3278 Project: Kylin Issue Type: Improvement Components: Job Engine Reporter: Chuqian Yu Hi,Kylin team. When I upgrade from 2.2.0 to 2.3.0 ,I found that the step.1 "Create Intermediate Flat Hive Table" of cube build was much slower than before, because Kylin distribute hive table by random when created it in version 2.3.0 . I wander is it necessary? Because kylin.source.hive.redistribute-flat-table was set to true by default, so we will do the distribution job at Step.2 "Redistribute Flat Hive Table". Best regards, Chuqian Yu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3277) Kylin should override hiveconf settings when connecting to hive using jdbc
[ https://issues.apache.org/jira/browse/KYLIN-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuqian Yu updated KYLIN-3277: -- Attachment: 0001-KYLIN-3277.patch > Kylin should override hiveconf settings when connecting to hive using jdbc > -- > > Key: KYLIN-3277 > URL: https://issues.apache.org/jira/browse/KYLIN-3277 > Project: Kylin > Issue Type: Bug >Reporter: Chuqian Yu >Priority: Major > Labels: patch > Attachments: 0001-KYLIN-3277.patch > > > Hi, kylin developers. My cube building procedure failing at Step 2 > "Redistribute Flat Hive Table" because Kylin always trying to submit a mr job > to the default yarn queue. > > I have overrided the mapred.job.queue.name property in both > kylin_hive_conf.xml and kylin.properties but it doesn't work. > > kylin.properties > ``` > kylin.source.hive.beeline-params=-n hive -p hive --hiveconf > mapred.job.queue.name=myQueue -u > "jdbc:hive2://myZk:2181/;serviceDiscoveryMode=zooKeeper;" > ``` > > kylin_hive_conf.xml > ``` > > mapred.job.queue.name > myQueue > > ``` > > After digging into the source code ,I found that kylin try to get the row > count of hive table before redistributing it. But it dose not override the > hive configuration when using jdbc to connect to hive server. > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3277) Kylin should override hiveconf settings when connecting to hive using jdbc
Chuqian Yu created KYLIN-3277: - Summary: Kylin should override hiveconf settings when connecting to hive using jdbc Key: KYLIN-3277 URL: https://issues.apache.org/jira/browse/KYLIN-3277 Project: Kylin Issue Type: Bug Reporter: Chuqian Yu Hi, kylin developers. My cube building procedure failing at Step 2 "Redistribute Flat Hive Table" because Kylin always trying to submit a mr job to the default yarn queue. I have overrided the mapred.job.queue.name property in both kylin_hive_conf.xml and kylin.properties but it doesn't work. kylin.properties ``` kylin.source.hive.beeline-params=-n hive -p hive --hiveconf mapred.job.queue.name=myQueue -u "jdbc:hive2://myZk:2181/;serviceDiscoveryMode=zooKeeper;" ``` kylin_hive_conf.xml ``` mapred.job.queue.name myQueue ``` After digging into the source code ,I found that kylin try to get the row count of hive table before redistributing it. But it dose not override the hive configuration when using jdbc to connect to hive server. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
