[
https://issues.apache.org/jira/browse/KYLIN-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172216#comment-17172216
]
Gabor Arki commented on KYLIN-4348:
-----------------------------------
Zookeeper:
{code:java}
ls /kylin/kylin_metadata/cube_job_ephemeral_lock
[cube_cm, cube_vm, cube_jm]
ls /kylin/kylin_metadata/cube_job_ephemeral_lock/cube_cm
[]
ls /kylin/kylin_metadata/cube_job_ephemeral_lock/cube_vm
[]
ls /kylin/kylin_metadata/cube_job_ephemeral_lock/cube_jm
[]
ls /kylin/kylin_metadata/cube_job_lock
[cube_cm, cube_vm, cube_jm]
ls /kylin/kylin_metadata/cube_job_lock/cube_cm
[f888380e-9ff4-98f5-2df4-1ae71e045f93]
ls /kylin/kylin_metadata/cube_job_lock/cube_vm
[fc186bd9-1186-6ed4-e58c-bbbf6dd8ef74]
ls /kylin/kylin_metadata/cube_job_lock/cube_jm
[d1a6475a-9ab2-5ee4-6714-f395e20cfc01]{code}
State of {{f888380e-9ff4-98f5-2df4-1ae71e045f93}} job:
Build Dimension Dictionaries For Steaming Job: FINISHED
Save Cube Dictionaries: PENDING
Overall job status: PENDING
Last logs:
{code:java}
2020-08-05 22:44:44 INFO [Scheduler 116797841 Job
f888380e-9ff4-98f5-2df4-1ae71e045f93-354] ExecutableManager:479 - job
id:f888380e-9ff4-98f5-2df4-1ae71e045f93-00 from RUNNING to SUCCEED
2020-08-05 22:44:44 INFO [Scheduler 116797841 Job
f888380e-9ff4-98f5-2df4-1ae71e045f93-354] ExecutableManager:479 - job
id:f888380e-9ff4-98f5-2df4-1ae71e045f93 from RUNNING to READY{code}
Since this I can only see the following for this job ID:
{code:java}
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:b730dd18-173c-53d9-250b-ab9fb30a83b8 is in running,
job state: READY.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:46a0233f-217e-9155-725b-c815ad77ba2c is in running,
job state: RUNNING.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:f888380e-9ff4-98f5-2df4-1ae71e045f93 is in running,
job state: READY.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:70a52f13-e401-4f2f-8a33-b35b5ef955c4 is in running,
job state: READY.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:4620192a-71e1-16dd-3b05-44d7f9144ad4 is in running,
job state: RUNNING.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:00924699-8b51-8091-6e71-34ccfeba3a98 is in running,
job state: RUNNING.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:169f75fa-a02f-221b-fc48-037bc7a842d0 is in running,
job state: RUNNING.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:456ebd63-9202-f142-eee6-2156846e5c11 is in running,
job state: READY.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:462 - Job:522b8b86-5f89-cffb-3423-cca8d6908613 is in running,
job state: READY.
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
2020-08-05 23:18:01 INFO [streaming_job_submitter-thread-1]
BuildJobSubmitter:287 - No left quota to build segments for cube:cube_cm at 0
{code}
The rest of the jobs for this cube are:
* pending on Calculate Statistics from Base Cuboid (one,
{{b730dd18-173c-53d9-250b-ab9fb30a83b8)}}
* pending on Build Dimension Dictionaries For Steaming Job
* running, but stuck on Build Dimension Dictionaries For Steaming Job (four as
in the list above)
The other 2 cubes we have are similarly stuck.
> Fix distributed concurrency lock bug
> ------------------------------------
>
> Key: KYLIN-4348
> URL: https://issues.apache.org/jira/browse/KYLIN-4348
> Project: Kylin
> Issue Type: Sub-task
> Reporter: wangxiaojing
> Assignee: wangxiaojing
> Priority: Major
> Fix For: v3.1.0
>
> Attachments: image-2020-02-03-10-54-21-976.png,
> image-2020-02-03-10-54-53-468.png
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
