kangkaisen created KYLIN-2389:
---------------------------------
Summary: Improve resource utilization for DistributedScheduler
Key: KYLIN-2389
URL: https://issues.apache.org/jira/browse/KYLIN-2389
Project: Kylin
Issue Type: Improvement
Components: Job Engine
Affects Versions: v2.0.0
Reporter: kangkaisen
Assignee: kangkaisen
Currently, in DistributedScheduler we lock segment in JobService, which will
make the job of segment only schedule in jobServer that the job submitted and
could not fully utilize the threadPool resource of all jobServers.
For example, we have two jobServer and the max concurrent jobs is 10, if we
continuously submit 20 jobs to jobServer1, there will be only 10 jobs running
at the same time not 20 and will no job running in jobServer2.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)