[
https://issues.apache.org/jira/browse/GRIFFIN-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang updated GRIFFIN-220:
-------------------------
Summary: Job rate limit for scheduler (was: Livy concurrent submission
queue)
> Job rate limit for scheduler
> ----------------------------
>
> Key: GRIFFIN-220
> URL: https://issues.apache.org/jira/browse/GRIFFIN-220
> Project: Griffin (Incubating)
> Issue Type: Improvement
> Components: timeliness-batch
> Reporter: Yang
> Priority: Minor
>
> Hi William and Lionel：
> Problem：
> Too many tasks submitted at the same time, resulting in failure of livy's
> submission job
> Optimization thinking:
> In view of the shortage of cluster resources caused by too many jobs
> submitted at the same time.We increase Livy submission job queue, when Livy
> submits,queues are increased, producer-consumer mode is adopted, and the
> number of jobs submitted is limited. When one job is completed, the next job
> is executed.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
