[
https://issues.apache.org/jira/browse/GRIFFIN-220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751079#comment-16751079
]
Eugene commented on GRIFFIN-220:
--------------------------------
Should consider service fusing downgrade, if the resource ready is not enough,
service could reject the following tasks submitted. keep the service is
available instead of failure
> Livy concurrent submission queue
> --------------------------------
>
> Key: GRIFFIN-220
> URL: https://issues.apache.org/jira/browse/GRIFFIN-220
> Project: Griffin (Incubating)
> Issue Type: Improvement
> Components: timeliness-batch
> Reporter: Yang
> Priority: Minor
>
> Hi William and Lionel:
> Problem:
> Too many tasks submitted at the same time, resulting in failure of livy's
> submission job
> Optimization thinking:
> In view of the shortage of cluster resources caused by too many jobs
> submitted at the same time.We increase Livy submission job queue, when Livy
> submits,queues are increased, producer-consumer mode is adopted, and the
> number of jobs submitted is limited. When one job is completed, the next job
> is executed.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)