Yang created GRIFFIN-220:
----------------------------
Summary: Livy concurrent submission queue
Key: GRIFFIN-220
URL: https://issues.apache.org/jira/browse/GRIFFIN-220
Project: Griffin (Incubating)
Issue Type: Improvement
Components: timeliness-batch
Reporter: Yang
Hi William and Lionel:
Problem:
Too many tasks submitted at the same time, resulting in failure of livy's
submission job
Optimization thinking:
In view of the shortage of cluster resources caused by too many jobs submitted
at the same time.We increase Livy submission job queue, when Livy
submits,queues are increased, producer-consumer mode is adopted, and the number
of jobs submitted is limited. When one job is completed, the next job is
executed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)