Yang created GRIFFIN-220:
----------------------------

             Summary: Livy concurrent submission queue
                 Key: GRIFFIN-220
                 URL: https://issues.apache.org/jira/browse/GRIFFIN-220
             Project: Griffin (Incubating)
          Issue Type: Improvement
          Components: timeliness-batch
            Reporter: Yang


Hi William and Lionel:

Problem:

Too many tasks submitted at the same time, resulting in failure of livy's 
submission job

Optimization thinking:

In view of the shortage of cluster resources caused by too many jobs submitted 
at the same time.We increase Livy submission job queue, when Livy 
submits,queues are increased, producer-consumer mode is adopted, and the number 
of jobs submitted is limited. When one job is completed, the next job is 
executed.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to