Kuai Yu created GOBBLIN-703:
-------------------------------

             Summary: Allow planning job to be run in a non-blocking way
                 Key: GOBBLIN-703
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-703
             Project: Apache Gobblin
          Issue Type: Improvement
            Reporter: Kuai Yu


Today all the planning job will be running in a dedicated thread pool and will 
wait until the full execution to be completed. This requires a lot of system 
resources and a dedicated monitoring thread. The improvement here is to reduce 
the waiting time on a dedicated monitoring thread. Basically once the planning 
job submits to the Helix, we don't need to wait on the job completion. The job 
status monitoring will be achieved by GaaS monitoring. 

By doing this, we are freeing most of the threadpool resources because each 
monitoring thread will be immediately return after it finishes the job 
submission.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to