Kuai Yu created GOBBLIN-308:
-------------------------------

             Summary: Gobblin cluster bootup hangs
                 Key: GOBBLIN-308
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-308
             Project: Apache Gobblin
          Issue Type: Bug
            Reporter: Kuai Yu
            Assignee: Kuai Yu


The problem happens when there are more than 100 files in the job catalog. 
During the boot up sequence, spec consumer was launched after jobCatalog. 
However the jobCatalog launches with a job listener which will push job spec 
into a blocking queue, and due to spec consumer hasn't been started, no 
component will start to consume job specs from the blocking queue. Once the 
blocking queue max size (100 by default) is reached, the system is hanging.





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to