Kuai Yu created GOBBLIN-308: ------------------------------- Summary: Gobblin cluster bootup hangs Key: GOBBLIN-308 URL: https://issues.apache.org/jira/browse/GOBBLIN-308 Project: Apache Gobblin Issue Type: Bug Reporter: Kuai Yu Assignee: Kuai Yu
The problem happens when there are more than 100 files in the job catalog. During the boot up sequence, spec consumer was launched after jobCatalog. However the jobCatalog launches with a job listener which will push job spec into a blocking queue, and due to spec consumer hasn't been started, no component will start to consume job specs from the blocking queue. Once the blocking queue max size (100 by default) is reached, the system is hanging. -- This message was sent by Atlassian JIRA (v6.4.14#64029)