Urmi Mustafi created GOBBLIN-1868:
-------------------------------------

             Summary: Refactor Common Utils between Orchestrator & DagManager
                 Key: GOBBLIN-1868
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1868
             Project: Apache Gobblin
          Issue Type: Bug
          Components: gobblin-service
            Reporter: Urmi Mustafi
            Assignee: Abhishek Tiwari


Create a Util class to contain functionality re-used between the DagManager and 
Orchestrator when launching executions of a flow spec. In the common case, the 
Orchestrator receives a flow to orchestrate, performs necessary validations, 
and forwards the execution responsibility to the DagManager. The DagManager's 
responsibility is to carry out any flow action requests. However, with launch 
executions now being stored in the DagActionStateStore, on restart or 
leadership change the DagManager has to perform validations before executing 
any launch actions the previous leader was unable to complete. Rather than 
duplicating the code or introducing a circular dependency between the 
DagManager and Orchestrator, this class is utilized to store the common 
functionality. It is stateless and requires all stateful pieces to be passed as 
input from the caller.
* Note: We expect further refactoring to be done to the DagManager in later 
stage of multi-active development so we do not attempt *major* reorganization 
as abstractions may change. 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to