Bharath Kumarasubramanian created SAMZA-2609:
------------------------------------------------

             Summary: Data model changes to track lifecycle information of job 
coordinator
                 Key: SAMZA-2609
                 URL: https://issues.apache.org/jira/browse/SAMZA-2609
             Project: Samza
          Issue Type: New Feature
            Reporter: Bharath Kumarasubramanian
            Assignee: Bharath Kumarasubramanian


*Goal*: Implement the data model changes needed to track the lifecycle of AM.

*Description*: With AM HA, the new AM will regenerate job model, do job 
planning and rewrite configurations and may have to spin up containers. The new 
rewritten configurations, job model can change from the existing metadata on 
which the containers are running. In order to handle this change of metadata, 
we need a way to identify lifecycle of the AM and store some information on the 
previous snapshot of the metadata.



*Changes*: 
 # Epoch identifier of the AM attempt so that we can determine if the new 
attempt is part of the same lifecycle of AM or a new deployment lifecycle
 # Additional information on the job model, configuration (potentially subset 
of it) so that we can use this information to decide the course of action if 
current metadata changed in comparison with the previous snapshot.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to