mynameborat opened a new pull request #1450: URL: https://github.com/apache/samza/pull/1450
**Description**: AM performs planning and job model generation for every incarnation. With AM-HA, the new job model or configuration may invalidate the containers from the previous attempt. In order to ensure correctness, we handle this by detecting these changes and restart all the containers in case of any changes to metadata (job model or configuration). **Note**: We stack this PR with two other PRs #1449 & #1448 that are part of AM-HA feature work and hence the reviewers are requested to review the last commit 036c068. **Changes**: - Detect changes in metadata by reading older metadata from coordinator stream and signal the CPM - As part of resource request & orchestration, ignore the containers that are already running from the previous attempt and proceed to release them if metadata changed. - Releasing the container will signal RM through AMRM client and RM will orchestrate killing the processing container. It is different from the normal `StopStreamProcessor` flow as the NMClient isn't the source of truth and doesn't have context about the containers spun in the previous attempts **Tests**: In progress **API Changes**: None **Upgrade Instructions**: None **Usage Instructions**: None ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
