ajothomas opened a new pull request, #1605: URL: https://github.com/apache/samza/pull/1605
**WIP PR: Pending additional of some integ tests and existing integ test failure fixes** **Feature:** [Pipeline Drain] SAMZA-2741 aims to support the ability to drain pipelines to allow incompatible intermediate schema changes. This PR aims to add some pipeline Drain components- DrainManager, DrainMonitor and DrainNotification and integrates them with Samza Container and JC. **Changes:** This PR adds some pipeline Drain Components: - DrainNotification: message in the metadata-store which acts as the trigger for Drain in samza containers and JC. - DrainManager: manages reads/writes of DrainNotifications to metadata-store - DrainMonitor: looks for DrainNotifications on the DrainManager. Provides a callback The PR will also integrate these components to SamzaContainer and JC. Changes to RunLoop, low level and high level API are not covered in the PR. **Tests:** - Unit tests for DrainManager, implementations of DrainMonitor and DrainNotification - Changed tests for SamzaContainer, StreamProcessor **API** changes: No public API change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
