ajothomas opened a new pull request, #1616:
URL: https://github.com/apache/samza/pull/1616
**Feature:**
[Pipeline Drain] SAMZA-2741 aims to support the ability to drain pipelines
to allow incompatible intermediate schema changes.
This PR is a part of the Pipeline Drain work and aims to make changes to
RunLoop processing and high level API to allow pipelines to drain
**Changes:**
- DrainMessage is the control message to trigger drain
- RunLoop Changes
- SystemConsumers adds DrainMessage to it's queue for the chooser to
choose from
- DrainMessages are processed by RunLoopTask and shuts down the task
when all SSPs for a task have encountered drain
- Added DrainListenerTask modifier interface for StreamTask
- Sync commits on the RunLoop thread on Drain
- High level API changes
- Handling and propagation of DrainMessages through the DAG in
StreamOperatorTask
**Tests:**
- Unit tests for Drain in RunLoop
- (Pending) integ test for Drain in SamzaContainer
- (Pending) integ test for High level API
API changes:
No public API change.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
