mynameborat opened a new pull request #1213: SAMZA-2305: Stream processor 
should ensure previous container is stopped during a rebalance
URL: https://github.com/apache/samza/pull/1213
 
 
   **Symptom**: Duplicate processing, Inconsistent checkpoints for inputs, 
Inconsistent changelog state
   **Cause**: We have a bug in the state machine inside stream processor that 
can result in processors running containers with old job model version after 
rebalances in Standalone deployment model. 
   **Fix**: We interrupt the container and wait for container to shutdown 
gracefully within a timeout (task.shutdown.ms) and fail the stream processor if 
the container doesn’t shut down within the timeout
   **Tests**: Added unit tests for StreamProcessor and SamzaContainer. Working 
on integration tests.
   
   More details about the bug can be found 
[here](https://docs.google.com/document/d/1gWjKsbNoRwuSexjAxgqw_1R9MaJEckMIZY0cX2_NoaY/edit#).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to