Yi Pan (Data Infrastructure) created SAMZA-1483:
---------------------------------------------------

             Summary: Restart or fail Samza jobs in Zk-based standalone 
processors when input topic partition changes
                 Key: SAMZA-1483
                 URL: https://issues.apache.org/jira/browse/SAMZA-1483
             Project: Samza
          Issue Type: Bug
            Reporter: Yi Pan (Data Infrastructure)


This is related to SAMZA-1482. We need to handle input stream partition count 
change in embedded Samza processors as well. 

In Zk-based embedded Samza processors, when a input stream partition count 
change is detected, we have the opportunity to trigger a JobModel update event, 
which would:
# for stateless jobs, restart the embedded SamzaContainer w/ new input topic 
partitions and new JobModel
# for stateful jobs, shutdown the embedded StreamProcessor by throwing 
exceptions when the input topic partitions are different



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to