Cameron Lee created SAMZA-2303:
----------------------------------

             Summary: Exclude side inputs when handling end-of-stream and 
watermarks for high-level
                 Key: SAMZA-2303
                 URL: https://issues.apache.org/jira/browse/SAMZA-2303
             Project: Samza
          Issue Type: Bug
            Reporter: Cameron Lee
            Assignee: Cameron Lee


OperatorImplGraph builds EndOfStreamStates and WatermarkStates objects with all 
of the input SSPs from the job model. That includes side-input SSPs. However, 
high-level operator tasks aren't given messages from side-input SSPs, so 
high-level operators should not need to include handling for end-of-stream and 
watermarks.

The result of this issue is that end-of-stream and watermark handling tries to 
include side-inputs but never updates those states, which can result in not 
exiting properly (end-of-stream) and not correctly calculating watermarks.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to