Maximilian Michels created BEAM-7192:
----------------------------------------

             Summary: Elements buffered during checkpointing may not be 
partitioned correctly
                 Key: BEAM-7192
                 URL: https://issues.apache.org/jira/browse/BEAM-7192
             Project: Beam
          Issue Type: Bug
          Components: runner-flink
            Reporter: Maximilian Michels
            Assignee: Maximilian Michels
             Fix For: 2.13.0


When a Flink checkpoint is taken, the current bundle is finalized. The 
finalization happens when the checkpoint barrier has already been sent 
downstream; emitting elements at this point would violate the checkpoint 
barrier alignment.

When elements are emitted during checkpointing they are buffered until the 
checkpoint is complete. We should ensure that they are keyed correctly and 
emission of the buffered elements does not interfere with any concurrent state 
requests (in case of portability).

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to