Aljoscha Krettek created BEAM-3727:

             Summary: Never shutdown sources in Flink Streaming execution mode
                 Key: BEAM-3727
             Project: Beam
          Issue Type: Bug
          Components: runner-flink
            Reporter: Aljoscha Krettek
            Assignee: Aljoscha Krettek

Because of FLINK-2491 checkpointing will not work for a streaming pipeline as 
soon as at least one source has finished. With the move to SDF IOs and the 
impulse primitive this is very problematic because essentially all jobs running 
in Flink Streaming mode would run without checkpointing.

We should, by default, never stop sources in streaming mode but add an option 
that allows doing so. Some people might want this and we also need it to make 
sure that the {{@ValidatesRunner}} tests for Flink in streaming mode finish. 

This message was sent by Atlassian JIRA

Reply via email to