Amit Sela created BEAM-647:

             Summary: Faul-tolerant sideInputs via Broadcast variables.
                 Key: BEAM-647
             Project: Beam
          Issue Type: Bug
          Components: runner-spark
            Reporter: Amit Sela
            Assignee: Amit Sela

Following which enables 
checkpointing to recover from failures, sideInputs (being implemented by 
broadcast variables) should be handled in a specific manner as described here:

This is a bit more complicated than Aggregators (via Accumulators) as they are 
implemented using a single "aggregating"  Accumulator, while a pipeline may 
contain multiple sideInputs.

This message was sent by Atlassian JIRA

Reply via email to