Daniel Halperin created BEAM-2007:
-------------------------------------
Summary: DataflowRunner drops Reads with no consumers
Key: BEAM-2007
URL: https://issues.apache.org/jira/browse/BEAM-2007
Project: Beam
Issue Type: Bug
Components: runner-dataflow
Reporter: Daniel Halperin
Assignee: Thomas Groh
Fix For: First stable release
Basically, if a pipeline has "just" a Read with no consumers, the optimizer in
Dataflow will drop it. To preserve Beam semantics, we do want to run the Read
and drop its output, e.g., because the Read may have side effects that we're
testing for.
Is it possible with pipeline surgery to find such Reads and add an Identity
ParDo to them?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
