Kenneth Knowles created BEAM-1611:
-------------------------------------
Summary: Stateful ParDo broken in Dataflow batch
Key: BEAM-1611
URL: https://issues.apache.org/jira/browse/BEAM-1611
Project: Beam
Issue Type: Bug
Components: runner-dataflow
Reporter: Kenneth Knowles
Assignee: Kenneth Knowles
Priority: Critical
The needed shuffle is not performed in batch mode. Confirmed that it is
performed in streaming.
http://stackoverflow.com/questions/42564604/stateful-pardo-not-working-on-dataflow-runner/42566967#42566967
Filing here as the quickest fix is to work around with transform overrides in
Beam, analogous to those in the direct runner.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)