David Morávek created BEAM-11267:
------------------------------------
Summary: Remove unnecessary reshuffle for stateful ParDo after
keyed operation
Key: BEAM-11267
URL: https://issues.apache.org/jira/browse/BEAM-11267
Project: Beam
Issue Type: Improvement
Components: runner-flink
Reporter: David Morávek
Assignee: David Morávek
When we have stateful pardo after GBK / Combine, we can safely assume that
partitioning remains consistent and we can safe an extra shuffle.
The use case for this are user defined timers / datadriven triggers. This code
path is stressed for example by
org.apache.beam.sdk.transforms.ParDoTest.TimerTests#testGbkFollowedByUserTimers.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)