Robert Burke created BEAM-11086:
-----------------------------------
Summary: [Go SDK] Validate windows are aggregated correctly in
GBKs and Combines
Key: BEAM-11086
URL: https://issues.apache.org/jira/browse/BEAM-11086
Project: Beam
Issue Type: Sub-task
Components: sdk-go
Reporter: Robert Burke
Add an integration test to validate windowing behavior against real runners, in
particular WRT GroupByKey operations.
This entails writing small batch test pipelines that assign event times, and
window into those transforms. Windows are assigned by the the runner as per the
given windowing strategy.
Code should be added in the sdks/go/test directory
[https://github.com/apache/beam/tree/master/sdks/go/test/integration/primitives]
and hooked up so that they're run as part of the post commit tests.
In particular, a multi-window case with a sliding window, and a lifted combiner
(like stats.Sum) should be written. It's unlikely the current Combiner Lifting
implementation takes windows into account correctly, leading to correctness
issues when they are used simultaneously.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
