Daniel Oliveira created BEAM-11020:
--------------------------------------
Summary: Fix multi-window SDF splitting in Go.
Key: BEAM-11020
URL: https://issues.apache.org/jira/browse/BEAM-11020
Project: Beam
Issue Type: Sub-task
Components: sdk-go
Reporter: Daniel Oliveira
Assignee: Daniel Oliveira
When splitting an element that's being processed on multiple windows, currently
the element gets split based on the current progress of the current
element+window pair, and the primary and residual both contain all windows from
the original. This is incorrect as certain windows in the residual have already
been processed.
The correct way to perform this split is to put the element + all fully
processed windows in the primary, the element + all fully unprocessed windows
in the residual, and then only split the element at the current element +
window pair.
This fix should already be in Java and Python, so those can be referenced.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)