Daniel Oliveira created BEAM-11020:
--------------------------------------

             Summary: Fix multi-window SDF splitting in Go.
                 Key: BEAM-11020
                 URL: https://issues.apache.org/jira/browse/BEAM-11020
             Project: Beam
          Issue Type: Sub-task
          Components: sdk-go
            Reporter: Daniel Oliveira
            Assignee: Daniel Oliveira


When splitting an element that's being processed on multiple windows, currently 
the element gets split based on the current progress of the current 
element+window pair, and the primary and residual both contain all windows from 
the original. This is incorrect as certain windows in the residual have already 
been processed.

The correct way to perform this split is to put the element + all fully 
processed windows in the primary, the element + all fully unprocessed windows 
in the residual, and then only split the element at the current element + 
window pair.

This fix should already be in Java and Python, so those can be referenced.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to