Robert Burke created BEAM-13628:
-----------------------------------

             Summary: [Go SDK] Make Side input cache fit resolved semantics.
                 Key: BEAM-13628
                 URL: https://issues.apache.org/jira/browse/BEAM-13628
             Project: Beam
          Issue Type: Bug
          Components: sdk-go
    Affects Versions: 2.35.0
            Reporter: Robert Burke


It's been determined the documentation in the proto was a a bit buggy WRT Side 
input semantics. Previous to https://github.com/apache/beam/pull/16474 it said 
state cache tokens are globally unique, however, in implementation and the 
original design they are unique WRT their associated StateKeys.

This means the Go SDK's side input cache is broken as delivered, and can cause 
a correctness issue when there are multiple distinct side inputs.

The correction will use the whole state key (which, for side inputs includes 
the transformID ,SideInputID) tuple (with a user key if it's a multimap side 
input)), along with the Runner provided token.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to