Jack McCluskey created BEAM-13130:
-------------------------------------

             Summary: [Go SDK] Side Input Memory Leak
                 Key: BEAM-13130
                 URL: https://issues.apache.org/jira/browse/BEAM-13130
             Project: Beam
          Issue Type: Bug
          Components: sdk-go
            Reporter: Jack McCluskey
            Assignee: Jack McCluskey


Keeping a list of the open stateKeyReader structs in the ScopedStateReader is 
holding on to memory for the life of bundles, leading to significant memory 
usage in large batch jobs. This list needs to be removed to the garbage 
collector can clean up stateKeyReader structs sooner.

 

stateKeyReader: 
[https://github.com/apache/beam/blob/d916c1f55e57a61b54135d0922ad8660735bd287/sdks/go/pkg/beam/core/runtime/harness/statemgr.go#L105]

List kept by ScopedStateReader: 
https://github.com/apache/beam/blob/d916c1f55e57a61b54135d0922ad8660735bd287/sdks/go/pkg/beam/core/runtime/harness/statemgr.go#L39



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to