Niel Markwick created BEAM-9822:
-----------------------------------

             Summary: Reduce memory usage - especially when streaming
                 Key: BEAM-9822
                 URL: https://issues.apache.org/jira/browse/BEAM-9822
             Project: Beam
          Issue Type: Bug
          Components: io-java-gcp
    Affects Versions: 2.20.0
            Reporter: Niel Markwick
             Fix For: 2.21.0


SpannerIO uses a lot of memory. 
In Streaming Dataflow, it uses many times as much (because dataflow creates 
many worker threads)

Lower the memory use, and change default parameters during streaming to use 
smaller batches and disable grouping.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to