Niel Markwick created BEAM-9822:
-----------------------------------
Summary: Reduce memory usage - especially when streaming
Key: BEAM-9822
URL: https://issues.apache.org/jira/browse/BEAM-9822
Project: Beam
Issue Type: Bug
Components: io-java-gcp
Affects Versions: 2.20.0
Reporter: Niel Markwick
Fix For: 2.21.0
SpannerIO uses a lot of memory.
In Streaming Dataflow, it uses many times as much (because dataflow creates
many worker threads)
Lower the memory use, and change default parameters during streaming to use
smaller batches and disable grouping.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)