Hey everyone, We’ve been running some load performance tests on our streamings pipelines with “—enableStreamingEngine" and we are finding increased system lag which is causing many of the files offloaded/published to PubSub to end up in a dead message pipeline.
Pipelines are running on Dataflow with: * Java Beam SDK 2.25 —maxNumWorkers=100 —workerMachineType=n1-standard-2 Has anyone experienced similar issues after transitioning to Streaming Engine on Dataflow? — Reynaldo
