Abacn commented on PR #30800: URL: https://github.com/apache/beam/pull/30800#issuecomment-2027438302
Looks like it has only 100-50 MB/s even for 20 workers, and there are errors in log: ``` DEADLINE_EXCEEDED writing batch of 25 mutations to Cloud Spanner, retrying after backoff of 9137ms (DEADLINE_EXCEEDED: com.google.api.gax.rpc.DeadlineExceededException: io.grpc.StatusRuntimeException: DEADLINE_EXCEEDED: Deadline Exceeded) ``` looks like write is throttled on the spanner side. If double the number of units of the spanner instance, would the throughput show difference? The stress test is testing the capability of Beam IO, so we want to Spanner side has sufficient capability Also need to run spotlessApply to clear the PreCommit failure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
