Chamikara Madhusanka Jayalath created BEAM-10045:
----------------------------------------------------

             Summary: Reduce logging related to ratelimitExceeded error for BQ 
sink when performing streaming inserts
                 Key: BEAM-10045
                 URL: https://issues.apache.org/jira/browse/BEAM-10045
             Project: Beam
          Issue Type: Improvement
          Components: io-java-gcp
            Reporter: Chamikara Madhusanka Jayalath


These errors are usually temporary and pipelines may recover.

 

We can consider not logging till we backoff for a certain amount of time here.

[https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java#L792]

 

cc: [~reuvenlax]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to