Robert Coe created BEAM-10999:
---------------------------------

             Summary: Bigquery Warning messages cause Dataflow job to fail
                 Key: BEAM-10999
                 URL: https://issues.apache.org/jira/browse/BEAM-10999
             Project: Beam
          Issue Type: Bug
          Components: io-java-gcp
    Affects Versions: 2.24.0, 2.19.0
         Environment: Google Dataflow
            Reporter: Robert Coe


I have a job fails when BigQuery throws any warning messages, even if the query 
is successful.

org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers.parseStatus Checks for 
"getErrors" and sets status to failure if there are any. However, this can 
include warning messages.

[Google's Bigquery Client 
Code|[https://github.com/googleapis/google-api-java-client-services/blob/master/clients/google-api-services-bigquery/v2/1.30.1/com/google/api/services/bigquery/model/JobStatus.java]]
 states that 

"Errors here do not necessarily mean that the job has completed or was 
unsuccessful."

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to