[
https://issues.apache.org/jira/browse/BEAM-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Kirpichov updated BEAM-1235:
-----------------------------------
Description:
When a BigQuery load job fails, we only say that it failed, but don't show the
error message.
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2339
doesn't put the jobStatus in the exception, and
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2332
doesn't even log it.
User who hit the issue:
http://stackoverflow.com/questions/41406891/bigquery-loads-manually-but-not-through-the-java-sdk
(though this is using the Dataflow SDK so it'll need to be backported from
Beam to Dataflow, or the user will need to use Beam once the issue is fixed)
was:
When a BigQuery load job fails, we only say that it failed, but don't show the
error message.
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2339
doesn't put the jobStatus in the exception, and
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2332
doesn't even log it.
User who hit the issue:
http://stackoverflow.com/questions/41406891/bigquery-loads-manually-but-not-through-the-java-sdk
> BigQueryIO doesn't show the load job error to the user
> ------------------------------------------------------
>
> Key: BEAM-1235
> URL: https://issues.apache.org/jira/browse/BEAM-1235
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-extensions
> Reporter: Eugene Kirpichov
> Assignee: Davor Bonaci
>
> When a BigQuery load job fails, we only say that it failed, but don't show
> the error message.
> https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2339
> doesn't put the jobStatus in the exception, and
> https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2332
> doesn't even log it.
> User who hit the issue:
> http://stackoverflow.com/questions/41406891/bigquery-loads-manually-but-not-through-the-java-sdk
> (though this is using the Dataflow SDK so it'll need to be backported from
> Beam to Dataflow, or the user will need to use Beam once the issue is fixed)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
