[
https://issues.apache.org/jira/browse/BEAM-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16151017#comment-16151017
]
Reuven Lax commented on BEAM-2834:
----------------------------------
Thanks for the bug report! This does appear to be a bug. It won't cause any
data loss in most runners (the input records will simply retry), however it
will cause spurious crashes.
For now you can always call
withFailedInsertRetryPolicy(InsertRetryPolicy.alwaysRetry()) to work around (in
fact the intended behavior was for the default to be this instead of null).
> NullPointerException @ BigQueryServicesImpl.java:759
> ----------------------------------------------------
>
> Key: BEAM-2834
> URL: https://issues.apache.org/jira/browse/BEAM-2834
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Affects Versions: 2.1.0
> Reporter: Andy Barron
> Assignee: Thomas Groh
>
> {code}
> java.lang.NullPointerException
> at
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:759)
> at
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:809)
> at
> org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn.flushRows(StreamingWriteFn.java:126)
> at
> org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn.finishBundle(StreamingWriteFn.java:96)
> {code}
> Going through the stack trace, the likely culprit is a null {{retryPolicy}}
> in {{StreamingWriteFn}}.
> For context, this error showed up about 70 times between 1 am and 1 pm
> Pacific time (2017-08-31) on a Dataflow streaming job.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
