[
https://issues.apache.org/jira/browse/BEAM-14074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504544#comment-17504544
]
Dennis Waldron commented on BEAM-14074:
---------------------------------------
Unfortunately, I don't have a reproducible case. I upgraded our pipelines to
use Beam 2.37.0 with no other code changes. Since then, the pipeline has logged
this exception on three separate occasions. It's the first time I've
encountered this error. Is there anything I can enable that would aid in
troubleshooting this? Would it be easier to log this via GCP support?
> BigQueryIO: NullPointerException in BigQueryServicesImpl
> --------------------------------------------------------
>
> Key: BEAM-14074
> URL: https://issues.apache.org/jira/browse/BEAM-14074
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.37.0
> Environment: GCP Dataflow, Java 11
> Reporter: Dennis Waldron
> Priority: P2
>
> Encountered several times on Beam 2.37.0 using BigQuery Streaming Inserts:
> {noformat}
> java.lang.RuntimeException: java.lang.NullPointerException
> at
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:1101)
> at
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:1154)
> at
> org.apache.beam.sdk.io.gcp.bigquery.BatchedStreamingWrite.flushRows(BatchedStreamingWrite.java:374)
> at
> org.apache.beam.sdk.io.gcp.bigquery.BatchedStreamingWrite.access$900(BatchedStreamingWrite.java:69)
> at
> org.apache.beam.sdk.io.gcp.bigquery.BatchedStreamingWrite$BatchAndInsertElements.finishBundle(BatchedStreamingWrite.java:263)
> Caused by: java.lang.NullPointerException
> at
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.getErrorInfo(BigQueryServicesImpl.java:1175)
> at
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl$InsertBatchofRowsCallable.call(BigQueryServicesImpl.java:879)
> at
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl$InsertBatchofRowsCallable.call(BigQueryServicesImpl.java:818)
> at
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$BoundedExecutorService$SemaphoreCallable.call(BigQueryServicesImpl.java:1697)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:834) {noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
