ahmedabu98 commented on issue #23291: URL: https://github.com/apache/beam/issues/23291#issuecomment-1311009258
Hey @carlpayne. I made a mistake creating this bug, as `withFailedInsertRetryPolicy()` is only used with STREAMING_INSERTS, not STORAGE_WRITE_API. Can you tell me more about your case? What version of Beam are you using? Are you having these problems at HEAD? I saw a recent PR #23556 that improved error handling. The Storage API sink now [removes failed rows before retrying](https://github.com/apache/beam/blob/92cef32915c40d353b51529a87d8f0131b0a3538/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StorageApiWriteUnshardedRecords.java#L472). FYI these improvements were committed relatively recently. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
