reuvenlax commented on issue #24090: URL: https://github.com/apache/beam/issues/24090#issuecomment-1320972847
Unfortunately at least for storage-api writes, we don't have a good way of doing this. At the point where BigQuery returns a failure, the sink no longer has a handle on the original PCollection, as it has already been converted to proto format and shuffled. Can you explain why you want to reinject it into Kafka? getFailedStorageApiInserts should only return non-retryable errors (i.e. passing in the wrong type for a field), so any attempt to retry it will fail indefinitely. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
