ajdub508 commented on issue #21080: URL: https://github.com/apache/beam/issues/21080#issuecomment-1675911299
I am having trouble finding the higher level function that will handle [this re-raised exception](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/bigquery_tools.py#L736). Would anyone be able to point that out for me? I haven't found where that exception would lead to retry strategy evaluation. Doing some research on this one and finding that the `self.gcp_bq_client.insert_rows_json` call [here](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/bigquery_tools.py#L720-L731) won't return a value in `errors` for errors such as a `google.api_core.exceptions.NotFound` error that is thrown when a table doesn't exist. Those errors will raise a `GoogleAPICallError`, though, and they are caught and re-raised in the `except` [here](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/bigquery_tools.py#L736), with the expectation that it will be retried appropriately. I haven't tracked down where it will go from there, yet. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
