damccorm opened a new issue, #21026: URL: https://github.com/apache/beam/issues/21026
Uploads might be retried in an underlying library on an upload thread. [https://github.com/apache/beam/blob/c026c9fa00239a6f3650a6fa69f3aa864f692afe/sdks/python/apache_beam/io/gcp/gcsio.py#L635-L639](https://github.com/apache/beam/blob/c026c9fa00239a6f3650a6fa69f3aa864f692afe/sdks/python/apache_beam/io/gcp/gcsio.py#L635-L639) The code is written in such a way as to not easily allow retries. One way to do so would be to allow http errors to be raised and then retry. See also https://issues.apache.org/jira/browse/BEAM-12567 Imported from Jira [BEAM-12758](https://issues.apache.org/jira/browse/BEAM-12758). Original Jira may contain additional context. Reported by: Ryan.Thompson. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
