Hi, Throwing this out there in case someone knows/is the right person to help. Our dataflow streaming job started crashing frequently (4 times so far, every 2 weeks) with the same error. We are up to date with beam. It previously ran without issues for several years.
The error is pretty low in the stack and after reading the source of the bigquery io connector I'm not sure why this doesn't trigger the failed rows output of the WriteToBigQuery class. RuntimeError: google.api_core.exceptions.RetryError: Timeout of 600.0s exceeded, last exception: HTTPSConnectionPool(host='bigquery.googleapis.com', port=443): Max retries exceeded with url: /bigquery/v2/projects/REDACTED/insertAll?prettyPrint=false (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2427)'))) [while running 'sessions to bq/WriteToBQ/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)-ptransform-82'] I have an issue on the beam repo as well. https://github.com/apache/beam/issues/34270 Best, Quentin
