Hyukjin Kwon created SPARK-58028:
------------------------------------
Summary: Retry Docker image pull in DockerJDBCIntegrationSuite to
avoid transient registry errors aborting the suite
Key: SPARK-58028
URL: https://issues.apache.org/jira/browse/SPARK-58028
Project: Spark
Issue Type: Bug
Components: Tests
Affects Versions: 5.0.0
Reporter: Hyukjin Kwon
Docker-backed JDBC integration suites (e.g. PostgresKrbIntegrationSuite) pull
their Docker image in beforeAll with a single attempt. A transient
registry/proxy error (observed on GitHub Actions: HTTP 502 Bad Gateway) or a
one-off pull timeout aborts the entire suite even though the rest of the run
has zero test failures. This has been seen aborting the scheduled build_java17
workflow on branch-4.1.
Wrap the image pull in a bounded retry loop
(spark.test.docker.imagePullAttempts, default 3) with linear backoff, so a
transient failure no longer aborts the suite. The final failure is rethrown
when all attempts are exhausted.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
