viatcheslavmogilevsky opened a new pull request #10979: URL: https://github.com/apache/druid/pull/10979
Fixes the issue of builds were failed cause apache.org bandwitch limits <!-- If you are a committer, follow the PR action item checklist for committers: https://github.com/apache/druid/blob/master/dev/committer-instructions.md#pr-and-issue-action-item-checklist-for-committers. --> ### Description There were intermittent downloading issues during massive integration tests outside travis such as: ``` [2021-03-09T21:27:53.027Z] Step 13/53 : RUN curl -s https://archive.apache.org/dist/hadoop/core/hadoop-2.8.5/hadoop-2.8.5.tar.gz | tar -xz -C /usr/local/ [2021-03-09T21:27:53.027Z] ---> Running in e1bebb15f9ac [2021-03-09T21:27:53.600Z] [2021-03-09T21:27:53.600Z] gzip: stdin: not in gzip format [2021-03-09T21:27:53.600Z] tar: Child returned status 1 [2021-03-09T21:27:53.600Z] tar: Error is not recoverable: exiting now ``` or ``` [2021-03-09T22:19:00.605Z] The command '/bin/sh -c /root/base-setup.sh && rm -f /root/base-setup.sh' returned a non-zero code: 8 [2021-03-09T22:19:00.605Z] [ERROR] Command execution failed. [2021-03-09T22:19:00.605Z] org.apache.commons.exec.ExecuteException: Process exited with an error: 8 (Exit value: 8) [2021-03-09T22:19:00.605Z] at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:404) [2021-03-09T22:19:00.605Z] at org.apache.commons.exec.DefaultExecutor.execute (DefaultExecutor.java:166) ``` These are because `archive.apache.org` isn't available by bandwitch limits The solution is to use mirror of this host, such as artifactory generic remote repository which points to https://archive.apache.org/ ### Changes: Added `ARG` instructions to the following dockerfiles `examples/quickstart/tutorial/hadoop/docker/Dockerfile` and `integration-tests/docker/Dockerfile`, changed `integration-tests/docker/base-setup.sh` to support `APACHE_ARCHIVE_MIRROR_HOST` variable and added optional `--build-arg` arguments to `integration-tests/script/docker_build_containers.sh` Added a tip in documentation: `integration-tests/README.md` about how to override `archive.apache.org` `archive.apache.org` host is still used by default ### Labels: `Area - Testing` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
