Kengo Seki created BIGTOP-3648:
----------------------------------
Summary: Change download site to dlcdn.apache.org for installing
Ant and Maven
Key: BIGTOP-3648
URL: https://issues.apache.org/jira/browse/BIGTOP-3648
Project: Bigtop
Issue Type: Improvement
Reporter: Kengo Seki
Assignee: Kengo Seki
I ran the Docker-Toolchain-3.0.1 job on CI for preparing the 3.0.1 release, but
found that creating Docker image failed on some nodes.
(Those builds seem to succeed, but they actually failed to download Ant and
Maven)
https://ci.bigtop.apache.org/view/Docker/job/Docker-Toolchain-3.0.1/5/DISTRO=centos-8,PLATFORM=amd64-slave/console
https://ci.bigtop.apache.org/view/Docker/job/Docker-Toolchain-3.0.1/5/DISTRO=centos-7,PLATFORM=ppc64le-slave/console
Bigtop toolchain gets the version list of Ant and Maven by accessing
downloads.apache.org as the following links, but those nodes seem to have been
banned from the ASF site due to too much traffic.
https://github.com/apache/bigtop/blob/master/bigtop_toolchain/lib/puppet/parser/functions/latest_ant_binary.rb#L20
https://github.com/apache/bigtop/blob/master/bigtop_toolchain/lib/puppet/parser/functions/latest_maven_binary.rb#L20
{code}
[jenkins@ip-172-31-24-193 ~]$ curl -v https://downloads.apache.org/
* Trying 135.181.214.104:443...
* Trying 2a01:4f8:10a:201a::2:443...
* Immediate connect fail for 2a01:4f8:10a:201a::2: Network is unreachable
* Trying 2a01:4f9:3a:2c57::2:443...
* Immediate connect fail for 2a01:4f9:3a:2c57::2: Network is unreachable
^C
{code}
According to the ban policy, it seems to be cancelled after 24 hours.
But it's better to use dlcdn.apache.org instead of downloads.apache.org,
because the mirror sites served by the former doesn't seem to have the rate
limit as the latter.
https://infra.apache.org/infra-ban.html
As Luca said in [this
comment|https://issues.apache.org/jira/browse/BIGTOP-3644#comment-17495214],
dlcdn.apache.org may serve less versions, but regarding Ant and Maven, it seems
to be serving the same versions as downloads.apache.org as of now.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
