Hi team, Around one month ago we saw jobs of all-build-options-ub2004 frequently failed in timeout (4h). The majority of the time is spent in downloading artifacts from Apache websites (e.g. http://archive.apache.org/) when building on Apache components. It's due to some issues in the Apache Infra which we can't control.
To address this, we upload all the dependent Apache tarballs to our S3 native-toolchain bucket and use it as an Apache Mirror. This reduces the job runtime to 1.5 hours. When building on Apache components, you can set this before your buildall.sh command to use this mirror: export APACHE_MIRROR=https://native-toolchain.s3.amazonaws.com/build/apache_components/tarballs However, this leads to another problem: if a new dependent tarball is missing in our s3 bucket, the pre-commit tests of the patch will fail. E.g. There is a patch that requires adding Apache Hive 2.3.9: https://gerrit.cloudera.org/c/21760/. The job now succeeds after adding the missing tarballs: https://jenkins.impala.io/job/all-build-options-ub2004/3268/ So please let us know when your patch requires new dependent tarballs from Apache mirrors. We will upload them to the s3 bucket to fix your test issue. Thanks, Quanlong
