Joe McDonnell created IMPALA-13072:
--------------------------------------
Summary: Toolchain: Add retries for uploading artifacts to the s3
buckets
Key: IMPALA-13072
URL: https://issues.apache.org/jira/browse/IMPALA-13072
Project: IMPALA
Issue Type: Improvement
Components: Infrastructure
Affects Versions: Impala 4.5.0
Reporter: Joe McDonnell
Assignee: Joe McDonnell
On ARM toolchain builds, we have seen some failures to upload tarballs to s3:
{noformat}
22:17:06 impala-toolchain-redhat8: Uploading
/mnt/build/llvm-5.0.1-asserts-p7-gcc-10.4.0.tar.gz to
s3://native-toolchain/build/33-f93e2c9a86/llvm/5.0.1-asserts-p7-gcc-10.4.0/llvm-5.0.1-asserts-p7-gcc-10.4.0-ec2-package-centos-8-aarch64.tar.gz
22:17:06 impala-toolchain-redhat8: /mnt/functions.sh: line 385: 680012
Segmentation fault (core dumped) aws s3 cp --only-show-errors
"${PACKAGE_FINAL_TGZ}" "${PACKAGE_S3_DESTINATION}"{noformat}
Since we do many uploads, even a relatively low failure rate can make it hard
to get a passing build. We should change the code to retry the upload.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
