[
https://issues.apache.org/jira/browse/IMPALA-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714655#comment-17714655
]
Joe McDonnell commented on IMPALA-12065:
----------------------------------------
Toolchain change:
[https://github.com/cloudera/native-toolchain/commit/234fad80361302acf8392a483cc144ccb03ee6dd]
{noformat}
commit 234fad80361302acf8392a483cc144ccb03ee6dd
Author: Joe McDonnell <[email protected]>
Date: Fri Apr 14 18:03:26 2023 -0700 IMPALA-12065: Use pigz when
compressing tarballs
This switches to using pigz to speed up the compression
of the final tarballs to be uploaded to the s3 bucket.
This helps mostly for large tarballs like LLVM, Kudu,
GCC, etc.
Testing:
- Ran toolchain build
Change-Id: I841d3b8e0cdd74811a9e53a23c12897a1f2fea8c
Reviewed-on: http://gerrit.cloudera.org:8080/19754
Reviewed-by: Michael Smith <[email protected]>
Reviewed-by: Wenzhe Zhou <[email protected]>
Tested-by: Joe McDonnell <[email protected]>
{noformat}
> Use pigz when compression the tarballs for native-toolchain
> -----------------------------------------------------------
>
> Key: IMPALA-12065
> URL: https://issues.apache.org/jira/browse/IMPALA-12065
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Affects Versions: Impala 4.3.0
> Reporter: Joe McDonnell
> Priority: Major
>
> This code in native-toolchain should be changed to use pigz:
> {noformat}
> tar zcf ${PACKAGE_FINAL_TGZ}\
> --directory=${BUILD_DIR} \
> ${PACKAGE_STRING}${PATCH_VERSION}{noformat}
> [https://github.com/cloudera/native-toolchain/blob/master/functions.sh#L392-L394]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
