[
https://issues.apache.org/jira/browse/IMPALA-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe McDonnell resolved IMPALA-11370.
------------------------------------
Fix Version/s: Impala 4.2.0
Assignee: Joe McDonnell
Resolution: Fixed
> Run make with --load-average for large toolchain components
> -----------------------------------------------------------
>
> Key: IMPALA-11370
> URL: https://issues.apache.org/jira/browse/IMPALA-11370
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Affects Versions: Impala 4.2.0
> Reporter: Joe McDonnell
> Assignee: Joe McDonnell
> Priority: Major
> Fix For: Impala 4.2.0
>
>
> Several components of the toolchain can use a significant amount of
> parallelism and resources (e.g. LLVM, Kudu). When using the docker build
> infrastructures, multiple of these builds can happen simultaneously. This can
> result in overloading the machine and high memory usage / memory pressure.
> One way to deal with it is to run those builds with make's --load-average
> command so that the total load doesn't go too high. This can result in a
> sawtooth load pattern as the make commands cut off and the load drifts down,
> so this may need some tuning of the value.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
