On Mon, Oct 25, 2021 at 7:00 AM Khem Raj <[email protected]> wrote: > > On Mon, Oct 25, 2021 at 9:46 AM Steve Sakoman <[email protected]> wrote: > > > > On Mon, Oct 25, 2021 at 6:09 AM Khem Raj <[email protected]> wrote: > > > > > > > > > > > > On 10/25/21 7:07 AM, Anuj Mittal wrote: > > > > From: Trevor Gamblin <[email protected]> > > > > > > > > Add "-l 52" to PARALLEL_MAKE in config.json to limit Make and Ninja > > > > builds based on the detected system load. With this option added, if > > > > either tool has at least one job running and detects that the system > > > > load exceeds the given value, it will wait until either the system load > > > > average drops below that limit, or until all other jobs are finished > > > > before starting additional jobs. > > > > > > > > Since most autobuilder machines have 56 cores, this should help keep the > > > > system from being overloaded during builds. > > > > > > > > Reference: > > > > https://www.gnu.org/software/make/manual/html_node/Parallel.html > > > > > > > > Signed-off-by: Trevor Gamblin <[email protected]> > > > > Signed-off-by: Richard Purdie <[email protected]> > > > > (cherry picked from commit 5c5fc7bcd221427d34bbac80c9bad315fb6de4df) > > > > Signed-off-by: Anuj Mittal <[email protected]> > > > > --- > > > > config.json | 2 +- > > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > > > diff --git a/config.json b/config.json > > > > index 33d36ad..d397365 100644 > > > > --- a/config.json > > > > +++ b/config.json > > > > @@ -43,7 +43,7 @@ > > > > "PREMIRRORS = ''", > > > > "BB_GENERATE_MIRROR_TARBALLS = '1'", > > > > "BB_NUMBER_THREADS = '16'", > > > > - "PARALLEL_MAKE = '-j 16'", > > > > + "PARALLEL_MAKE = '-j 16 -l 52'", > > > > > > We have seen a lot of hung builds when we used this option internally on > > > builders, Additionally some packages like bison started to fail > > > intermittently which seemed like a parallel build issue but never got to > > > see why it would happen only with -l enabled. > > > > > > So this change would need some testing before we make it permanent into AB > > > > Which branch did you test this with? I had some issues when I > > originally added it to dunfell but after the last patch series I am > > getting green a-full and meta-oe builds on the autobuilder. > > it was dunfell primarily
In that case you might want to try again with the current dunfell head. It was a couple of weeks of pain, but I think I've eliminated all of the issues with using this patch. Steve > > > > > And master has been running with this for q > > Steve > > > > > > > > > "XZ_MEMLIMIT = '5%'", > > > > "XZ_THREADS = '8'", > > > > "BB_TASK_NICE_LEVEL = '5'", > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#55150): https://lists.yoctoproject.org/g/yocto/message/55150 Mute This Topic: https://lists.yoctoproject.org/mt/86577772/21656 Group Owner: [email protected] Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
