On Thu, Dec 3, 2020 at 9:48 AM Ross Burton <[email protected]> wrote: > > Hi, > > Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of cores > available unless told otherwise. This was a good idea six years > ago[1] but some modern machines are moving to very large core counts. > > For example, 88 core dual Xeons are fairly common. A ThunderX2 has 256 > cores (2 sockets, 4 hyperthreads per physical core). The Ampere Altra > is dual socket 2*80=160 cores. > > At this level of parallelisation the sheer amount of I/O from the > unpack storm is quite excessive. As a strawman argument, I propose a > hard cap to the default BB_NUMBER_THREADS of -- and I'm literally > making up numbers here -- 32. Maybe 64. Comments? >
I think capping at say 32 might be fine also think about how can we then make it known widely to users since this will be important to know. > Cheers, > Ross > > [1] > http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=1529ef0504542145f2b81b2dba4bcc81d5dac96e > > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#145250): https://lists.openembedded.org/g/openembedded-core/message/145250 Mute This Topic: https://lists.openembedded.org/mt/78690216/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
