On Thu, 3 Dec 2020 at 17:48, Ross Burton <[email protected]> wrote: > > Hi, > > Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of cores > available unless told otherwise. This was a good idea six years > ago[1] but some modern machines are moving to very large core counts. > > For example, 88 core dual Xeons are fairly common. A ThunderX2 has 256 > cores (2 sockets, 4 hyperthreads per physical core). The Ampere Altra > is dual socket 2*80=160 cores. > > At this level of parallelisation the sheer amount of I/O from the > unpack storm is quite excessive. As a strawman argument, I propose a > hard cap to the default BB_NUMBER_THREADS of -- and I'm literally > making up numbers here -- 32. Maybe 64. Comments?
This is really going to depend on what storage technology you're using. I used to limit both at 8 when I was using traditional HDDs. With NVMe drives I see no need to limit at the top end of the systems I've built on (12c/24t). -- Paul Barker Konsulko Group
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#145248): https://lists.openembedded.org/g/openembedded-core/message/145248 Mute This Topic: https://lists.openembedded.org/mt/78690216/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
