On Wed, 2021-08-18 at 17:24 +0100, Jose Quaresma wrote:
> - bitbake BB_NUMBER_THREADS uses cpu_count from oe utils that uses
> the python os.sched_getaffinity and it is more acurrate.
>
> grep -nH ^BB_NUMBER_THREADS meta/conf/bitbake.conf
> meta/conf/bitbake.conf:806:BB_NUMBER_THREADS ?= "${@oe.utils.cpu_count()}"
>
> - multiprocessing.cpu_count() returns the number of CPUs on the host,
> not the number of usable CPUs on the host. If the user is using
> scheduler affinity then the number of usable CPUs may be less,
> so when determining how many cores we can use check the affinity instead.
>
> Signed-off-by: Jose Quaresma <[email protected]>
> ---
> meta/classes/sstate.bbclass | 5 ++---
> 1 file changed, 2 insertions(+), 3 deletions(-)
>
> diff --git a/meta/classes/sstate.bbclass b/meta/classes/sstate.bbclass
> index c3c145e7f3..bc14b5e264 100644
> --- a/meta/classes/sstate.bbclass
> +++ b/meta/classes/sstate.bbclass
> @@ -964,13 +964,12 @@ def sstate_checkhashes(sq_data, d, siginfo=False,
> currentcount=0, summary=True,
> tasklist.append((tid, sstatefile))
>
>
>
>
> if tasklist:
> + nproc = min(d.getVar("BB_NUMBER_THREADS"), len(tasklist))
> +
> if len(tasklist) >= min_tasks:
> msg = "Checking sstate mirror object availability"
> bb.event.fire(bb.event.ProcessStarted(msg, len(tasklist)), d)
>
>
>
>
> - import multiprocessing
> - nproc = min(multiprocessing.cpu_count(), len(tasklist))
> -
> bb.event.enable_threadlock()
> pool = oe.utils.ThreadedPool(nproc, len(tasklist),
> worker_init=checkstatus_init, worker_end=checkstatus_end)
https://autobuilder.yoctoproject.org/typhoon/#/builders/69/builds/3825/steps/17/logs/stdio
Cheers,
Richard
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#154938):
https://lists.openembedded.org/g/openembedded-core/message/154938
Mute This Topic: https://lists.openembedded.org/mt/84976055/21656
Group Owner: [email protected]
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-
