Matt Harvey <m.j.har...@acellera.com> added the comment:
No, using the affinity's not useful to us as, in the general case, the batch
system (PBS Pro in our case) isn't using cgroups or cpusets (it does control
ave cpu use by monitoring rusage of the process group).
Several other batch system I've worked with either set NCPUS directly or have a
method for site-specific customisation of the job's environment.
That doesn't preclude using the affinity as an alternative to os.cpu_count()
As @pitrou correctly observes, probably better to have a simple,
well-sign-posted way for the sysadmins to influence the pool default than try
to overload multiprocessing with complex heuristics.
nosy: +Matt Harvey
Python tracker <rep...@bugs.python.org>
Python-bugs-list mailing list