Hello

Based on recent discussion about hwloc_topology_load() being slow on
some "large" platforms (almost 1 second on KNL), here's a new feature
proposal:

We've been recommending the use of XML to avoid multiple expensive
discovery: Export to XML once at boot, and reload from XML for each
actual process using hwloc. The main limitation is cgroups: resource
managers use cgroups to restrict the processors and memory that are
actually available to each job. So the topology of different jobs on the
same machine is actually slightly different from the main XML that
contained everything when it was created outside of cgroups during boot.

So we're looking at adding a new topology flag that loads the entire
machine from XML (or synthetic) and applies restrictions from the
local/native operating system.

Details at https://github.com/open-mpi/hwloc/pull/212
Comments welcome here or there.

Brice

_______________________________________________
hwloc-devel mailing list
hwloc-devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/hwloc-devel

Reply via email to