Does "ldd /path/to/libhwloc.so" say that it depends on libcuda? Check the end of the configure output, you should see "CUDA" on the "probe/display I/O devices" line:
----------------------------------------------------------------------------- Hwloc optional build support status (more details can be found above): Probe / display I/O devices: PCI(pciaccess+linux) LinuxIO OpenCL CUDA NVML GL Graphical output (Cairo): yes XML input / output: full Netloc functionality: yes (with scotch: no) Plugin support: no ----------------------------------------------------------------------------- If not, go above and look for CUDA checks: checking for cuda.h... yes checking if CUDA_VERSION >= 3020... yes checking for cuInit in -lcuda... yes checking cuda_runtime_api.h usability... yes checking cuda_runtime_api.h presence... yes checking for cuda_runtime_api.h... yes checking if CUDART_VERSION >= 3020... yes checking for cudaGetDeviceProperties in -lcudart... yes Brice Le 07/07/2017 23:36, David Solt a écrit : > Ok here we have a machine with cuda installed: > > # rpm -qa | grep cuda > cuda-nvgraph-8-0-8.0.54-1.ppc64le > cuda-curand-dev-8-0-8.0.54-1.ppc64le > cuda-nvrtc-dev-8-0-8.0.54-1.ppc64le > cuda-cudart-8-0-8.0.54-1.ppc64le > cuda-cusolver-dev-8-0-8.0.54-1.ppc64le > cuda-8.0.54-1.ppc64le > cuda-driver-dev-8-0-8.0.54-1.ppc64le > cuda-core-8-0-8.0.54-1.ppc64le > etc, etc, etc > > #lspci | grep NVIDIA > > [root@c712f6n06 ~]# lspci | grep NVI > 0002:01:00.0 3D controller: NVIDIA Corporation GP100GL (rev a1) > 0003:01:00.0 3D controller: NVIDIA Corporation GP100GL (rev a1) > 0006:01:00.0 3D controller: NVIDIA Corporation GP100GL (rev a1) > 0007:01:00.0 3D controller: NVIDIA Corporation GP100GL (rev a1) > > But the only devices returned by hwloc are named "cardX" (same as what > lstopo shows) and have osdev.type of HWLOC_OBJ_OSDEV_GPU and we see no > devices of type HWLOC_OBJ_OSDEV_COPROC > > Sorry, I'm sure I'm doing something stupid here... I'm certainly new > to using hwloc. > > Dave > > > > From: Brice Goglin <brice.gog...@inria.fr> > To: Hardware locality user list <hwloc-users@lists.open-mpi.org> > Date: 07/07/2017 02:54 PM > Subject: Re: [hwloc-users] Why do I get such little information > back about GPU's on my system > Sent by: "hwloc-users" <hwloc-users-boun...@lists.open-mpi.org> > ------------------------------------------------------------------------ > > > > Le 07/07/2017 21:51, David Solt a écrit : > Oh, Geoff Paulsen will be there at Open MPI meeting and he can help > with the discussion. We tried searching for > > // Iterate over each osdevice and identify the GPU's on each socket. > while ((obj = hwloc_get_next_osdev(machine_topology, obj)) != NULL) { > if (HWLOC_OBJ_OSDEV_COPROC == obj->attr->osdev.type) { // was > HWLOC_OBJ_OSDEV_GPU > > Currently we are not finding any such devices. Does this require > that the cuda libraries be installed on the system for hwloc to find > the hardware? > > Yes. We use the cuda API for listing these objects. > Brice > _______________________________________________ > hwloc-users mailing list > hwloc-users@lists.open-mpi.org > https://rfd.newmexicoconsortium.org/mailman/listinfo/hwloc-users > > > > > _______________________________________________ > hwloc-users mailing list > hwloc-users@lists.open-mpi.org > https://rfd.newmexicoconsortium.org/mailman/listinfo/hwloc-users
_______________________________________________ hwloc-users mailing list hwloc-users@lists.open-mpi.org https://rfd.newmexicoconsortium.org/mailman/listinfo/hwloc-users