[OMPI users] Special Hybrid placement in OpenMPI 4.0.5

2021-04-07 Thread Koren, Gabriel via users
Hello, I'll like to do a special placement of an hybrid code in a cluster. 1. I'll like to select specific cores (0-5, 7-12, 14-16,18-21) etc 2. Scatter the MPI ranks evenly 3. Attach OMP's to each rank. Using -cpu-set $cplist -npernode XX -cpus-per-rank YY is the right way? Will cpus-pe

Re: [OMPI users] Building Open-MPI with Intel C

2021-04-07 Thread Heinz, Michael William via users
Sorry – I did actually send a thank you to Gilles and John @ 8:48 local time but it looks like at some point in my conversation with Gilles we stopped CC’ing the list – which means John never saw my thank you. So, “Thanks for the help, John!” From: users On Behalf Of Jeff Squyres (jsquyres) v

Re: [OMPI users] Building Open-MPI with Intel C

2021-04-07 Thread Jeff Squyres (jsquyres) via users
:-) For the web archives: Mike confirmed to me off-list that the non-interactive login setup was, indeed, the issue, and he's now good to go. On Apr 7, 2021, at 10:09 AM, John Hearns mailto:hear...@gmail.com>> wrote: Jeff, you know as well as I do that EVERYTHING is in the path at Cornelis N

Re: [OMPI users] Building Open-MPI with Intel C

2021-04-07 Thread John Hearns via users
Jeff, you know as well as I do that EVERYTHING is in the path at Cornelis Networks. On Wed, 7 Apr 2021 at 14:59, Jeff Squyres (jsquyres) wrote: > Check the output from ldd in a non-interactive login: your LD_LIBRARY_PATH > probably doesn't include the location of the Intel runtime. > > E.g. > >

Re: [OMPI users] Building Open-MPI with Intel C

2021-04-07 Thread Jeff Squyres (jsquyres) via users
Check the output from ldd in a non-interactive login: your LD_LIBRARY_PATH probably doesn't include the location of the Intel runtime. E.g. ssh othernode ldd /path/to/orted Your shell startup files may well differentiate between interactive and non-interactive logins (i.e., it may set PATH

Re: [OMPI users] Building Open-MPI with Intel C

2021-04-07 Thread John Hearns via users
Manually log into one of your nodes. Load the modules you use in a batch job. Run 'ldd' on your executable. Start at the bottom and work upwards... By the way, have you looked at using Easybuild? Would be good to have your input there maybe. On Wed, 7 Apr 2021 at 01:01, Heinz, Michael William vi

Re: [OMPI users] Building Open-MPI with Intel C

2021-04-07 Thread Heinz, Michael William via users
Giles, I’ll double check - but the intel runtime is installed on all machines in the fabric. - Michael Heinz michael.william.he...@cornelisnetworks.com On Apr 7, 2021, at 2:42 AM, Gilles Gouaillardet via users mailto:users@lists.open-mpi.o