Re: [OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Gilles Gouaillardet via users
Fair enough Ralph! I was implicitly assuming a "build once / run everywhere" use case, my bad for not making my assumption clear. If the container is built to run on a specific host, there are indeed other options to achieve near native performances. Cheers, Gilles On Thu, Jan 27, 2022 at

Re: [OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Brian Dobbins via users
Hi Ralph, Thanks for the explanation - in hindsight, that makes perfect sense, since each process is operating inside the container and will of course load up identical libraries, so data types/sizes can't be inconsistent. I don't know why I didn't realize that before. I imagine the past

Re: [OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Gilles Gouaillardet via users
Brian, FWIW Keep in mind that when running a container on a supercomputer, it is generally recommended to use the supercomputer MPI implementation (fine tuned and with support for the high speed interconnect) instead of the one of the container (generally a vanilla MPI with basic support for TCP

Re: [OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Ralph Castain via users
I'll disagree a bit there. You do want to use an MPI library in your container that is configued to perform on the host cluster. However, that doesn't mean you are constrained as Gilles describes. It takes a little more setup knowledge, true, but there are lots of instructions and knowledgeable

Re: [OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Ralph Castain via users
Afraid I don't understand. If your image has the OMPI libraries installed in it, what difference does it make what is on your host? You'll never see the IMPI installation. We have been supporting people running that way since Singularity was originally released, without any problems. The only

Re: [OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Bennet Fauber via users
Luis, Can you install OpenMPI into your home directory (or other shared filesystem) and use that? You may also want contact your cluster admins to see if they can help do that or offer another solution. On Wed, Jan 26, 2022 at 3:21 PM Luis Alfredo Pires Barbosa via users wrote: > > Hi Ralph, >

Re: [OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Brian Dobbins via users
Hi Ralph, Afraid I don't understand. If your image has the OMPI libraries installed > in it, what difference does it make what is on your host? You'll never see > the IMPI installation. > > We have been supporting people running that way since Singularity was > originally released, without any

Re: [OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Ralph Castain via users
There is indeed an ABI difference. However, the _launcher_ doesn't have anything to do with the MPI library. All that is needed is a launcher that can provide the key exchange required to wireup the MPI processes. At this point, both MPICH and OMPI have PMIx support, so you can use the same

Re: [OMPI users] OpenMPI - Intel MPI

2022-01-26 Thread Ralph Castain via users
Err...the whole point of a container is to put all the library dependencies _inside_ it. So why don't you just install OMPI in your singularity image? On Jan 26, 2022, at 6:42 AM, Luis Alfredo Pires Barbosa via users mailto:users@lists.open-mpi.org> > wrote: Hello all, I have Intel MPI in my

[OMPI users] OpenMPI - Intel MPI

2022-01-26 Thread Luis Alfredo Pires Barbosa via users
Hello all, I have Intel MPI in my cluster but I am running singularity image of a software which uses OpenMPI. Since they may not be compatible and I dont think it is possible to get these two different MPI running in the system. I wounder if there is some work arround for this issue. Any

Re: [OMPI users] OpenMPI - Intel MPI

2022-01-26 Thread John Hearns via users
Luis, it is perfectly possible to use different MPI on the same cluster. May we ask what your OS and cluster management stack is? Normally you use the Modules system to configure your job to use a chosen MPI On Wed, 26 Jan 2022 at 15:01, Ralph Castain via users < users@lists.open-mpi.org>

Re: [OMPI users] [External] Re: OpenMPI - Intel MPI

2022-01-26 Thread Sheppard, Raymond W via users
Hi All, FYI, we had trouble with Intel MPI in the past. A full install of their compiler builds it along with the compiler. Users were having the compiler paths, libs etc put in front, along with system dirs. So the OpenMPI module sometimes was not seen even when it was just loaded. The

[OMPI users] RES: OpenMPI - Intel MPI

2022-01-26 Thread Luis Alfredo Pires Barbosa via users
Hi Ralph, My singularity image has OpenMPI, but my host doesnt (Intel MPI). And I am not sure if I the system would work with Intel + OpenMPI. Luis Enviado do Email para Windows De: Ralph Castain via users