Re: [OMPI users] Collective MPI-IO + MPI_THREAD_MULTIPLE

Sebastian, at first glance, the global lock in romio glue is not necessary. feel free to give the attached patch a try (it works with your example, and i made no further testing) Cheers, Gilles On 3/25/2016 9:26 AM, Gilles Gouaillardet wrote: Sebastian, thanks for the info. bottom line,

Re: [OMPI users] Collective MPI-IO + MPI_THREAD_MULTIPLE

Sebastian, thanks for the info. bottom line, the global lock is in the OpenMPI glue for ROMIO. i will check what kind of locking (if any) is done in mpich Cheers, Gilles On 3/24/2016 11:30 PM, Sebastian Rettenberger wrote: Hi, I tested this on my desktop machine. Thus, one node, two

Re: [OMPI users] Collective MPI-IO + MPI_THREAD_MULTIPLE

> On Mar 24, 2016, at 4:51 PM, Gilles Gouaillardet wrote: > > Jeff, > > from mpi 3.1 page 217 > >> Finally, in multithreaded implementations, one can have more than one, >> concurrently >> executing, collective communication call at a process. In these situations, >> it

Re: [OMPI users] Collective MPI-IO + MPI_THREAD_MULTIPLE

Jeff, from mpi 3.1 page 217 Finally, in multithreaded implementations, one can have more than one, concurrently executing, collective communication call at a process. In these situations, it is the user's responsibility to ensure that the same communicator is not used concurrently by two di

Re: [OMPI users] Collective MPI-IO + MPI_THREAD_MULTIPLE

On Thursday, March 24, 2016, Sebastian Rettenberger wrote: > Hi, > > I tried to run the attached program with OpenMPI. It works well with MPICH > and Intel MPI but I get a deadlock when using OpenMPI. > I am using OpenMPI 1.10.0 with support for MPI_THREAD_MULTIPLE. > > It

Re: [OMPI users] Problems in compiling a code with dynamic linking

Hi Elie Besides Gilles' and Thomas' suggestions: 1) Do you have any file system in your cluster head node that is an NFS export, and presumably mounted on the compute nodes? If you do, that would be the best place to install the Intel compiler. This would make it available on the compute

Re: [OMPI users] Collective MPI-IO + MPI_THREAD_MULTIPLE

Hi, I tested this on my desktop machine. Thus, one node, two tasks. It deadlock appears on the local file system and on the nfs mount. The MPICH version I tested was 3.2. However, as far as I know, locking is part of the MPI library and not ROMIO. Best regards, Sebastian On 03/24/2016 03:19

Re: [OMPI users] Collective MPI-IO + MPI_THREAD_MULTIPLE

Sebastian, in openmpi 1.10, the default io component is romio from mpich 3.0.4. how many tasks, how many nodes and which file system are you running on ? Cheers, Gilles On Thursday, March 24, 2016, Sebastian Rettenberger wrote: > Hi, > > I tried to run the attached

[OMPI users] Collective MPI-IO + MPI_THREAD_MULTIPLE

Hi, I tried to run the attached program with OpenMPI. It works well with MPICH and Intel MPI but I get a deadlock when using OpenMPI. I am using OpenMPI 1.10.0 with support for MPI_THREAD_MULTIPLE. It seems like ROMIO uses global locks in OpenMPI which is a problem if multiple threads want

Re: [OMPI users] Problems in compiling a code with dynamic linking

On 3/24/2016 12:01 AM, Gilles Gouaillardet wrote: > Elio, > > usually, /opt is a local filesystem, so it is possible /opt/intel is > only available on your login nodes. > > your best option is to ask your sysadmin where the mkl libs are on the > compute nodes, and/or how to use mkl in your jobs.

Re: [OMPI users] Problems in compiling a code with dynamic linking

Hello, On 03/24/2016 03:22 AM, Gilles Gouaillardet wrote: it seems /opt/intel/composer_xe_2013_sp1/bin/compilervars.sh is only available on your login/frontend nodes, but not on your compute nodes. you might be luckier with /opt/intel/mkl/bin/mklvars.sh an other option is to ldd

Re: [OMPI users] Problems in compiling a code with dynamic linking

Elio, usually, /opt is a local filesystem, so it is possible /opt/intel is only available on your login nodes. your best option is to ask your sysadmin where the mkl libs are on the compute nodes, and/or how to use mkl in your jobs. feel free to submit a dumb pbs script ls -l /opt ls -l

Re: [OMPI users] Problems in compiling a code with dynamic linking

Dear Gilles, thanks for your reply and your options. I have tried the first option, hich for me basically is the easiest. I have compiled using "make.inc" but now setting LIB = -L/opt/intel/mkl/lib/intel64 -lmkl_blas95_lp64 -lmkl_lapack95_lp64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential