Re: [OMPI users] OpenMPI-1.7.3 - cuda support

2013-10-30 Thread KESTENER Pierre
MPI Users Objet : Re: [OMPI users] OpenMPI-1.7.3 - cuda support The CUDA-aware support is only available when running with the verbs interface to Infiniband. It does not work with the PSM interface which is being used in your installation. To verify this, you need to disable the usage of PSM

Re: [OMPI users] OpenMPI-1.7.3 - cuda support

2013-10-30 Thread Rolf vandeVaart
this: mpirun -mca pml ob1 . This will force the use of the verbs support layer (openib) with the CUDA-aware support. From: users [mailto:users-boun...@open-mpi.org] On Behalf Of KESTENER Pierre Sent: Wednesday, October 30, 2013 12:07 PM To: us...@open-mpi.org Subject: Re: [OMPI users] OpenMPI

Re: [OMPI users] OpenMPI-1.7.3 - cuda support

2013-10-30 Thread KESTENER Pierre
Dear Rolf, thank for looking into this. Here is the complete backtrace for execution using 2 GPUs on the same node: (cuda-gdb) bt #0 0x7711d885 in raise () from /lib64/libc.so.6 #1 0x7711f065 in abort () from /lib64/libc.so.6 #2 0x70387b8d in psmi_errhandler_psm (ep=,

Re: [OMPI users] OpenMPI-1.7.3 - cuda support

2013-10-30 Thread Rolf vandeVaart
users] OpenMPI-1.7.3 - cuda support Hello, I'm having problems running a simple cuda-aware mpi application; the one found at https://github.com/parallel-forall/code-samples/tree/master/posts/cuda-aware-mpi-example I have modified symbol ENV_LOCAL_RANK into OMPI_COMM_WORLD_LOCAL_RANK My cluster has

[OMPI users] OpenMPI-1.7.3 - cuda support

2013-10-30 Thread KESTENER Pierre
Hello, I'm having problems running a simple cuda-aware mpi application; the one found at https://github.com/parallel-forall/code-samples/tree/master/posts/cuda-aware-mpi-example I have modified symbol ENV_LOCAL_RANK into OMPI_COMM_WORLD_LOCAL_RANK My cluster has 2 K20m GPUs per node, with