Re: [OMPI users] Hybrid OpenMPI/OpenMP leading to deadlocks?

2014-10-16 Thread McGrattan, Kevin B. Dr.
October 16, 2014 11:40 AM To: Open MPI Users Subject: Re: [OMPI users] Hybrid OpenMPI/OpenMP leading to deadlocks? Hi Kevin Wouldn't it be possible to make your code restartable, by saving the appropriate fluid configuration/phase space variables, and splitting your long run into smaller pieces? That

Re: [OMPI users] Hybrid OpenMPI/OpenMP leading to deadlocks?

2014-10-16 Thread Gus Correa
function than what I have coded? *From:*users [mailto:users-boun...@open-mpi.org] *On Behalf Of *Ralph Castain *Sent:* Wednesday, October 15, 2014 11:05 PM *To:* Open MPI Users *Subject:* Re: [OMPI users] Hybrid OpenMPI/OpenMP leading to deadlocks? If you only have one thread doing MPI calls

Re: [OMPI users] Hybrid OpenMPI/OpenMP leading to deadlocks?

2014-10-16 Thread McGrattan, Kevin B. Dr.
function than what I have coded? From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Ralph Castain Sent: Wednesday, October 15, 2014 11:05 PM To: Open MPI Users Subject: Re: [OMPI users] Hybrid OpenMPI/OpenMP leading to deadlocks? If you only have one thread doing MPI calls, then single

Re: [OMPI users] Hybrid OpenMPI/OpenMP leading to deadlocks?

2014-10-16 Thread Ralph Castain
If you only have one thread doing MPI calls, then single and funneled are indeed the same. If this is only happening after long run times, I'd suspect resource exhaustion. You might check your memory footprint to see if you are running into leak issues (could be in our library as well as your

[OMPI users] Hybrid OpenMPI/OpenMP leading to deadlocks?

2014-10-15 Thread McGrattan, Kevin B. Dr.
I am using OpenMPI 1.8.3 on a linux cluster to run fairly long CFD (computational fluid dynamics) simulations using 16 MPI processes. The calculations last several days and typically involve millions of MPI exchanges. I use the Intel Fortran compiler, and when I compile with the -openmp option