Re: [OMPI users] Question about OpenMPI performance vs. MVAPICH2

2009-09-20 Thread Ralph Castain
Excellent point that is often overlooked. Be sure you compiled optimized - i.e., "mpicc -O3" (or whatever O-level you want). OMPI's wrapper compilers do NOT contain optimization flags. On Sep 20, 2009, at 9:50 AM, Jed Brown wrote: Brian Powell wrote: I ran a final test which I find very stra

Re: [OMPI users] Question about OpenMPI performance vs. MVAPICH2

2009-09-20 Thread Ralph Castain
Did you set -mca mpi_paffinity_alone 1? This will bind the processes to cores and (usually) significantly improve performance. The upcoming 1.3.4 will have additional binding options to help with performance issues. On Sep 20, 2009, at 12:36 AM, Brian Powell wrote: Greetings, I recently

Re: [OMPI users] Question about OpenMPI performance vs. MVAPICH2

2009-09-20 Thread Jed Brown
Brian Powell wrote: > I ran a final test which I find very strange: I ran the same test case > on 1 cpu. The MVAPICH2 case was 23% faster!?!? This makes little sense > to me. Both are using ifort as the mpif90 compiler using *identical* > optimization flags, etc. I don't understand how the results

[OMPI users] Job fails after hours of running on a specific node

2009-09-20 Thread Sangamesh B
Dear all, The CPMD application which is compiled with OpenMPI-1.3 (Intel 10.1 compilers) on CentOS-4.5, fails only, when a specific node i.e. node-0-2 is involved. But runs well on other nodes. Initially job failed after 5-10 mins (on node-0-2 + some other nodes). After googling error,

[OMPI users] Question about OpenMPI performance vs. MVAPICH2

2009-09-20 Thread Brian Powell
Greetings, I recently purchased and set up a new blade cluster using Xeon 5560 CPUs, Mellanox DDR ConnectX cards, running CentOS 5.2. I use the cluster to run a large FORTRAN 90 fluid model. I have been using OpenMPI on my other clusters for years, and it is my default MPI environment.