Re: [OMPI users] Open MPI and DAPL 2.0.34 are incompatible?

2011-12-23 Thread Beat Rubischon
Hi Paul! On 22.12.11 19:43, Paul Kapinos wrote: > Well. Any suggestions? Does OpenMPI ever able to use DAPL 2.0 on Linux? I don't think so. Even Intel dropped the need for DAPL in their 4.x release. It's an extra layer between the IB stack and the MPI which basically adds additional complexity an

[OMPI users] Openmpi performance issue

2011-12-23 Thread Eric Feng
Hello,  I am running into performance issue with Open MPI, I wish experts here can provide me some help, I have one application calls a lot of sendrecv, and isend/irecv, so waitall. When I run Intel MPI, it is around 30% faster than OpenMPI. However if i test sendrecv using IMB, OpenMPI is even

[OMPI users] over-subscription of cores

2011-12-23 Thread Santosh Ansumali
Dear All, We are running a PDE solver which is memory bound. Due to cache related issue, smaller number of grid point per core leads to better performance for this code. Thus, though available memory per core is more than 2 GB, we are able to good performance by using less than 1 GB

Re: [OMPI users] over-subscription of cores

2011-12-23 Thread Gustavo Correa
I don't know about the grid engine/ SGE. However, in Torque, the batch/resource manager I use, to allow oversubscription, you need to modify the batch server nodes file and pretend the nodes have more cores than the physical ones. [Something like 'node01 np=8' would change to 'node01 np=16' for in