Re: [OMPI users] Multiple Subnet MPI Fail

2010-11-22 Thread Paul Monday (Parallel Scientific)
Thanks for the quick response ... I've been thinking about this today and tried a few things on my CentOS mini connected cluster ... To use tcp btl I will have to set up a bridge on A with ib0 and ib1 participating in the bridge, then tcp btl could be used as you suggest. Unfortunately, the

Re: [OMPI users] Multiple Subnet MPI Fail

2010-11-22 Thread Terry Dontje
You're gonna have to use a protocol that can route through a machine, OFED User Verbs (ie openib) does not do this. The only way I know of to do this via OMPI is with the tcp btl. --td On 11/22/2010 09:28 AM, Paul Monday (Parallel Scientific) wrote: We've been using OpenMPI in a switched

[OMPI users] Multiple Subnet MPI Fail

2010-11-22 Thread Paul Monday (Parallel Scientific)
We've been using OpenMPI in a switched environment with success, but we've moved to a point to point environment to do some work. Some of the nodes cannot talk directly to one another, sort of like this with computers A,B, C with A having two ports: A(1)(opensm)-->B A(2)(opensm)-->C