Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-24 Thread Jim Kress ORG
or have I asked about the use of --enable-static for their 1.3.2 configurations. I will have to follow-up on that. Jim On Wed, 2009-06-24 at 19:30 -0400, Gus Correa wrote: > Hi Jim > > Jim Kress ORG wrote: > > Hey Gus. I was correct. > > > > If I did: &g

[OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-22 Thread Jim Kress ORG
For the app I am using, ORCA (a Quantum Chemistry program), when it was compiled using openMPI 1.2.8 and run under 1.2.8 with the following in the openmpi-mca-params.conf file: btl=self,openib the app ran fine with no traffic over my Ethernet network and all traffic over my Infiniband network.

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-22 Thread Jim Kress ORG
ur cmd line. This will cause rank=0 to output the MCA params it > thinks were set via the default files and/or environment (including > cmd line). > > Ralph > > On Jun 22, 2009, at 6:14 PM, Jim Kress ORG wrote: > > > For the app I am using, ORCA (a Quantum Chemistry

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-22 Thread Jim Kress ORG
; > -mca mpi_show_mca_params file,env > > to your cmd line. This will cause rank=0 to output the MCA params it > thinks were set via the default files and/or environment (including > cmd line). > > Ralph > > On Jun 22, 2009, at 6:14 PM, Jim Kress ORG wrote: > >

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-23 Thread Jim Kress ORG
tting the MCA param that you think it is. Try adding: > > -mca mpi_show_mca_params file,env > > to your cmd line. This will cause rank=0 to output the MCA params it > thinks were set via the default files and/or environment (including > cmd line). > > Ralph > >

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-23 Thread Jim Kress ORG
he MCA param that you think it is. Try adding: > > -mca mpi_show_mca_params file,env > > to your cmd line. This will cause rank=0 to output the MCA params it > thinks were set via the default files and/or environment (including > cmd line). > > Ralph > > On Jun

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-23 Thread Jim Kress ORG
estion. > > This option only works with 1.3.2, I'm afraid - it was a new feature. > > Ralph > > On Jun 23, 2009, at 2:31 PM, Jim Kress ORG wrote: > > > Ralph, > > > > I did the following: > > > > export OMPI_MCA_mpi_show_mca_params="fil

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-23 Thread Jim Kress ORG
3.2, or > 1.2.8? I see a 1.2.8 in your app name, hence the question. > > This option only works with 1.3.2, I'm afraid - it was a new feature. > > Ralph > > On Jun 23, 2009, at 2:31 PM, Jim Kress ORG wrote: > > > Ralph, > > > > I did the following: > >

Re: [OMPI users] 50% performance reduction due toOpenMPI v 1.3.2 forcing all MPI traffic over Ethernet insteadof using Infiniband

2009-06-23 Thread Jim Kress ORG
until v1.3.2 -- if the > executable was compiled/linked against any version prior to that, it's > pure luck that it works with the 1.3.2 shared libraries at all. > > > On Jun 23, 2009, at 7:25 PM, Jim Kress ORG wrote: > > > This is what I get > > &g

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-24 Thread Jim Kress ORG
Well, the whole situation is really bizarre. I just uninstalled openmpi 1.3.2 on my system. Then I installed OFED 1.4.1 to see if that resolves this situation. Here's what I get: [root@master ~]# ompi_info --config Configured by: root Configured on: Wed Jun 24 11:10:00

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2forcing all MPI traffic over Ethernet instead of using Infiniband

2009-06-24 Thread Jim Kress ORG
Hey Gus. I was correct. If I did: ./configure --prefix=/my/dir --with-openib=/usr --enable-static make all install then reboot and use mpi-selector to choose openmpi-1.3.2, and then: [root@master ~]# ompi_info --config Configured by: root Configured on: Wed Jun 24