When you say "connected mode" you referring to ipoib or your MPI configuration? You really don't want to use ipoib for HPC applications. What MPI are you using?
For MPI - my personal experience is that OpenMPI is sometimes more reliable but Mvapich-1 offers the best performance. -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of giggzounet Sent: Tuesday, December 07, 2010 9:01 AM To: [email protected] Subject: [ewg] Need help for Infiniband optimisation for our cluster (MTU...) Hi, I'm new on this list. We have in our laboratory a little cluster: - master 8 cores - 8 nodes with 12 cores - DDR infiniband switch Mellanox MTS3600R On these machines we have an oscar cluster with CentOS 5.5. We have installed the ofed packages 1.5.1. The default config for the infiniband is used. So infiniband is running in connected mode. Our cluster is used to solve CFD (Computational Fluid Dynamics) problems. And I'm trying to optimize the infiniband network and so I have several questions: - Is it the right mailing list to ask ? (if not...where should I post ?) - Is there a how-to on infiniband optimisation ? - CFD computations need a lot of bandwidth. There are a lot of data exchange through MPI (we are using intel mpi). Has the infiniband mode (connected or datagram) influence in this case ? What is the "best" MTU for those computation ? Best regards, Guillaume _______________________________________________ ewg mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg _______________________________________________ ewg mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
