On 12/16/2011 10:37 AM, Gerben Roest wrote: > On 16-12-2011 14:10, Hal Rosenstock wrote: > >>> They should be DDR cards. Does Rate=2 mean DDR? >> >> No; it means 1x SDR (lowest speed/width). 4x DDR would be rate 6 (20 >> Gbps). See IBA 1.2.1 vol 1 PathRecord SA attribute Rate component. >> >> By default, OpenSM sets the rate for the IPoIB broadcast groups when not >> explicitly specified is rate 3 (10 Gbps) which is 4x SDR. > > I have a similar twin node that does work correctly (has DDR IB) and it > says at ibstat: "Rate: 20" > whereas the two that are having problems say "Rate: 2". > > Testing with openmpi osu_bw show: > > Rate=2: max bw: 245 MB/s > Rate=20: max bw: 1970 MB/s
Yes, that's consistent. Can you temporarily try the cable that is known to work (for rate 20) between the ports that come up at rate 2 and see if they come up properly (at rate 20) ? -- Hal > > greetings, > > Gerben > -- > To unsubscribe from this list: send the line "unsubscribe linux-rdma" in > the body of a message to [email protected] > More majordomo info at http://vger.kernel.org/majordomo-info.html > -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
