Hi Or,
On Thu, 03 Dec 2009 10:21:04 +0200 Or Gerlitz <[email protected]> wrote: > Yevgeny Kliteynik wrote: > > " It looks like in 'datagram' mode, the SL weights > > do not seem to be applied, or maybe this is an > > artifact of IPoIB in 'datagram mode' " > > yes, there's no reason for connected mode to behave differently wrt to QoS/SL > assignment from the SM, as both modes get their SL from the path record > provided by the SM and both mode use the same code for the path query... Right, that was my gut's feeling. > > > Have you checked that in this mode you do get the right > > SL for each child interface by shutting off the relevant > > SL (mapping it to VL15)? > > seeing what SL is provided by the SM in return to the path query is trivial, > either through the opensm logs or the ipoib ones, e.g here you see that ib1 > got SL 0 > on its Path to GID fe80:0000:0000:0000:0008:f104:0399:3c92 LID 0x0006 which is > 10.10.0.91 Just checked, the SLs provided by the path queries are OK in datagram mode. There might be some overhead somewhere (in iperf or in the IPoIB layer) that prevent using the link full bandwidth in datagram mode. Thanks, Sébastien. > > > ifdown ib1 > > echo 1 > /sys/module/ib_ipoib/parameters/debug_level > > ifup ib1 > > ping 10.10.0.91 > > dmesg | grep ib1 > > > ib1: Start path record lookup for fe80:0000:0000:0000:0008:f104:0399:3c92 > > MTU > 0 > > ib1: PathRec LID 0x0006 for GID fe80:0000:0000:0000:0008:f104:0399:3c92 > > ib1: Created ah ffff81021ddda180 > > ib1: created address handle ffff81021ddda500 for LID 0x0006, SL 0 > > > # ip neigh show dev ib1 > > 10.10.0.91 lladdr > > 80:00:00:49:fe:80:00:00:00:00:00:00:00:08:f1:04:03:99:3c:92 REACHABLE > > -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
