On 22 January 2013 10:57, John Nielsen <[email protected]> wrote: > On Jan 19, 2013, at 7:56 PM, Joseph Glanville > <[email protected]> wrote: > >>>> I assume it is now an EoIB driver. Does it replace the IPoIB driver? >>>> >>> Nope, it is upper-layer thing: https://lwn.net/Articles/509448/ >> >> Aye, its effectively a NAT translation layer that strips Ethernet >> headers and grafts on IPoIB headers, thus using the same wire protocol >> and allowing communication from EoIB to IPoIB. >> >> However this approach is a little dirty and has been nacked by the >> netdev community so we aren't likely to see it in the mainline >> kernel.. basically ever. > > Just to clarify: > > EoIB has been around for a while (at least in the Mellanox software, not sure > about mainline). It uses the mlx4_vnic module and is a true Ethernet > encapsulation over InfiniBand. Unfortunately the newer Mellanox switches > won't support it any more and the ones that to have entered "Limited > Support." (Not to be confused with mlx4_en, which just turns a ConnectX card > into a 10G Ethernet NIC.) > > IPoIB is IP over InfiniBand without Ethernet (the data link layer is straight > InfiniBand). > > eIPoIB is (or will be, maybe) Ethernet over IP over InfiniBand. It is > intended to work with both Linux bridging and regular IB switches that > support IPoIB. (Allowing e.g. unmodified KVM guests on hypervisors connected > to an IPoIB fabric.) Both Joseph's comments and the LWN link above are > referring to eIPoIB. Last I heard (from a pretty direct source in the last > couple of weeks) Mellanox is still working on this but doesn't have anything > generally available yet. Here's hoping.. but the feedback on netdev was quite > negative, to put it mildly. > > JN >
Apolgies, I misread EoIB as eIPoIB as others were discussing IPoIB appearing as an Ethernet device. Personally I would like to see a pure software implementation of EoIB ala IPoIB, using the subnet manager to manage addressing etc rather than trying to implement a NAT style solution. The usefulness of communicating to IPoIB devices via the same interface as IPoIB doesn't sufficiently offset the dirtiness of NAT IMO. -- CTO | Orion Virtualisation Solutions | www.orionvm.com.au Phone: 1300 56 99 52 | Mobile: 0428 754 846 -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
