On Mon, Apr 19, 2010 at 7:05 PM, Ben Pfaff <[email protected]> wrote:
> It would probably not be too hard to modify OVS to support 20-byte MAC
> addresses exclusively.

Ok, however we do need both 6 and 20-byte together...

> To support both sizes of MAC addresses would be more work.  I think that
> it would amount to a more careful audit of each place a MAC address is
> used.  It would probably require adding address-length fields some
> places.  I'm not sure how it would interact with OpenFlow.  You could
> drop OpenFlow support, or you could only expose the 6-byte MAC flows
> through OpenFlow, or you could add OpenFlow extensions.
>
> I have a question, though: do you really want to actually *switch*
> IPoIB?  If you just want to use it on your host, without doing
> switching, then why not skip going through the bridge or OVS entirely?
> Just configure the network device directly.

Yes, we're sort of doing this now.

I'm running XCP on 2 physical machines configured as a pool. Each box
has two normal Ethernet NICs (with 6-byte HW addresses) and a single
Infiniband NIC (with a 20-byte HW address).

My original plan was to run the inter-vm network over the IB link, but
this requires the OVS or Linux bridge to work. Instead I'm now running
the XCP management interface on the IB link. This makes XCP create a
bridge interface "brib0" with a broken OVS connection to "ib0". When I
manually configure ib0 and route traffic through this interface using
the Linux routing table communication works and I have very fast
communication between the hosts in the pool.

The problem I'm now facing is that XCP runs the VM consoles on the
brib0 interface but I'm unable to route traffic from one of the
Ethernet NICs to this interface. I've tried to do this using iptables
but it seems the lib_REDIRECT kernel module is unavailable on XCP. The
simplest solution would probably be to run the XCP consoles on a
different NIC than the management interface but I've been unable to
configure this so far. Routing traffic to the interface is probably
also possible but I've not achieved this yet.

Many thanks for your help!

Trygve

--
HypoBytes Ltd.
Trygve Sanne Hardersen
Akersveien 24F
0177 Oslo
Norway

hypobytes.com
+47 40 55 30 25

_______________________________________________
discuss mailing list
[email protected]
http://openvswitch.org/mailman/listinfo/discuss_openvswitch.org

Reply via email to