Re: [ovirt-users] LACP Bonding issue
Bryan Sockel writes: > That was my next thought, wanted to see if there was another way before I got > to that point. Just let me know if you want to see my configuration files in /etc/sysconfig/network-scripts/ I'm happy to share them. -derek -- Derek Atkins 617-623-3745 de...@ihtfp.com www.ihtfp.com Computer and Internet Security Consultant ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] LACP Bonding issue
That was my next thought, wanted to see if there was another way before I got to that point. Original message From: Derek Atkins Date: 4/20/17 8:12 PM (GMT-06:00) To: Bryan Sockel Cc: Chris Adams , users@ovirt.org Subject: Re: [ovirt-users] LACP Bonding issue _ >From : Derek Atkins [de...@ihtfp.com] To : Bryan Sockel [bryan.soc...@altn.com] Cc : Chris Adams [c...@cmadams.net], users@ovirt.org [users@ovirt.org] Date : Thursday, April 20 2017 20:11:46 For what it's worth I set up my bond0 manually on CentOS before installing ovirt hosted engine and the ovirtmgmt bridge "took over" from bond0.. But it appears to still be working. At least I've not noticed links being down, and "ifconfig" shows decent amount of traffic on both eno1 and eno2. Maybe wipe, re-install, configure it manually, and then install ovirt? -derek On Thu, April 20, 2017 8:58 pm, Bryan Sockel wrote: > We checked the port groups, and servers are cabled correctly. > > After server is rebooted, em1 is the only interface passing traffic. > Other 3 nics sitting idle. We can down each port on the switch and > confirm it is down on the server. > > > I am pretty sure it is related to the bridge that was created to pass > vm-host-altn traffic when the appliance was first installed. > > > > Original message > From: Chris Adams > Date: 4/20/17 5:40 PM (GMT-06:00) > To: users@ovirt.org > Subject: Re: [ovirt-users] LACP Bonding issue > > _ > > From : Chris Adams [c...@cmadams.net] > To : users@ovirt.org [users@ovirt.org] > Date : Thursday, April 20 2017 17:40:25 > Once upon a time, Bryan Sockel said: >> It seems that is some disconnect between my network bridge, the bond > and my >> interfaces. I would like to some how get my bond to use all 4 > interfaces. >> On reboot, it always seems to reset consistently to EM1. > > Are you sure the switch side is all the same LACP group? Sounds like > one port may accidentally be in a separate group, and that happens to be > em1. > > You might try swapping wires between em1 and another port and reboot and > see which ports come up - if all but the port with the wire formerly in > em1 come up, it points to the switch config. > > -- > Chris Adams > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > -- Derek Atkins 617-623-3745 de...@ihtfp.com www.ihtfp.com Computer and Internet Security Consultant ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] LACP Bonding issue
For what it's worth I set up my bond0 manually on CentOS before installing ovirt hosted engine and the ovirtmgmt bridge "took over" from bond0.. But it appears to still be working. At least I've not noticed links being down, and "ifconfig" shows decent amount of traffic on both eno1 and eno2. Maybe wipe, re-install, configure it manually, and then install ovirt? -derek On Thu, April 20, 2017 8:58 pm, Bryan Sockel wrote: > We checked the port groups, and servers are cabled correctly. > > After server is rebooted, em1 is the only interface passing traffic. > Other 3 nics sitting idle. We can down each port on the switch and > confirm it is down on the server. > > > I am pretty sure it is related to the bridge that was created to pass > vm-host-altn traffic when the appliance was first installed. > > > > Original message > From: Chris Adams > Date: 4/20/17 5:40 PM (GMT-06:00) > To: users@ovirt.org > Subject: Re: [ovirt-users] LACP Bonding issue > > _ > > From : Chris Adams [c...@cmadams.net] > To : users@ovirt.org [users@ovirt.org] > Date : Thursday, April 20 2017 17:40:25 > Once upon a time, Bryan Sockel said: >> It seems that is some disconnect between my network bridge, the bond > and my >> interfaces. I would like to some how get my bond to use all 4 > interfaces. >> On reboot, it always seems to reset consistently to EM1. > > Are you sure the switch side is all the same LACP group? Sounds like > one port may accidentally be in a separate group, and that happens to be > em1. > > You might try swapping wires between em1 and another port and reboot and > see which ports come up - if all but the port with the wire formerly in > em1 come up, it points to the switch config. > > -- > Chris Adams > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > -- Derek Atkins 617-623-3745 de...@ihtfp.com www.ihtfp.com Computer and Internet Security Consultant ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] LACP Bonding issue
Sorry about the message with nothing new... Once upon a time, Bryan Sockel said: > We checked the port groups, and servers are cabled correctly. > > After server is rebooted, em1 is the only interface passing traffic. > Other 3 nics sitting idle. We can down each port on the switch and > confirm it is down on the server. > > I am pretty sure it is related to the bridge that was created to pass > vm-host-altn traffic when the appliance was first installed. Well, I don't have any problem with that setup on multiple oVirt clusters (including a bunch of R610 servers), so I don't think that's it. I configure oVirt for "custom" bonding options; I use: mode=802.3ad lacp_rate=1 xmit_hash_policy=layer2+3 Is it possible to move the wires around temporarily, so different server ports are connected to different switch ports? It would be interested to see if the "solo" behavior stayed with the port or the wire. -- Chris Adams ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] LACP Bonding issue
Once upon a time, Bryan Sockel said: > We checked the port groups, and servers are cabled correctly. > > After server is rebooted, em1 is the only interface passing traffic. > Other 3 nics sitting idle. We can down each port on the switch and > confirm it is down on the server. > > > I am pretty sure it is related to the bridge that was created to pass > vm-host-altn traffic when the appliance was first installed. > > > > Original message > From: Chris Adams > Date: 4/20/17 5:40 PM (GMT-06:00) > To: users@ovirt.org > Subject: Re: [ovirt-users] LACP Bonding issue > > _ > > >From : Chris Adams [c...@cmadams.net] > To : users@ovirt.org [users@ovirt.org] > Date : Thursday, April 20 2017 17:40:25 > Once upon a time, Bryan Sockel said: > > It seems that is some disconnect between my network bridge, the bond > and my > > interfaces. I would like to some how get my bond to use all 4 > interfaces. > > On reboot, it always seems to reset consistently to EM1. > > Are you sure the switch side is all the same LACP group? Sounds like > one port may accidentally be in a separate group, and that happens to be > em1. > > You might try swapping wires between em1 and another port and reboot and > see which ports come up - if all but the port with the wire formerly in > em1 come up, it points to the switch config. > > -- > Chris Adams > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users -- Chris Adams ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] LACP Bonding issue
We checked the port groups, and servers are cabled correctly. After server is rebooted, em1 is the only interface passing traffic. Other 3 nics sitting idle. We can down each port on the switch and confirm it is down on the server. I am pretty sure it is related to the bridge that was created to pass vm-host-altn traffic when the appliance was first installed. Original message From: Chris Adams Date: 4/20/17 5:40 PM (GMT-06:00) To: users@ovirt.org Subject: Re: [ovirt-users] LACP Bonding issue _ >From : Chris Adams [c...@cmadams.net] To : users@ovirt.org [users@ovirt.org] Date : Thursday, April 20 2017 17:40:25 Once upon a time, Bryan Sockel said: > It seems that is some disconnect between my network bridge, the bond and my > interfaces. I would like to some how get my bond to use all 4 interfaces. > On reboot, it always seems to reset consistently to EM1. Are you sure the switch side is all the same LACP group? Sounds like one port may accidentally be in a separate group, and that happens to be em1. You might try swapping wires between em1 and another port and reboot and see which ports come up - if all but the port with the wire formerly in em1 come up, it points to the switch config. -- Chris Adams ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] LACP Bonding issue
Once upon a time, Bryan Sockel said: > It seems that is some disconnect between my network bridge, the bond and my > interfaces. I would like to some how get my bond to use all 4 interfaces. > On reboot, it always seems to reset consistently to EM1. Are you sure the switch side is all the same LACP group? Sounds like one port may accidentally be in a separate group, and that happens to be em1. You might try swapping wires between em1 and another port and reboot and see which ports come up - if all but the port with the wire formerly in em1 come up, it points to the switch config. -- Chris Adams ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] LACP Bonding issue
After further testing we can either get EM1 running on the bond or EM2 - EM4 running in the bond, but not EM1-EM4. We are running the Hosted Engine Appliance in our setup. In order to install the appliance, i have to point it to a physical nic during the install process. The install process creates the network bridge ovirtmgmt which is tied to interface EM1 on both servers. After i finished setting up the appliance, and both of my hosts, i went in and created my bond so i could configure LACP. It seems that is some disconnect between my network bridge, the bond and my interfaces. I would like to some how get my bond to use all 4 interfaces. On reboot, it always seems to reset consistently to EM1. -Original Message- From: Konstantin Shalygin To: users@ovirt.org, Bryan Sockel Date: Thu, 20 Apr 2017 23:43:15 +0700 Subject: Re: Re: [ovirt-users] LACP Bonding issue You should configure your LAG with this options (custom mode on oVirt): mode=4 miimon=100 xmit_hash_policy=2 lacp_rate=1 An tell to your network admin configure switch: "Give me lacp timeout short with channel-group mode active. Also set port-channel load-balance src-dst-mac-ip (or src-dst-ip\src-dst-mac)". You also need to understand that LACP balancing works 'per flow'. You can take 2 hosts and run "iperf -c xxx.xxx.xxx.xxx -i 0.1 -d", and on one phy interface you should see 1Gb RX, and on another phy interface 1Gb TX. Hi, I discovered an issue with my LACP configuration and i am having trouble figuring it out. I am running 2 Dell Powered 610's with 4 broadcomm nics. I am trying to bond them together, however only one of the nics goes active no mater how much traffic i push across the links. I have spoken to my network admin, and says that the switch ports are configured and can only see one active link on the switch. Thanks Bryan___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] LACP Bonding issue
You should configure your LAG with this options (custom mode on oVirt): mode=4 miimon=100 xmit_hash_policy=2 lacp_rate=1 An tell to your network admin configure switch: "Give me lacp timeout short with channel-group mode active. Also set port-channel load-balance src-dst-mac-ip (or src-dst-ip\src-dst-mac)". You also need to understand that LACP balancing works 'per flow'. You can take 2 hosts and run "iperf -c xxx.xxx.xxx.xxx -i 0.1 -d", and on one phy interface you should see 1Gb RX, and on another phy interface 1Gb TX. Hi, I discovered an issue with my LACP configuration and i am having trouble figuring it out. I am running 2 Dell Powered 610's with 4 broadcomm nics. I am trying to bond them together, however only one of the nics goes active no mater how much traffic i push across the links. I have spoken to my network admin, and says that the switch ports are configured and can only see one active link on the switch. Thanks Bryan ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users