GitHub user mattjereb created a discussion: High-availability networking
(bonding + bridging) issue on Ubuntu 24.04 for cloud infrastructure
Dear CloudStack Community Members,
I need help :)
I couldn’t find any clear instructions online for configuring a
high-availability network adapter setup to support cloud infrastructure.
I have 6× 10Gb network adapters per host and would like to configure them as
follows:
Host/Compute nodes:
2× Management
2× Tenant traffic
1× iSCSI Port A
1× iSCSI Port B
Management node:
1× Management
I have already set up bonding and bridging on Ubuntu 24.04 hosts. From the
Linux perspective the network works correctly (connectivity, pings, etc. all
function as expected). However, the cloud agent/management services cannot
connect because the management service does not recognise the software bridge
interface (mgmtbr).
Does anyone have experience with this kind of setup? Any suggestions or
recommended configurations would be greatly appreciated.
**Netplan**
`network:
version: 2
renderer: networkd
ethernets:
ens160: {}
ens161: {}
ens224: {}
ens256: {}
ens193: { addresses: ["192.168.251.11/24"] }
ens225: { addresses: ["192.168.252.11/24"] }
bonds:
mgmt-bond:
interfaces: [ens224, ens160]
parameters:
mode: active-backup
primary: ens224
mii-monitor-interval: 100
overlay-bond:
interfaces: [ens256, ens161]
parameters:
mode: active-backup
mii-monitor-interval: 100
vlans:
vlan11-public:
id: 11
link: overlay-bond
vlan31-vxlan: # New dedicated VLAN for Overlay/VXLAN
id: 31
link: overlay-bond
bridges:
mgmtbr:
interfaces: [mgmt-bond]
addresses: ["10.0.30.11/24"]
nameservers:
addresses:
- 10.0.30.8
search: [poc.local]
routes:
- to: default
via: "10.0.30.1"
metric: 10
parameters: { stp: false, forward-delay: 0 }
publicbr: # Dedicated to Public Internet Access
interfaces: [vlan11-public]
parameters: { stp: false, forward-delay: 0 }
overlaybr: # Dedicated to VXLAN Overlay
interfaces: [vlan31-vxlan]
addresses: ["10.0.31.11/24"] # This is your VTEP IP for VXLAN
parameters: { stp: false, forward-delay: 0 }
`
**management-server.log**
`2026-03-27 14:59:52,146 DEBUG [c.c.a.m.ClusteredAgentAttache]
(AgentConnectTaskPool-553:[ctx-996add69]) (logid:1be161e5) Seq
5-8892638939219755009: Routed from 345040297085
2026-03-27 14:59:52,146 DEBUG [c.c.a.t.Request]
(AgentConnectTaskPool-553:[ctx-996add69]) (logid:1be161e5) Seq
5-8892638939219755009: Sending { Cmd , MgmtId: 345040297085, via: 5(node1),
Ver: v1, Flags: 100111,
[{"com.cloud.agent.api.CheckNetworkCommand":{"networkInfoList":[{"physicalNetworkId":"210","privateNetworkName":"mgmtbr","storageNetworkName":"mgmtbr"},{"physicalNetworkId":"211","publicNetworkName":"publicbr"},{"physicalNetworkId":"212","guestNetworkName":"overlaybr"}],"wait":"0","bypassHostMaintenance":"false"}}]
}
2026-03-27 14:59:52,189 DEBUG [c.c.a.t.Request] (AgentManager-Handler-14:[])
(logid:) Seq 5-8892638939219755009: Processing: { Ans: , MgmtId: 345040297085,
via: 5, Ver: v1, Flags: 110,
[{"com.cloud.agent.api.CheckNetworkAnswer":{"_reconnect":"false","result":"false","details":"Can
not find network: mgmtbr","wait":"0","bypassHostMaintenance":"false"}}] }
2026-03-27 14:59:52,189 DEBUG [c.c.a.m.ClusteredAgentAttache]
(AgentManager-Handler-14:[]) (logid:) Seq 5-8892638939219755009: No more
commands found
2026-03-27 14:59:52,189 DEBUG [c.c.a.t.Request]
(AgentConnectTaskPool-553:[ctx-996add69]) (logid:1be161e5) Seq
5-8892638939219755009: Received: { Ans: , MgmtId: 345040297085, via: 5(node1),
Ver: v1, Flags: 110, { CheckNetworkAnswer } }
2026-03-27 14:59:52,189 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
(AgentConnectTaskPool-553:[ctx-996add69]) (logid:1be161e5) Details from
executing class com.cloud.agent.api.CheckNetworkCommand: Can not find network:
mgmtbr
2026-03-27 14:59:52,189 WARN [o.a.c.e.o.NetworkOrchestrator]
(AgentConnectTaskPool-553:[ctx-996add69]) (logid:1be161e5) Unable to setup
agent Host
{"id":5,"name":"node1","type":"Routing","uuid":"f04d374b-2944-4bbb-ab81-ba09becb42e3"}
due to Can not find network: mgmtbr
2026-03-27 14:59:52,190 WARN [c.c.a.AlertManagerImpl]
(AgentConnectTaskPool-553:[ctx-996add69]) (logid:1be161e5) alertType=[7]
dataCenterId=[4] podId=[3] clusterId=[null] message=[Incorrect Network setup on
agent, Reinitialize agent after network names are setup, details : Can not find
network: mgmtbr].
2026-03-27 14:59:52,193 WARN [c.c.a.AlertManagerImpl]
(AgentConnectTaskPool-553:[ctx-996add69]) (logid:1be161e5) No recipients set in
global setting 'alert.email.addresses', skipping sending alert with subject
[Incorrect Network setup on agent, Reinitialize agent after network names are
setup, details : Can not find network: mgmtbr] and content [Incorrect Network
setup on agent, Reinitialize agent after network names are setup, details : Can
not find network: mgmtbr].
2026-03-27 14:59:52,193 INFO [c.c.u.e.CSExceptionErrorCode]
(AgentConnectTaskPool-553:[ctx-996add69]) (logid:1be161e5) Could not find
exception: com.cloud.exception.ConnectionException in error code list for
exceptions
`
`root@node1:~# virsh nodedev-list --cap net
net_ens160_00_50_56_01_1c_61
net_ens160_ba_27_30_8c_c6_9e
net_ens160_fe_09_1a_bd_f1_36
net_ens161_4a_88_03_38_ad_c5
net_ens193_00_50_56_01_1c_65
net_ens224_00_50_56_01_1c_62
net_ens224_fe_09_1a_bd_f1_36
net_ens225_00_50_56_01_1c_66
net_ens256_4a_88_03_38_ad_c5
net_lo_00_00_00_00_00_00
root@node1:~# brctl show
bridge name bridge id STP enabled interfaces
cloud0 8000.4e3408889113 no
mgmtbr 8000.fe091abdf136 yes mgmt-bond
overlaybr 8000.4a880338adc5 no vlan31-vxlan
publicbr 8000.4a880338adc5 no vlan11-public
`
Kind Regards, Matt
GitHub link: https://github.com/apache/cloudstack/discussions/12905
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
