xuanyuanaosheng opened a new issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409
##### ISSUE TYPE
* Bug Report
##### OS / ENVIRONMENT
1. OS Version: Red Hat Enterprise Linux release 8.4 (Ootpa)
3. cloudstack version: cloudstack-agent-4.15.1.0-1.el8.x86_64
4. libvirt: 6.0.0-35
The network-scripts:
```
network-scripts-team-1.31-2.el8.x86_64
network-scripts-10.00.15-1.el8.x86_64
network-scripts-openvswitch-2.12.0-1.1.el8.x86_64
```
The net-tools
`net-tools-2.0-0.52.20160912git.el8.x86_64`
The openvswitch version:
```
openvswitch-devel-2.12.0-1.1.el8.x86_64
openvswitch-2.12.0-1.1.el8.x86_64
openvswitch-ipsec-2.12.0-1.1.el8.x86_64
pcp-pmda-openvswitch-5.2.5-4.el8.x86_64
python3-openvswitch-2.12.0-1.1.el8.x86_64
network-scripts-openvswitch-2.12.0-1.1.el8.x86_64
```
The cloudstack work node is using KVM + openvswitch
(http://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html#configuring-the-network-bridges-for-openvswitch
)
##### The configuration:
```
ovs-vsctl add-br cloudbr
ovs-vsctl add-port cloudbr eno1
ovs-vsctl set port cloudbr trunks=136,291,300
ovs-vsctl add-br mgmt0 cloudbr 136
ovs-vsctl add-br cloudbr0 cloudbr 291
ovs-vsctl add-br cloudbr1 cloudbr 300
```
The network configuration:
ifcfg-eno1
```
TYPE=OVSPort
IPV6INIT=no
BOOTPROTO=none
DEVICETYPE=ovs
OVS_BRIDGE=cloudbr
UUID=22c22720-553e-4c78-9f8a-5873805a0842
HOTPLUG=no
DEVICE=eno1
ONBOOT=yes
```
ifcfg-cloudbr
```
DEVICE=cloudbr
TYPE=OVSBridge
ONBOOT=yes
HOTPLUG=no
BOOTPROT=none
DEVICETYPE=ovs
```
ifcfg-mgmt0
```
DEVICE=mgmt0
TYPE=OVSBridge
ONBOOT=yes
HOTPLUG=no
BOOTPROT=static
DEVICETYPE=ovs
IPADDR=10.67.36.200
NETMASK=255.255.252.0
GATEWAY=10.67.39.254
```
ifcfg-cloudbr0
```
DEVICE=cloudbr0
ONBOOT=yes
HOTPLUG=no
DEVICETYPE=ovs
TYPE=OVSBridge
BOOTPROT=none
```
ifcfg-cloudbr1
```
DEVICE=cloudbr1
ONBOOT=yes
HOTPLUG=no
DEVICETYPE=ovs
TYPE=OVSBridge
BOOTPROT=none
```
The result:
```
# nmcli d
DEVICE TYPE STATE CONNECTION
virbr0 bridge connected (externally) virbr0
eno1 ethernet disconnected --
eno2 ethernet disconnected --
lo loopback unmanaged --
cloudbr openvswitch unmanaged --
cloudbr0 openvswitch unmanaged --
cloudbr1 openvswitch unmanaged --
mgmt0 openvswitch unmanaged --
ovs-system openvswitch unmanaged --
virbr0-nic tun unmanaged --
ip_vti0 vti unmanaged --
# nmcli c
NAME UUID TYPE DEVICE
virbr0 0f5b515b-1b16-4137-82fd-5cfb9dd38bd3 bridge virbr0
eno1 22c22720-553e-4c78-9f8a-5873805a0842 ethernet --
eno2 9652cf18-0c29-4100-b962-424aca932852 ethernet --
# ovs-vsctl show
8f14de15-de35-4934-8f6d-c6eff0995af9
Bridge cloudbr
Port "eno1"
Interface "eno1"
Port "mgmt0"
tag: 136
Interface "mgmt0"
type: internal
Port "cloudbr1"
tag: 501
Interface "cloudbr1"
type: internal
Port "cloudbr0"
tag: 291
Interface "cloudbr0"
type: internal
Port cloudbr
trunks: [136, 291, 501]
Interface cloudbr
type: internal
ovs_version: "2.12.0"
```
The openvswitch status
```
systemctl status openvswitch
● openvswitch.service - Open vSwitch
Loaded: loaded (/usr/lib/systemd/system/openvswitch.service; enabled;
vendor preset: disabled)
Active: active (exited) since Mon 2021-09-06 18:07:01 CST; 3min 27s ago
Process: 12375 ExecStop=/bin/true (code=exited, status=0/SUCCESS)
Process: 12686 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
Main PID: 12686 (code=exited, status=0/SUCCESS)
Tasks: 0 (limit: 3355442)
Memory: 0B
CGroup: /system.slice/openvswitch.service
Sep 06 18:07:01 wqdccls006.cn.infra systemd[1]: Starting Open vSwitch...
Sep 06 18:07:01 wqdccls006.cn.infra systemd[1]: Started Open vSwitch.
```
The openvswitch's log is:
1. ovsdb-server.log
```
2021-09-06T10:07:01.648Z|00001|vlog|INFO|opened log file
/var/log/openvswitch/ovsdb-server.log
2021-09-06T10:07:01.652Z|00002|ovsdb_server|INFO|ovsdb-server (Open vSwitch)
2.12.0
2021-09-06T10:07:01.656Z|00003|jsonrpc|WARN|unix#0: receive error:
Connection reset by peer
2021-09-06T10:07:01.656Z|00004|reconnect|WARN|unix#0: connection dropped
(Connection reset by peer)
2021-09-06T10:07:01.670Z|00005|jsonrpc|WARN|unix#2: receive error:
Connection reset by peer
2021-09-06T10:07:01.670Z|00006|reconnect|WARN|unix#2: connection dropped
(Connection reset by peer)
2021-09-06T10:07:01.794Z|00007|jsonrpc|WARN|unix#5: receive error:
Connection reset by peer
2021-09-06T10:07:01.794Z|00008|reconnect|WARN|unix#5: connection dropped
(Connection reset by peer)
```
2. ovs-vswitchd.log
```
2021-09-06T10:07:01.345Z|00035|bridge|INFO|bridge cloudbr: deleted interface
cloudbr on port 65534
2021-09-06T10:07:01.345Z|00036|bridge|INFO|bridge cloudbr: deleted interface
eno1 on port 1
2021-09-06T10:07:01.345Z|00037|bridge|INFO|bridge cloudbr: deleted interface
cloudbr1 on port 4
2021-09-06T10:07:01.345Z|00038|bridge|INFO|bridge cloudbr: deleted interface
cloudbr0 on port 3
2021-09-06T10:07:01.345Z|00039|bridge|INFO|bridge cloudbr: deleted interface
mgmt0 on port 2
2021-09-06T10:07:01.352Z|00001|ofproto_dpif_xlate(handler66)|WARN|received
packet on unknown port 1 on bridge cloudbr while processing
arp,in_port=1,dl_vlan=136,dl_vlan_pcp=1,vlan_tci1=0x0000,dl_src=00:50:56:ae:6d:67,dl_dst=ff:ff:ff:ff:ff:ff,arp_spa=10.67.39.112,arp_tpa=10.67.39.104,arp_op=1,arp_sha=00:50:56:ae:6d:67,arp_tha=00:00:00:00:00:00
2021-09-06T10:07:01.354Z|00002|ofproto_dpif_xlate(handler66)|WARN|received
packet on unknown port 1 on bridge cloudbr while processing
tcp,in_port=1,dl_vlan=136,dl_vlan_pcp=0,vlan_tci1=0x0000,dl_src=00:de:fb:bb:15:c1,dl_dst=82:95:f3:d0:06:43,nw_src=10.30.149.88,nw_dst=10.67.36.200,nw_tos=0,nw_ecn=0,nw_ttl=123,tp_src=54279,tp_dst=22,tcp_flags=ack
2021-09-06T10:07:01.371Z|00001|ofproto_dpif_upcall(handler98)|INFO|Dropped 3
log messages in last 2505 seconds (most recently, 2505 seconds ago) due to
excessive rate
2021-09-06T10:07:01.371Z|00002|ofproto_dpif_upcall(handler98)|INFO|received
packet on unassociated datapath port 2
2021-09-06T10:07:01.716Z|00001|vlog|INFO|opened log file
/var/log/openvswitch/ovs-vswitchd.log
2021-09-06T10:07:01.720Z|00002|ovs_numa|INFO|Discovered 16 CPU cores on NUMA
node 0
2021-09-06T10:07:01.720Z|00003|ovs_numa|INFO|Discovered 16 CPU cores on NUMA
node 1
2021-09-06T10:07:01.720Z|00004|ovs_numa|INFO|Discovered 2 NUMA nodes and 32
CPU cores
2021-09-06T10:07:01.720Z|00005|reconnect|INFO|unix:/var/run/openvswitch/db.sock:
connecting...
2021-09-06T10:07:01.720Z|00006|reconnect|INFO|unix:/var/run/openvswitch/db.sock:
connected
2021-09-06T10:07:01.724Z|00007|ofproto_dpif|INFO|system@ovs-system: Datapath
supports recirculation
2021-09-06T10:07:01.724Z|00008|ofproto_dpif|INFO|system@ovs-system: VLAN
header stack length probed as 2
2021-09-06T10:07:01.724Z|00009|ofproto_dpif|INFO|system@ovs-system: MPLS
label stack length probed as 1
2021-09-06T10:07:01.724Z|00010|ofproto_dpif|INFO|system@ovs-system: Datapath
supports truncate action
2021-09-06T10:07:01.724Z|00011|ofproto_dpif|INFO|system@ovs-system: Datapath
supports unique flow ids
2021-09-06T10:07:01.724Z|00012|ofproto_dpif|INFO|system@ovs-system: Datapath
supports clone action
2021-09-06T10:07:01.724Z|00013|ofproto_dpif|INFO|system@ovs-system: Max
sample nesting level probed as 10
2021-09-06T10:07:01.724Z|00014|ofproto_dpif|INFO|system@ovs-system: Datapath
supports eventmask in conntrack action
2021-09-06T10:07:01.724Z|00015|ofproto_dpif|INFO|system@ovs-system: Datapath
supports ct_clear action
2021-09-06T10:07:01.724Z|00016|ofproto_dpif|INFO|system@ovs-system: Max
dp_hash algorithm probed to be 0
2021-09-06T10:07:01.724Z|00017|ofproto_dpif|INFO|system@ovs-system: Datapath
supports check_pkt_len action
2021-09-06T10:07:01.724Z|00018|ofproto_dpif|INFO|system@ovs-system: Datapath
supports ct_state
2021-09-06T10:07:01.724Z|00019|ofproto_dpif|INFO|system@ovs-system: Datapath
supports ct_zone
2021-09-06T10:07:01.724Z|00020|ofproto_dpif|INFO|system@ovs-system: Datapath
supports ct_mark
2021-09-06T10:07:01.725Z|00021|ofproto_dpif|INFO|system@ovs-system: Datapath
supports ct_label
2021-09-06T10:07:01.725Z|00022|ofproto_dpif|INFO|system@ovs-system: Datapath
supports ct_state_nat
2021-09-06T10:07:01.725Z|00023|ofproto_dpif|INFO|system@ovs-system: Datapath
supports ct_orig_tuple
2021-09-06T10:07:01.725Z|00024|ofproto_dpif|INFO|system@ovs-system: Datapath
supports ct_orig_tuple6
```
##### EXPECTED RESULTS
The cloudstack work node's network works fine.
##### ACTUAL RESULTS
The cloudstack work node has no IP as configuration, the openvswitch status
is not ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]