On Thu, Sep 3, 2020 at 11:51 AM Sverker Abrahamsson via Users < users@ovirt.org> wrote:
> Hi Dominik > That is my issue, I don't get to where I can get the ovirtmgmt bridge > established because vdsm insists on creating it. It used to be possible to > create that bridge statically and vdsm would just skip it but seems to be > broken now. > > If it would be possible to use OVN for the management network that would > solve my issue and would be the preferable solution, but as you write that > isn't possible which was what I suspected. > > Do you have any other suggestion on how to solve this issue? That I get > the external interface untagged and the internal network tagged is not > possible to change. > > /Sverker > Hello Sverker, can you please share output from "nmcli con show" and "nmstatectl show"? Thank you. Regards, Ales > Den 2020-09-03 kl. 10:52, skrev Dominik Holler: > > > > On Wed, Sep 2, 2020 at 10:38 PM Sverker Abrahamsson via Users < > users@ovirt.org> wrote: > >> Well, unforturnatly I don't have a choise since it is out of my control. >> I only have one physical network port where the external traffic is >> untagged and the internal vlan is tagged. If I could run with OVN >> > > OVN is for VM traffic only, not usable for the management network. > > >> instead I wouldn't need that tagged vlan, but I haven't been able to get >> that to work neither. >> >> > Please let us know if OVN does not work for VM traffic for you. > > >> It's perfectly possible to have both tagged and untagged traffic on the >> same switch port, issue is that vdsm tries to take control over the >> network without being able to be flexible enough.. I'm attempting now to >> have ovirtmgmt bridge created before, that used to be possible but >> according to previous mails on the list it went broken somewhere at 4.x. >> >> /Sverker >> >> Den 2020-09-02 kl. 21:39, skrev Strahil Nikolov: >> > Switchports can either be tagged or untagged. >> > I'm not sure that your setup is supported at all. >> > >> > Best Regards, >> > Strahil Nikolov >> > >> > >> > >> > >> > >> > >> > В сряда, 2 септември 2020 г., 20:41:57 Гринуич+3, Sverker Abrahamsson >> via Users <users@ovirt.org> написа: >> > >> > >> > >> > >> > >> > Pretty formatting the "desired state" it seems that vdsm tries to remove >> > the ip of my underlying interface, that is enp4s0: >> > > > > { >> > 'interfaces': [{ >> > 'name': 'enp4s0', >> > 'state': 'up', >> > 'mtu': 1500 >> > }, { >> > 'vlan': { >> > 'id': 4000, >> > 'base-iface': 'enp4s0' >> > }, >> > 'name': 'enp4s0.4000', >> > 'type': 'vlan', >> > 'state': 'up', >> > 'mtu': 1500, >> > 'ipv4': { >> > 'enabled': False >> > }, >> > 'ipv6': { >> > 'enabled': False >> > } >> > }, { >> > 'name': 'ovirtmgmt', >> > 'type': 'linux-bridge', >> > 'state': 'up', >> > 'mtu': 1500, >> > 'bridge': { >> > 'port': [{ >> > 'name': 'enp4s0.4000' >> > } >> > ], >> > 'options': { >> > 'stp': { >> > 'enabled': False >> > } >> > } >> > }, >> > 'ipv4': { >> > 'enabled': True, >> > 'address': [{ >> > 'ip': '172.27.1.1', >> > 'prefix-length': 24 >> > } >> > ], >> > 'dhcp': False >> > }, >> > 'ipv6': { >> > 'enabled': False >> > } >> > } >> > ], >> > 'dns-resolver': { >> > 'config' >> > : { >> > 'server': ['213.133.98.98'] >> > } >> > } >> > } >> > >> > > Thanks, this is helpful information. > Can you please share the getCapabilities result sent from vdsm to Engine > directly before the setupNetworks request, > and the parameters of the setupNetworks request from Engine to vdsm? > Both are in the vdsm.log during adding the host. > > >> > >> > This is my interfaces before vdsm attemtpts to change the config: >> > >> > enp4s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 >> > inet 144.76.84.73 netmask 255.255.255.255 broadcast 0.0.0.0 >> > inet6 fe80::62a4:4cff:fee9:4ac prefixlen 64 scopeid >> 0x20<link> >> > inet6 2a01:4f8:192:1148::2 prefixlen 64 scopeid 0x0<global> >> > ether 60:a4:4c:e9:04:ac txqueuelen 1000 (Ethernet) >> > RX packets 293442 bytes 385541799 (367.6 MiB) >> > RX errors 0 dropped 0 overruns 0 frame 0 >> > TX packets 91095 bytes 31160348 (29.7 MiB) >> > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >> > device interrupt 17 memory 0xf7d00000-f7d20000 >> > >> > enp4s0.4000: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 >> > inet 172.27.1.1 netmask 255.255.255.0 broadcast 172.27.1.255 >> > inet6 fe80::62a4:4cff:fee9:4ac prefixlen 64 scopeid >> 0x20<link> >> > ether 60:a4:4c:e9:04:ac txqueuelen 1000 (Ethernet) >> > RX packets 0 bytes 0 (0.0 B) >> > RX errors 0 dropped 0 overruns 0 frame 0 >> > TX packets 13 bytes 938 (938.0 B) >> > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >> > >> > I.e. enp4s0 is the external interface that must not be changed, bridge >> > must be created on the vlan interface. I would prefer to create the >> > bridge manually and not through vdsm if that is possible. >> > >> > /Sverker >> > >> > Den 2020-09-02 kl. 19:14, skrev Sverker Abrahamsson via Users: >> >> Hi, >> >> I'm attempting to install hosted engine but getting this failure: >> >> >> >> [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": >> >> "The host has been set in non_operational status, deployment errors: >> >> code 505: Host h1-mgmt.limetransit.com installation failed. Failed to >> >> configure management network on the host., code 1120: Failed to >> >> configure management network on host h1-mgmt.limetransit.com due to >> >> setup networks failure., code 9000: Failed to verify Power Management >> >> configuration for Host h1-mgmt.limetransit.com., code 10802: VDSM >> >> h1-mgmt.limetransit.com command HostSetupNetworksVDS failed: Internal >> >> JSON-RPC error: {'reason': 'Unexpected failure of libnm when running >> >> the mainloop: run execution'}, fix accordingly and re-deploy."} >> >> >> >> Looking in vdsm.log I find this which I believe is the root cause: >> >> >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:25,897::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) >> >> call setupNetworks with ({'ovirtmgmt': {'vlan': '4000', 'netmask': >> >> '255.255.255.0', 'ipv6autoconf': False, >> >> 'nic': 'enp4s0', 'bridged': 'true', 'ipaddr': '172.27.1.1', >> >> 'defaultRoute': True, 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, >> >> 'switch': 'legacy'}}, {}, {'connectivityTimeout': 120, >> >> 'commitOnSuccess': True, 'connectivityCh >> >> eck': 'true'}) {} >> >> MainProcess|jsonrpc/0::INFO::2020-09-02 >> >> 16:38:25,897::api::220::root::(setupNetworks) Setting up network >> >> according to configuration: networks:{'ovirtmgmt': {'vlan': '4000', >> >> 'netmask': '255.255.255.0', 'ipv6autoconf': Fal >> >> se, 'nic': 'enp4s0', 'bridged': 'true', 'ipaddr': '172.27.1.1', >> >> 'defaultRoute': True, 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, >> >> 'switch': 'legacy'}}, bondings:{}, options:{'connectivityTimeout': >> >> 120, 'commitOnSuccess': >> >> True, 'connectivityCheck': 'true'} >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:25,902::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd >> >> None) >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:25,906::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; >> >> <rc> = 0 >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:25,945::vsctl::74::root::(commit) Executing commands: >> >> /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge >> >> -- list Port -- list Interface >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:25,945::cmdutils::130::root::(exec_cmd) /usr/bin/ovs-vsctl >> >> --timeout=5 --oneline --format=json -- list Bridge -- list Port -- >> >> list Interface (cwd None) >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:25,952::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; >> >> <rc> = 0 >> >> MainProcess|jsonrpc/0::INFO::2020-09-02 >> >> 16:38:25,957::netconfpersistence::58::root::(setNetwork) Adding >> >> network ovirtmgmt({'vlan': 4000, 'netmask': '255.255.255.0', >> >> 'ipv6autoconf': False, 'nic': 'enp4s0', 'bridged': True >> >> , 'ipaddr': '172.27.1.1', 'defaultRoute': True, 'dhcpv6': False, >> >> 'mtu': 1500, 'switch': 'legacy', 'stp': False, 'bootproto': 'none', >> >> 'nameservers': ['213.133.98.98']}) >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:25,958::commands::153::common.commands::(start) /usr/bin/taskset >> >> --cpu-list 0-7 /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe >> >> (cwd None) >> >> MainProcess|jsonrpc/0::INFO::2020-09-02 >> >> 16:38:26,154::hooks::122::root::(_runHooksDir) >> >> /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe: rc=0 err=b'' >> >> MainProcess|jsonrpc/0::INFO::2020-09-02 >> >> 16:38:26,155::configurator::195::root::(_setup_nmstate) Processing >> >> setup through nmstate >> >> MainProcess|jsonrpc/0::INFO::2020-09-02 >> >> 16:38:26,175::configurator::197::root::(_setup_nmstate) Desired state: >> >> {'interfaces': [{'name': 'enp4s0', 'state': 'up', 'mtu': 1500}, >> >> {'vlan': {'id': 4000, 'base-iface': 'enp4s0'} >> >> , 'name': 'enp4s0.4000', 'type': 'vlan', 'state': 'up', 'mtu': 1500, >> >> 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': >> >> 'ovirtmgmt', 'type': 'linux-bridge', 'state': 'up', 'mtu': 1500, >> >> 'bridge': {'port': [ >> >> {'name': 'enp4s0.4000'}], 'options': {'stp': {'enabled': False}}}, >> >> 'ipv4': {'enabled': True, 'address': [{'ip': '172.27.1.1', >> >> 'prefix-length': 24}], 'dhcp': False}, 'ipv6': {'enabled': False}}], >> >> 'dns-resolver': {'config' >> >> : {'server': ['213.133.98.98']}}} >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:26,217::checkpoint::121::root::(create) Checkpoint >> >> /org/freedesktop/NetworkManager/Checkpoint/1 created for all devices: >> 60 >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:26,218::netapplier::239::root::(_add_interfaces) Adding new >> >> interfaces: ['ovirtmgmt'] >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:26,221::netapplier::251::root::(_edit_interfaces) Editing >> >> interfaces: ['enp4s0.4000', 'enp4s0'] >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:26,224::nmclient::136::root::(execute_next_action) Executing NM >> >> action: func=add_connection_async >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:26,231::connection::329::root::(_add_connection_callback) >> >> Connection adding succeeded: dev=ovirtmgmt >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:26,232::nmclient::136::root::(execute_next_action) Executing NM >> >> action: func=commit_changes_async >> >> MainProcess|jsonrpc/0::ERROR::2020-09-02 >> >> 16:38:26,233::nmclient::200::root::(quit) NM main-loop aborted: >> >> Connection update failed: error=nm-connection-error-quark: >> >> ipv6.gateway: gateway cannot be set if there are no addresses >> >> configured (7), dev=enp4s0/<enum NM_DEVICE_STATE_ACTIVATED of type >> >> NM.DeviceState> >> >> MainProcess|jsonrpc/0::DEBUG::2020-09-02 >> >> 16:38:26,246::checkpoint::164::root::(rollback) Checkpoint >> >> /org/freedesktop/NetworkManager/Checkpoint/1 rollback executed: >> >> >> dbus.Dictionary({dbus.String('/org/freedesktop/NetworkManager/Devices/6'): >> >> dbus.UInt32(0), >> >> dbus.String('/org/freedesktop/NetworkManager/Devices/7'): >> >> dbus.UInt32(0), >> >> dbus.String('/org/freedesktop/NetworkManager/Devices/8'): >> >> dbus.UInt32(0), >> >> dbus.String('/org/freedesktop/NetworkManager/Devices/9'): >> >> dbus.UInt32(0), >> >> dbus.String('/org/freedesktop/NetworkManager/Devices/3'): >> >> dbus.UInt32(0), >> >> dbus.String('/org/freedesktop/NetworkManager/Devices/2'): >> >> dbus.UInt32(0), >> >> dbus.String('/org/freedesktop/NetworkManager/Devices/4'): >> >> dbus.UInt32(0), >> >> dbus.String('/org/freedesktop/NetworkManager/Devices/1'): >> >> dbus.UInt32(0), >> >> dbus.String('/org/freedesktop/NetworkManager/Devices/5'): >> >> dbus.UInt32(0)}, signature=dbus.Signature('su')) >> >> MainProcess|jsonrpc/0::ERROR::2020-09-02 >> >> 16:38:31,251::supervdsm_server::97::SuperVdsm.ServerCallback::(wrapper) >> >> Error in setupNetworks >> >> Traceback (most recent call last): >> >> File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", >> >> line 95, in wrapper >> >> res = func(*args, **kwargs) >> >> File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line >> >> 241, in setupNetworks >> >> _setup_networks(networks, bondings, options, net_info) >> >> File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line >> >> 266, in _setup_networks >> >> networks, bondings, options, net_info, in_rollback >> >> File >> >> >> "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", >> >> line 154, in setup >> >> _setup_nmstate(networks, bondings, options, in_rollback) >> >> File >> >> >> "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", >> >> line 199, in _setup_nmstate >> >> nmstate.setup(desired_state, verify_change=not in_rollback) >> >> File "/usr/lib/python3.6/site-packages/vdsm/network/nmstate.py", >> >> line 63, in setup >> >> state_apply(desired_state, verify_change=verify_change) >> >> File "/usr/lib/python3.6/site-packages/libnmstate/deprecation.py", >> >> line 40, in wrapper >> >> return func(*args, **kwargs) >> >> File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", >> >> line 96, in wrapped >> >> ret = func(*args, **kwargs) >> >> File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", >> >> line 73, in apply >> >> state.State(desired_state), verify_change, commit, >> rollback_timeout >> >> File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", >> >> line 163, in _apply_ifaces_state >> >> con_profiles=ifaces_add_configs + ifaces_edit_configs, >> >> File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__ >> >> next(self.gen) >> >> File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", >> >> line 232, in _setup_providers >> >> mainloop.run(timeout=MAINLOOP_TIMEOUT) >> >> File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", >> >> line 177, in run >> >> f"Unexpected failure of libnm when running the mainloop: {err}" >> >> libnmstate.error.NmstateLibnmError: Unexpected failure of libnm when >> >> running the mainloop: run execution >> >> >> >> My host have a main network interface and a vlan interface on the same >> >> physical interface which is an internal management network which >> >> should be used as management network. The vlan interface doesn't have >> >> any ipv6 interface, but nmclient fails on setting ipv6 gateway. This >> >> seems like a bug? >> >> >> >> /Sverker >> >> >> >> _______________________________________________ >> >> discuss mailing list >> >> disc...@openvswitch.org >> >> https://mail.openvswitch.org/mailman/listinfo/ovs-discuss >> >> _______________________________________________ >> >> Users mailing list -- users@ovirt.org >> >> To unsubscribe send an email to users-le...@ovirt.org >> >> Privacy Statement: https://www.ovirt.org/privacy-policy.html >> >> oVirt Code of Conduct: >> >> https://www.ovirt.org/community/about/community-guidelines/ >> >> List Archives: >> >> >> https://lists.ovirt.org/archives/list/users@ovirt.org/message/R4YSTOQM7I4XLCWQJOJH5DKZFX56IDAZ/ >> > _______________________________________________ >> > Users mailing list -- users@ovirt.org >> > To unsubscribe send an email to users-le...@ovirt.org >> > Privacy Statement: https://www.ovirt.org/privacy-policy.html >> > oVirt Code of Conduct: >> https://www.ovirt.org/community/about/community-guidelines/ >> > List Archives: >> > >> https://lists.ovirt.org/archives/list/users@ovirt.org/message/UMXFPVLJHYOO3UR5PI24EPIXC3KATDPQ/ >> > >> _______________________________________________ >> Users mailing list -- users@ovirt.org >> To unsubscribe send an email to users-le...@ovirt.org >> Privacy Statement: https://www.ovirt.org/privacy-policy.html >> oVirt Code of Conduct: >> https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: >> https://lists.ovirt.org/archives/list/users@ovirt.org/message/RQIPLZGVOHXU5D2VPKSVPX7NEPYKGTRW/ >> > _______________________________________________ > Users mailing list -- users@ovirt.org > To unsubscribe send an email to users-le...@ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/ED2YKQAKVG66JOMX3JCNXPMWK6OX73ET/ > -- Ales Musil Software Engineer - RHV Network Red Hat EMEA <https://www.redhat.com> amu...@redhat.com IM: amusil <https://red.ht/sig>
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YCTXNC55QIOX7L4M7LXFP6XPJP67LNTX/