Re: [ovirt-users] oVirt and Openstack Neutron: network not working
On Tue, Mar 21, 2017 at 12:59 PM, Luca 'remix_tj' Lorenzettowrote: > Hello Marcin, hello all, > > the provider failure was due to neutron services not behaving > correctly. Now when i try to start a VM attached to an external > network i get this in vdsm.log: > > [cut] Hello all, after some time i've been able to complete the integration between neutron (deployed with TripleO) and oVirt 4.1 What did i have to do? First, to have the configuration done directly by ovirt-manager i had to remove the host and re-add it specifying the external network provider in the related tab. The external provider should be configured also to point to the rabbitmq service listening into the internal_api network of Openstack. Additionally, all hosts that should use the openstack networks need to have access to the tenant networks directly or through router (in my case the tenant network is not routed, so i had to put an interface of the host in that network). Then the new host procedure should install and configure all requirements but: - no openstack packages are installed in ovirt-node-ng image - no repos available with openstack packages So i had to install manually this packages: openstack-neutron openstack-neutron-openvswitch openstack-utils openstack-selinux from RDO repos (and required to enable CentOS repos for dependencies) Then install also vsdm openstacknet hook (which is not available in enabled repos). Once did this also removing a default iptables policy: -A INPUT -j REJECT --reject-with icmp-host-prohibited that denies VXLAN to be established. Maybe a more detailed rule can be added allowing only the VXLAN port, but since i'm lazy and is only a lab, i tried with the ANY-ANY-ALLOW method. Then if the user adds a new host using as network provider a neutron provider, the configuration of neutron-openvswitch service should go on directly and configure all the requirements. After that the integration is working as i expect. If you want to do with already existing hosts you need to configure by hand openstack-neutron. Not a big deal, but if someone does this for you is better. I'll post my configuration in another email (need to check if is ok and has no useless entries). Had to open this two bugs for asking integration in the setup procedure and in ovirt-host-ng. https://bugzilla.redhat.com/show_bug.cgi?id=1446264 https://bugzilla.redhat.com/show_bug.cgi?id=1446306 Luca -- "E' assurdo impiegare gli uomini di intelligenza eccellente per fare calcoli che potrebbero essere affidati a chiunque se si usassero delle macchine" Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) "Internet è la più grande biblioteca del mondo. Ma il problema è che i libri sono tutti sparsi sul pavimento" John Allen Paulos, Matematico (1945-vivente) Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
Hello Marcin, hello all, the provider failure was due to neutron services not behaving correctly. Now when i try to start a VM attached to an external network i get this in vdsm.log: 2017-03-21 12:51:38,893 INFO (vm/23ea52a8) [vds] prepared volume path: /rhev/data-center/0001-0001-0001-0001-0311/3fb1af07-186b-4d2b-8a7a-26ff265f71fb/images/8933217f-47b0-4fe4-bb2f-7defcffb6bb8/4f996ad6-c06c-4527-be1f-45a9e718d01e (clientIF:374) 2017-03-21 12:51:39,047 INFO (vm/23ea52a8) [root] (hooks:108) 2017-03-21 12:51:39,809 INFO (vm/23ea52a8) [root] Adding vNIC 0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3 for provider type OPENSTACK_NETWORK and plugin OPEN_VSWITCHSetting up vNIC (portId 0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3) security groups openstacknet hook: [unexpected error]: Traceback (most recent call last): File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 194, in main() File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 148, in main addOpenstackVnic(domxml, pluginType, vNicId, hasSecurityGroups) File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 121, in addOpenstackVnic addOvsVnic(domxml, iface, portId, hasSecurityGroups) File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 90, in addOvsVnic addOvsHybridVnic(domxml, iface, portId) File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 98, in addOvsHybridVnic portId) File "/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py", line 99, in setUpSecurityGroupVnic 'external-ids:attached-mac=%s' % macAddr]) File "/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py", line 47, in executeOrExit (command, err)) RuntimeError: Failed to execute ['/usr/bin/ovs-vsctl', '--', '--may-exist', 'add-port', 'br-int', 'qvo0eec5c68-49', '--', 'set', 'Interface', 'qvo0eec5c68-49', 'external-ids:iface-id=0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3', 'external-ids:iface-status=active', u'external-ids:attached-mac=00:1a:4a:16:01:51'], due to: ovs-vsctl: no bridge named br-int (hooks:108) 2017-03-21 12:51:39,810 ERROR (vm/23ea52a8) [virt.vm] (vmId='23ea52a8-e499-41bb-8be4-8621b67869fd') The vm start process failed (vm:616) Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 552, in _startUnderlyingVm self._run() File "/usr/share/vdsm/virt/vm.py", line 1985, in _run domxml = hooks.before_vm_start(self._buildDomainXML(), File "/usr/share/vdsm/virt/vm.py", line 1667, in _buildDomainXML self._appendDevices(domxml) File "/usr/share/vdsm/virt/vm.py", line 1621, in _appendDevices deviceXML, self.conf, dev.custom) File "/usr/lib/python2.7/site-packages/vdsm/hooks.py", line 132, in before_device_create params=customProperties) File "/usr/lib/python2.7/site-packages/vdsm/hooks.py", line 118, in _runHooksDir raise exception.HookError(err) HookError: Hook Error: ('Adding vNIC 0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3 for provider type OPENSTACK_NETWORK and plugin OPEN_VSWITCHSetting up vNIC (portId 0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3) security groups\nopenstacknet hook: [unexpected error]: Traceback (most recent call last):\n File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 194, in \nmain()\n File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 148, in main\naddOpenstackVnic(domxml, pluginType, vNicId, hasSecurityGroups)\n File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 121, in addOpenstackVnic\naddOvsVnic(domxml, iface, portId, hasSecurityGroups)\n File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 90, in addOvsVnic\naddOvsHybridVnic(domxml, iface, portId)\n File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line 98, in addOvsHybridVnic\nportId)\n File "/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py", line 99, in setUpSecurityGroupVnic\n \'external-ids:attached-mac=%s\' % macAddr])\n File "/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py", line 47, in executeOrExit\n(command, err))\nRuntimeError: Failed to execute [\'/usr/bin/ovs-vsctl\', \'--\', \'--may-exist\', \'add-port\', \'br-int\', \'qvo0eec5c68-49\', \'--\', \'set\', \'Interface\', \'qvo0eec5c68-49\', \'external-ids:iface-id=0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3\', \'external-ids:iface-status=active\', u\'external-ids:attached-mac=00:1a:4a:16:01:51\'], due to: ovs-vsctl: no bridge named br-int\n\n\n\n',) 2017-03-21 12:51:39,812 INFO (vm/23ea52a8) [virt.vm] (vmId='23ea52a8-e499-41bb-8be4-8621b67869fd') Changed state to Down: Hook Error: ('Adding vNIC 0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3 for provider type OPENSTACK_NETWORK and plugin OPEN_VSWITCHSetting up vNIC (portId 0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3) security groups\nopenstacknet hook: [unexpected error]: Traceback (most recent call last):\n File
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
PROVIDER_FAILURE indicates a problem with the external network provider. The detailed cause of the error should be present in the vdsm logs. On Mon, Mar 13, 2017 at 11:37 AM, Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com> wrote: > About VM failing i can add this from engine.log: > > 2017-03-13 11:12:35,662+01 INFO > [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] > (org.ovirt.thread.pool-6-thread-5) > [462b7528-dce7-4b9e-98e4-f44ab9a551a5] START, > UpdateVmDynamicDataVDSCommand( > UpdateVmDynamicDataVDSCommandParameters:{runAsync='true', hostI > d='null', vmId='23ea52a8-e499-41bb-8be4-8621b67869fd', > vmDynamic='org.ovirt.engine.core.common.businessentities. > VmDynamic@da9f8b26'}), > log id: 4d5a0bbe > 2017-03-13 11:12:35,665+01 INFO > [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] > (org.ovirt.thread.pool-6-thread-5) > [462b7528-dce7-4b9e-98e4-f44ab9a551a5] FINISH, > UpdateVmDynamicDataVDSCommand, log id: 4d5a0bbe > 2017-03-13 11:14:35,698+01 ERROR > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (org.ovirt.thread.pool-6-thread-5) > [462b7528-dce7-4b9e-98e4-f44ab9a551a5] EVENT_ID: > USER_FAILED_RUN_VM(54), Correlation ID: > 462b7528-dce7-4b9e-98e4-f44ab9a551a5, Job ID > : 86497f63-6bd0-46e5-b667-320f4ef30f30, Call Stack: null, Custom Event > ID: -1, Message: Failed to run VM ovirt-node-test (User: > admin@internal-authz). > 2017-03-13 11:14:35,703+01 INFO > [org.ovirt.engine.core.bll.RunVmCommand] > (org.ovirt.thread.pool-6-thread-5) > [462b7528-dce7-4b9e-98e4-f44ab9a551a5] Lock freed to object > 'EngineLock:{exclusiveLocks='[23ea52a8-e499-41bb-8be4-8621b67869fd=ACTION_TYPE_FAILED_OBJECT_LOCKE > D>]', sharedLocks='null'}' > 2017-03-13 11:14:35,703+01 ERROR > [org.ovirt.engine.core.bll.RunVmCommand] > (org.ovirt.thread.pool-6-thread-5) > [462b7528-dce7-4b9e-98e4-f44ab9a551a5] Command > 'org.ovirt.engine.core.bll.RunVmCommand' failed: EngineException: > (Failed with error PROVIDER_FAILURE and code 5050) > 2017-03-13 11:14:35,713+01 INFO > [org.ovirt.engine.core.bll.ProcessDownVmCommand] > (org.ovirt.thread.pool-6-thread-36) [48f00a21] Running command: > ProcessDownVmCommand internal: true. > > I see in particular a PROVIDER_FAILURE error, that's maybe related. > > 2017-03-13 11:17 GMT+01:00 Luca 'remix_tj' Lorenzetto > : > > Hello, > > > > now, didn't understand why, the VM isn't starting. This is the VDSM > > log when i try to poweron while attached to an external network. If i > > attach to ovirtmgmt or other standard network, vm boots. > > > > Luca > > > > -- > > "E' assurdo impiegare gli uomini di intelligenza eccellente per fare > > calcoli che potrebbero essere affidati a chiunque se si usassero delle > > macchine" > > Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) > > > > "Internet è la più grande biblioteca del mondo. > > Ma il problema è che i libri sono tutti sparsi sul pavimento" > > John Allen Paulos, Matematico (1945-vivente) > > > > Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , < > lorenzetto.l...@gmail.com> > > > > -- > "E' assurdo impiegare gli uomini di intelligenza eccellente per fare > calcoli che potrebbero essere affidati a chiunque se si usassero delle > macchine" > Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) > > "Internet è la più grande biblioteca del mondo. > Ma il problema è che i libri sono tutti sparsi sul pavimento" > John Allen Paulos, Matematico (1945-vivente) > > Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , < > lorenzetto.l...@gmail.com> > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
About VM failing i can add this from engine.log: 2017-03-13 11:12:35,662+01 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-6-thread-5) [462b7528-dce7-4b9e-98e4-f44ab9a551a5] START, UpdateVmDynamicDataVDSCommand( UpdateVmDynamicDataVDSCommandParameters:{runAsync='true', hostI d='null', vmId='23ea52a8-e499-41bb-8be4-8621b67869fd', vmDynamic='org.ovirt.engine.core.common.businessentities.VmDynamic@da9f8b26'}), log id: 4d5a0bbe 2017-03-13 11:12:35,665+01 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-6-thread-5) [462b7528-dce7-4b9e-98e4-f44ab9a551a5] FINISH, UpdateVmDynamicDataVDSCommand, log id: 4d5a0bbe 2017-03-13 11:14:35,698+01 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-5) [462b7528-dce7-4b9e-98e4-f44ab9a551a5] EVENT_ID: USER_FAILED_RUN_VM(54), Correlation ID: 462b7528-dce7-4b9e-98e4-f44ab9a551a5, Job ID : 86497f63-6bd0-46e5-b667-320f4ef30f30, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM ovirt-node-test (User: admin@internal-authz). 2017-03-13 11:14:35,703+01 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-6-thread-5) [462b7528-dce7-4b9e-98e4-f44ab9a551a5] Lock freed to object 'EngineLock:{exclusiveLocks='[23ea52a8-e499-41bb-8be4-8621b67869fd=]', sharedLocks='null'}' 2017-03-13 11:14:35,703+01 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-6-thread-5) [462b7528-dce7-4b9e-98e4-f44ab9a551a5] Command 'org.ovirt.engine.core.bll.RunVmCommand' failed: EngineException: (Failed with error PROVIDER_FAILURE and code 5050) 2017-03-13 11:14:35,713+01 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-36) [48f00a21] Running command: ProcessDownVmCommand internal: true. I see in particular a PROVIDER_FAILURE error, that's maybe related. 2017-03-13 11:17 GMT+01:00 Luca 'remix_tj' Lorenzetto : > Hello, > > now, didn't understand why, the VM isn't starting. This is the VDSM > log when i try to poweron while attached to an external network. If i > attach to ovirtmgmt or other standard network, vm boots. > > Luca > > -- > "E' assurdo impiegare gli uomini di intelligenza eccellente per fare > calcoli che potrebbero essere affidati a chiunque se si usassero delle > macchine" > Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) > > "Internet è la più grande biblioteca del mondo. > Ma il problema è che i libri sono tutti sparsi sul pavimento" > John Allen Paulos, Matematico (1945-vivente) > > Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , > -- "E' assurdo impiegare gli uomini di intelligenza eccellente per fare calcoli che potrebbero essere affidati a chiunque se si usassero delle macchine" Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) "Internet è la più grande biblioteca del mondo. Ma il problema è che i libri sono tutti sparsi sul pavimento" John Allen Paulos, Matematico (1945-vivente) Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
Yes, or when you attach an external network vnic to a VM 2017-03-10 16:02 GMT+01:00 Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com>: > On Fri, Mar 10, 2017 at 2:41 PM, Marcin Mirecki> wrote: > > Luca, > > > > Can you please send me the vdsm log of plugging a vnic to an external > > network? > > The relevant log file is: /var/log/vdsm/vdsm.log > > You mean when i power on a VM that is using that external network? > > > -- > "E' assurdo impiegare gli uomini di intelligenza eccellente per fare > calcoli che potrebbero essere affidati a chiunque se si usassero delle > macchine" > Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) > > "Internet è la più grande biblioteca del mondo. > Ma il problema è che i libri sono tutti sparsi sul pavimento" > John Allen Paulos, Matematico (1945-vivente) > > Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , < > lorenzetto.l...@gmail.com> > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
On Fri, Mar 10, 2017 at 2:41 PM, Marcin Mireckiwrote: > Luca, > > Can you please send me the vdsm log of plugging a vnic to an external > network? > The relevant log file is: /var/log/vdsm/vdsm.log You mean when i power on a VM that is using that external network? -- "E' assurdo impiegare gli uomini di intelligenza eccellente per fare calcoli che potrebbero essere affidati a chiunque se si usassero delle macchine" Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) "Internet è la più grande biblioteca del mondo. Ma il problema è che i libri sono tutti sparsi sul pavimento" John Allen Paulos, Matematico (1945-vivente) Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
Luca, Can you please send me the vdsm log of plugging a vnic to an external network? The relevant log file is: /var/log/vdsm/vdsm.log On Fri, Mar 10, 2017 at 12:11 PM, Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com> wrote: > > > Il 10 mar 2017 11:48 AM, "Marcin Mirecki"ha > scritto: > > Hello Luca > > >Name: openstack-networks > >Type: OpenStack Networking > >Description: > >Provider URL: http://openstack.example.com:9696 > > I assume Networking Plugin: Open vSwitch > > > Yes, i confirm. > > > > Do you have any security groups defined for the vnic profile on your > external network? > Looking at the output you provided is seems you do.The qpb bridge and the > qvb/qvo veth pair are created when the security groups are present. > Can you try without the security groups? This would connect your vm vnic > right into the ovs integration bridge (br-int). > > > No i haven't defined any security policy, explicitly. I'm using a network > defined through horizon without any special option. > > > >This are the output of the commands you asked from a node where a vm > >that is attached to a neutron network is running: > Yes, this is what I needed. > > >[root@ovirt002 ~]# ovs-vsctl show > >ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection > >failed (No such file or directory) > > This is quite worrying. Is ovs on the host working properly? > Can you please check: service openvswitch status > If not active: service openvswitch start > > > Who should enable it, a cluster confoguration or whatl else? I'm using > ovirt-node-ng, i suppose that openvswitch is already installed (didn't > check). > > > > > >> Have you tried connecting any nics manually and checking connectivity > >> between them? > >What do you mean? > > Add 2 ports in openstack directly > Add 2 nics on vm's, specifying the libvirt xml for the interfaces: > > > > > > > > > > > > Where i find the xml file? > > > If the openstack neutron plugin works correctly, the ports should be > connected to the osn network. > > > > > > > On Thu, Mar 9, 2017 at 4:26 PM, Luca 'remix_tj' Lorenzetto < > lorenzetto.l...@gmail.com> wrote: > >> On Thu, Mar 9, 2017 at 2:24 PM, Marcin Mirecki >> wrote: >> > Hello Luca, >> >> Hello Marcin, >> >> > The osn provider basically only connects the vnics to the osn networks, >> > items like dhcp must be handled on the osn networks itself. >> >> Yes, i know. The network is defined by neutron, which has it's own dhcp >> server. >> >> > Have you tried connecting any nics manually and checking connectivity >> > between them? >> >> What do you mean? >> >> > No connectivity with static IP's could hint at some configuration >> problems. >> > Are osn/ovs set up correctly? Firewall blocking traffic? >> >> there is no firewall between openstack controllers and ovirt >> engine/hosts. My doubt is about configuration, i've configured in this >> way: >> >> Name: openstack-networks >> Type: OpenStack Networking >> Description: >> Provider URL: http://openstack.example.com:9696 >> >> Flagged read-only and requires authentication >> >> Set the authentication and tested, reports everything ok. >> >> Nothing else has been configured. I didn't found any documentation >> that clarified if is enough. >> >> After powering on i see on openstack this: >> >> [stack@opstrio1101 ~]$ openstack port list | grep 00:1a:4a:16:01:51 >> <-- this is mac address of oVirt VM >> | 86c46fed-dddf-4776-a765-27d4e52e861c | nic1 >> | 00:1a:4a:16:01:51 | ip_address='172.25.7.4', >> subnet_id='280a98ad-0fd5-4961-a307-d1bfea8355cd' | >> >> >> >> > Can you please send us a more detailed descirption of your env (ip addr, >> > brctl show, ovs-vsctl show)? >> >> This are the output of the commands you asked from a node where a vm >> that is attached to a neutron network is running: >> >> [root@ovirt002 ~]# ip addr >> 1: lo: mtu 65536 qdisc noqueue state UNKNOWN qlen 1 >> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 >> inet 127.0.0.1/8 scope host lo >>valid_lft forever preferred_lft forever >> inet6 ::1/128 scope host >>valid_lft forever preferred_lft forever >> 2: enp2s0f0: mtu 1500 qdisc mq >> master bond0 state UP qlen 1000 >> link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff >> 3: enp2s0f1: mtu 1500 qdisc mq >> master bond0 state UP qlen 1000 >> link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff >> 4: enp2s0f2: mtu 1500 qdisc mq >> master bond1 state UP qlen 1000 >> link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff >> 5: enp2s0f3: mtu 1500 qdisc mq >> master bond1 state UP qlen 1000 >> link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff >> 6: enp2s0f4: mtu 1500 qdisc mq >> state DOWN qlen 1000 >>
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
>[root@fltiovirt002 ~]# ovs-vsctl show >53bfa8a8-80c5-4372-abb1-633c29eb1e60 > ovs_version: "2.6.90 This show that ovs is up. It's however missing the integration bridge (br-int). The integration bridge is the bridge to which the vm vnics should be connected. Try: ovs-vsctl add-br br-int this should create the bridge. On Fri, Mar 10, 2017 at 2:09 PM, Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com> wrote: > On Fri, Mar 10, 2017 at 12:11 PM, Luca 'remix_tj' Lorenzetto >wrote: > > > >>[root@ovirt002 ~]# ovs-vsctl show > >>ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection > >>failed (No such file or directory) > > > > This is quite worrying. Is ovs on the host working properly? > > Can you please check: service openvswitch status > > If not active: service openvswitch start > > > > > > Hello, > > i started ovs on the node where vm is running, but now i see only this: > > [root@fltiovirt002 ~]# ovs-vsctl show > 53bfa8a8-80c5-4372-abb1-633c29eb1e60 > ovs_version: "2.6.90 > > even restarting the vm on the same host changes nothing. I see instead > q* interfaces appearing and disappearing from ip a s command output. > > > > -- > "E' assurdo impiegare gli uomini di intelligenza eccellente per fare > calcoli che potrebbero essere affidati a chiunque se si usassero delle > macchine" > Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) > > "Internet è la più grande biblioteca del mondo. > Ma il problema è che i libri sono tutti sparsi sul pavimento" > John Allen Paulos, Matematico (1945-vivente) > > Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , < > lorenzetto.l...@gmail.com> > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
> No i haven't defined any security policy, explicitly. I'm using a network defined through horizon without any special option. This is strange, as the basic flow should only connect the vnic to the ovs integration bridge. Please give me some time to look at the code. > Where i find the xml file? This is in the libvirt vm definition. It can be edited using the "virsh" tools: virsh edit You could also attempt to check this by attaching some an interface (like a veth pair) directly to the ovs bridge and setting the ovs interfaceid parameter to mark is as osn port. Let me know if this is clear, if not I will try to decribe the procedure in more detail. On Fri, Mar 10, 2017 at 12:11 PM, Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com> wrote: > > > Il 10 mar 2017 11:48 AM, "Marcin Mirecki"ha > scritto: > > Hello Luca > > >Name: openstack-networks > >Type: OpenStack Networking > >Description: > >Provider URL: http://openstack.example.com:9696 > > I assume Networking Plugin: Open vSwitch > > > Yes, i confirm. > > > > Do you have any security groups defined for the vnic profile on your > external network? > Looking at the output you provided is seems you do.The qpb bridge and the > qvb/qvo veth pair are created when the security groups are present. > Can you try without the security groups? This would connect your vm vnic > right into the ovs integration bridge (br-int). > > > No i haven't defined any security policy, explicitly. I'm using a network > defined through horizon without any special option. > > > >This are the output of the commands you asked from a node where a vm > >that is attached to a neutron network is running: > Yes, this is what I needed. > > >[root@ovirt002 ~]# ovs-vsctl show > >ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection > >failed (No such file or directory) > > This is quite worrying. Is ovs on the host working properly? > Can you please check: service openvswitch status > If not active: service openvswitch start > > > Who should enable it, a cluster confoguration or whatl else? I'm using > ovirt-node-ng, i suppose that openvswitch is already installed (didn't > check). > > > > > >> Have you tried connecting any nics manually and checking connectivity > >> between them? > >What do you mean? > > Add 2 ports in openstack directly > Add 2 nics on vm's, specifying the libvirt xml for the interfaces: > > > > > > > > > > > > Where i find the xml file? > > > If the openstack neutron plugin works correctly, the ports should be > connected to the osn network. > > > > > > > On Thu, Mar 9, 2017 at 4:26 PM, Luca 'remix_tj' Lorenzetto < > lorenzetto.l...@gmail.com> wrote: > >> On Thu, Mar 9, 2017 at 2:24 PM, Marcin Mirecki >> wrote: >> > Hello Luca, >> >> Hello Marcin, >> >> > The osn provider basically only connects the vnics to the osn networks, >> > items like dhcp must be handled on the osn networks itself. >> >> Yes, i know. The network is defined by neutron, which has it's own dhcp >> server. >> >> > Have you tried connecting any nics manually and checking connectivity >> > between them? >> >> What do you mean? >> >> > No connectivity with static IP's could hint at some configuration >> problems. >> > Are osn/ovs set up correctly? Firewall blocking traffic? >> >> there is no firewall between openstack controllers and ovirt >> engine/hosts. My doubt is about configuration, i've configured in this >> way: >> >> Name: openstack-networks >> Type: OpenStack Networking >> Description: >> Provider URL: http://openstack.example.com:9696 >> >> Flagged read-only and requires authentication >> >> Set the authentication and tested, reports everything ok. >> >> Nothing else has been configured. I didn't found any documentation >> that clarified if is enough. >> >> After powering on i see on openstack this: >> >> [stack@opstrio1101 ~]$ openstack port list | grep 00:1a:4a:16:01:51 >> <-- this is mac address of oVirt VM >> | 86c46fed-dddf-4776-a765-27d4e52e861c | nic1 >> | 00:1a:4a:16:01:51 | ip_address='172.25.7.4', >> subnet_id='280a98ad-0fd5-4961-a307-d1bfea8355cd' | >> >> >> >> > Can you please send us a more detailed descirption of your env (ip addr, >> > brctl show, ovs-vsctl show)? >> >> This are the output of the commands you asked from a node where a vm >> that is attached to a neutron network is running: >> >> [root@ovirt002 ~]# ip addr >> 1: lo: mtu 65536 qdisc noqueue state UNKNOWN qlen 1 >> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 >> inet 127.0.0.1/8 scope host lo >>valid_lft forever preferred_lft forever >> inet6 ::1/128 scope host >>valid_lft forever preferred_lft forever >> 2: enp2s0f0: mtu 1500 qdisc mq >> master bond0 state UP qlen 1000 >> link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff >> 3: enp2s0f1: mtu 1500 qdisc mq
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
On Fri, Mar 10, 2017 at 12:11 PM, Luca 'remix_tj' Lorenzettowrote: > >>[root@ovirt002 ~]# ovs-vsctl show >>ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection >>failed (No such file or directory) > > This is quite worrying. Is ovs on the host working properly? > Can you please check: service openvswitch status > If not active: service openvswitch start > > Hello, i started ovs on the node where vm is running, but now i see only this: [root@fltiovirt002 ~]# ovs-vsctl show 53bfa8a8-80c5-4372-abb1-633c29eb1e60 ovs_version: "2.6.90 even restarting the vm on the same host changes nothing. I see instead q* interfaces appearing and disappearing from ip a s command output. -- "E' assurdo impiegare gli uomini di intelligenza eccellente per fare calcoli che potrebbero essere affidati a chiunque se si usassero delle macchine" Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) "Internet è la più grande biblioteca del mondo. Ma il problema è che i libri sono tutti sparsi sul pavimento" John Allen Paulos, Matematico (1945-vivente) Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
Il 10 mar 2017 11:48 AM, "Marcin Mirecki"ha scritto: Hello Luca >Name: openstack-networks >Type: OpenStack Networking >Description: >Provider URL: http://openstack.example.com:9696 I assume Networking Plugin: Open vSwitch Yes, i confirm. Do you have any security groups defined for the vnic profile on your external network? Looking at the output you provided is seems you do.The qpb bridge and the qvb/qvo veth pair are created when the security groups are present. Can you try without the security groups? This would connect your vm vnic right into the ovs integration bridge (br-int). No i haven't defined any security policy, explicitly. I'm using a network defined through horizon without any special option. >This are the output of the commands you asked from a node where a vm >that is attached to a neutron network is running: Yes, this is what I needed. >[root@ovirt002 ~]# ovs-vsctl show >ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection >failed (No such file or directory) This is quite worrying. Is ovs on the host working properly? Can you please check: service openvswitch status If not active: service openvswitch start Who should enable it, a cluster confoguration or whatl else? I'm using ovirt-node-ng, i suppose that openvswitch is already installed (didn't check). >> Have you tried connecting any nics manually and checking connectivity >> between them? >What do you mean? Add 2 ports in openstack directly Add 2 nics on vm's, specifying the libvirt xml for the interfaces: Where i find the xml file? If the openstack neutron plugin works correctly, the ports should be connected to the osn network. On Thu, Mar 9, 2017 at 4:26 PM, Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com> wrote: > On Thu, Mar 9, 2017 at 2:24 PM, Marcin Mirecki > wrote: > > Hello Luca, > > Hello Marcin, > > > The osn provider basically only connects the vnics to the osn networks, > > items like dhcp must be handled on the osn networks itself. > > Yes, i know. The network is defined by neutron, which has it's own dhcp > server. > > > Have you tried connecting any nics manually and checking connectivity > > between them? > > What do you mean? > > > No connectivity with static IP's could hint at some configuration > problems. > > Are osn/ovs set up correctly? Firewall blocking traffic? > > there is no firewall between openstack controllers and ovirt > engine/hosts. My doubt is about configuration, i've configured in this > way: > > Name: openstack-networks > Type: OpenStack Networking > Description: > Provider URL: http://openstack.example.com:9696 > > Flagged read-only and requires authentication > > Set the authentication and tested, reports everything ok. > > Nothing else has been configured. I didn't found any documentation > that clarified if is enough. > > After powering on i see on openstack this: > > [stack@opstrio1101 ~]$ openstack port list | grep 00:1a:4a:16:01:51 > <-- this is mac address of oVirt VM > | 86c46fed-dddf-4776-a765-27d4e52e861c | nic1 > | 00:1a:4a:16:01:51 | ip_address='172.25.7.4', > subnet_id='280a98ad-0fd5-4961-a307-d1bfea8355cd' | > > > > > Can you please send us a more detailed descirption of your env (ip addr, > > brctl show, ovs-vsctl show)? > > This are the output of the commands you asked from a node where a vm > that is attached to a neutron network is running: > > [root@ovirt002 ~]# ip addr > 1: lo: mtu 65536 qdisc noqueue state UNKNOWN qlen 1 > link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 > inet 127.0.0.1/8 scope host lo >valid_lft forever preferred_lft forever > inet6 ::1/128 scope host >valid_lft forever preferred_lft forever > 2: enp2s0f0: mtu 1500 qdisc mq > master bond0 state UP qlen 1000 > link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff > 3: enp2s0f1: mtu 1500 qdisc mq > master bond0 state UP qlen 1000 > link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff > 4: enp2s0f2: mtu 1500 qdisc mq > master bond1 state UP qlen 1000 > link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff > 5: enp2s0f3: mtu 1500 qdisc mq > master bond1 state UP qlen 1000 > link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff > 6: enp2s0f4: mtu 1500 qdisc mq > state DOWN qlen 1000 > link/ether 00:21:5a:9b:b7:9b brd ff:ff:ff:ff:ff:ff > 7: enp2s0f5: mtu 1500 qdisc mq > state DOWN qlen 1000 > link/ether 00:21:5a:9b:b7:9d brd ff:ff:ff:ff:ff:ff > 8: enp2s0f6: mtu 1500 qdisc mq > state DOWN qlen 1000 > link/ether b4:b5:2f:55:bc:eb brd ff:ff:ff:ff:ff:ff > 9: enp2s0f7: mtu 1500 qdisc mq > state DOWN qlen 1000
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
Hello Luca >Name: openstack-networks >Type: OpenStack Networking >Description: >Provider URL: http://openstack.example.com:9696 I assume Networking Plugin: Open vSwitch Do you have any security groups defined for the vnic profile on your external network? Looking at the output you provided is seems you do.The qpb bridge and the qvb/qvo veth pair are created when the security groups are present. Can you try without the security groups? This would connect your vm vnic right into the ovs integration bridge (br-int). >This are the output of the commands you asked from a node where a vm >that is attached to a neutron network is running: Yes, this is what I needed. >[root@ovirt002 ~]# ovs-vsctl show >ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection >failed (No such file or directory) This is quite worrying. Is ovs on the host working properly? Can you please check: service openvswitch status If not active: service openvswitch start >> Have you tried connecting any nics manually and checking connectivity >> between them? >What do you mean? Add 2 ports in openstack directly Add 2 nics on vm's, specifying the libvirt xml for the interfaces: If the openstack neutron plugin works correctly, the ports should be connected to the osn network. On Thu, Mar 9, 2017 at 4:26 PM, Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com> wrote: > On Thu, Mar 9, 2017 at 2:24 PM, Marcin Mirecki> wrote: > > Hello Luca, > > Hello Marcin, > > > The osn provider basically only connects the vnics to the osn networks, > > items like dhcp must be handled on the osn networks itself. > > Yes, i know. The network is defined by neutron, which has it's own dhcp > server. > > > Have you tried connecting any nics manually and checking connectivity > > between them? > > What do you mean? > > > No connectivity with static IP's could hint at some configuration > problems. > > Are osn/ovs set up correctly? Firewall blocking traffic? > > there is no firewall between openstack controllers and ovirt > engine/hosts. My doubt is about configuration, i've configured in this > way: > > Name: openstack-networks > Type: OpenStack Networking > Description: > Provider URL: http://openstack.example.com:9696 > > Flagged read-only and requires authentication > > Set the authentication and tested, reports everything ok. > > Nothing else has been configured. I didn't found any documentation > that clarified if is enough. > > After powering on i see on openstack this: > > [stack@opstrio1101 ~]$ openstack port list | grep 00:1a:4a:16:01:51 > <-- this is mac address of oVirt VM > | 86c46fed-dddf-4776-a765-27d4e52e861c | nic1 > | 00:1a:4a:16:01:51 | ip_address='172.25.7.4', > subnet_id='280a98ad-0fd5-4961-a307-d1bfea8355cd' | > > > > > Can you please send us a more detailed descirption of your env (ip addr, > > brctl show, ovs-vsctl show)? > > This are the output of the commands you asked from a node where a vm > that is attached to a neutron network is running: > > [root@ovirt002 ~]# ip addr > 1: lo: mtu 65536 qdisc noqueue state UNKNOWN qlen 1 > link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 > inet 127.0.0.1/8 scope host lo >valid_lft forever preferred_lft forever > inet6 ::1/128 scope host >valid_lft forever preferred_lft forever > 2: enp2s0f0: mtu 1500 qdisc mq > master bond0 state UP qlen 1000 > link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff > 3: enp2s0f1: mtu 1500 qdisc mq > master bond0 state UP qlen 1000 > link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff > 4: enp2s0f2: mtu 1500 qdisc mq > master bond1 state UP qlen 1000 > link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff > 5: enp2s0f3: mtu 1500 qdisc mq > master bond1 state UP qlen 1000 > link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff > 6: enp2s0f4: mtu 1500 qdisc mq > state DOWN qlen 1000 > link/ether 00:21:5a:9b:b7:9b brd ff:ff:ff:ff:ff:ff > 7: enp2s0f5: mtu 1500 qdisc mq > state DOWN qlen 1000 > link/ether 00:21:5a:9b:b7:9d brd ff:ff:ff:ff:ff:ff > 8: enp2s0f6: mtu 1500 qdisc mq > state DOWN qlen 1000 > link/ether b4:b5:2f:55:bc:eb brd ff:ff:ff:ff:ff:ff > 9: enp2s0f7: mtu 1500 qdisc mq > state DOWN qlen 1000 > link/ether b4:b5:2f:55:bc:ef brd ff:ff:ff:ff:ff:ff > 10: bond0: mtu 1500 qdisc > noqueue master ovirtmgmt state UP qlen 1000 > link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff > 11: ovirtmgmt: mtu 1500 qdisc > noqueue state UP qlen 1000 > link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff > inet 10.5.40.192/22 brd
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
On Thu, Mar 9, 2017 at 2:24 PM, Marcin Mireckiwrote: > Hello Luca, Hello Marcin, > The osn provider basically only connects the vnics to the osn networks, > items like dhcp must be handled on the osn networks itself. Yes, i know. The network is defined by neutron, which has it's own dhcp server. > Have you tried connecting any nics manually and checking connectivity > between them? What do you mean? > No connectivity with static IP's could hint at some configuration problems. > Are osn/ovs set up correctly? Firewall blocking traffic? there is no firewall between openstack controllers and ovirt engine/hosts. My doubt is about configuration, i've configured in this way: Name: openstack-networks Type: OpenStack Networking Description: Provider URL: http://openstack.example.com:9696 Flagged read-only and requires authentication Set the authentication and tested, reports everything ok. Nothing else has been configured. I didn't found any documentation that clarified if is enough. After powering on i see on openstack this: [stack@opstrio1101 ~]$ openstack port list | grep 00:1a:4a:16:01:51 <-- this is mac address of oVirt VM | 86c46fed-dddf-4776-a765-27d4e52e861c | nic1 | 00:1a:4a:16:01:51 | ip_address='172.25.7.4', subnet_id='280a98ad-0fd5-4961-a307-d1bfea8355cd' | > Can you please send us a more detailed descirption of your env (ip addr, > brctl show, ovs-vsctl show)? This are the output of the commands you asked from a node where a vm that is attached to a neutron network is running: [root@ovirt002 ~]# ip addr 1: lo: mtu 65536 qdisc noqueue state UNKNOWN qlen 1 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: enp2s0f0: mtu 1500 qdisc mq master bond0 state UP qlen 1000 link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff 3: enp2s0f1: mtu 1500 qdisc mq master bond0 state UP qlen 1000 link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff 4: enp2s0f2: mtu 1500 qdisc mq master bond1 state UP qlen 1000 link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff 5: enp2s0f3: mtu 1500 qdisc mq master bond1 state UP qlen 1000 link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff 6: enp2s0f4: mtu 1500 qdisc mq state DOWN qlen 1000 link/ether 00:21:5a:9b:b7:9b brd ff:ff:ff:ff:ff:ff 7: enp2s0f5: mtu 1500 qdisc mq state DOWN qlen 1000 link/ether 00:21:5a:9b:b7:9d brd ff:ff:ff:ff:ff:ff 8: enp2s0f6: mtu 1500 qdisc mq state DOWN qlen 1000 link/ether b4:b5:2f:55:bc:eb brd ff:ff:ff:ff:ff:ff 9: enp2s0f7: mtu 1500 qdisc mq state DOWN qlen 1000 link/ether b4:b5:2f:55:bc:ef brd ff:ff:ff:ff:ff:ff 10: bond0: mtu 1500 qdisc noqueue master ovirtmgmt state UP qlen 1000 link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff 11: ovirtmgmt: mtu 1500 qdisc noqueue state UP qlen 1000 link/ether 00:21:5a:9b:b7:93 brd ff:ff:ff:ff:ff:ff inet 10.5.40.192/22 brd 10.5.43.255 scope global ovirtmgmt valid_lft forever preferred_lft forever inet6 fe80::221:5aff:fe9b:b793/64 scope link valid_lft forever preferred_lft forever 12: bond1: mtu 1500 qdisc noqueue master NFS state UP qlen 1000 link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff 13: NFS: mtu 1500 qdisc noqueue state UP qlen 1000 link/ether 00:21:5a:9b:b7:97 brd ff:ff:ff:ff:ff:ff inet 10.5.160.46/22 brd 10.5.163.255 scope global NFS valid_lft forever preferred_lft forever inet6 fe80::221:5aff:fe9b:b797/64 scope link valid_lft forever preferred_lft forever 14: ;vdsmdummy;: mtu 1500 qdisc noop state DOWN qlen 1000 link/ether be:ae:6d:b7:0f:f5 brd ff:ff:ff:ff:ff:ff 16: qvo86c46fed-dd@qvb86c46fed-dd: mtu 1500 qdisc noqueue state UP qlen 1000 link/ether 5e:d1:06:97:f0:19 brd ff:ff:ff:ff:ff:ff inet6 fe80::5cd1:6ff:fe97:f019/64 scope link valid_lft forever preferred_lft forever 17: qvb86c46fed-dd@qvo86c46fed-dd: mtu 1500 qdisc noqueue state UP qlen 1000 link/ether e6:73:ee:8e:03:09 brd ff:ff:ff:ff:ff:ff inet6 fe80::e473:eeff:fe8e:309/64 scope link valid_lft forever preferred_lft forever 18: qbr86c46fed-dd: mtu 1500 qdisc noop state DOWN qlen 1000 link/ether fe:1a:4a:16:01:51 brd ff:ff:ff:ff:ff:ff 21: tap86c46fed-dd: mtu 1500 qdisc
Re: [ovirt-users] oVirt and Openstack Neutron: network not working
Hello Luca, The osn provider basically only connects the vnics to the osn networks, items like dhcp must be handled on the osn networks itself. Have you tried connecting any nics manually and checking connectivity between them? No connectivity with static IP's could hint at some configuration problems. Are osn/ovs set up correctly? Firewall blocking traffic? Can you please send us a more detailed descirption of your env (ip addr, brctl show, ovs-vsctl show)? Thanks, Marcin ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users