Re: [openstack-dev] PCI pass-through SRIOV
Hi Levi, Thanks for the replay, What I need to ask Intel regarding this controller IntelXL710, whether it is supported for sriov kvm or sriov openstack?? If the query regarding kvm , I tested by creating VF on this controller and attached to virtual instance and boot it manually on top of KVM hypervisor, Now am tested it using openstack. Thanks and Regards, Raghavendrachari kamsali, From: Moshe Levi [mailto:mosh...@mellanox.com] Sent: Tuesday, May 26, 2015 7:54 PM To: Kamsali, RaghavendraChari [ENGINEERING/IN]; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV This is a different error 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] libvirtError: internal error: process exited while connecting to monitor: 2015-05-26T04:34:07.980897Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: vfio: failed to open /dev/vfio/vfio: Operation not permitted 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] 2015-05-26T04:34:07.980951Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: vfio: failed to setup container for group 49 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] 2015-05-26T04:34:07.980970Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: vfio: failed to get group 49 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] 2015-05-26T04:34:07.980995Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: Device initialization failed. 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] 2015-05-26T04:34:07.981019Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: Device 'vfio-pci' could not be initialized You are using intel card therefore I think you should contact them and ask if this card is supported. From: Kamsali, RaghavendraChari (Artesyn) [mailto:raghavendrachari.kams...@artesyn.com] Sent: Tuesday, May 26, 2015 4:49 PM To: Kamsali, RaghavendraChari (Artesyn); Moshe Levi; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV Please find the attachment for the logs when changed in ml2_conf_sriov.ini From: Kamsali, RaghavendraChari (Artesyn) [mailto:raghavendrachari.kams...@artesyn.com] Sent: Tuesday, May 26, 2015 1:36 PM To: Moshe Levi; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: Re: [Openstack] [openstack-dev] PCI pass-through SRIOV Hi, Yes I changed it on what you mentioned in ml2_conf_sriov.ini ,but same issue occurs. Thanks and Regards, Raghavendrachari kamsali, Embedded Computing and Power, Hyderabad, AndhraPradesh , India From: Moshe Levi [mailto:mosh...@mellanox.com] Sent: Tuesday, May 26, 2015 12:58 PM To: Kamsali, RaghavendraChari [ENGINEERING/IN]; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV Hi Kamsali, This is the error: Refusing to bind due to unsupported vnic_type: direct Please add the following to you ml2_conf.ini supported_pci_vendor_devs = 8086:154c Thanks, Moshe Levi From: Kamsali, RaghavendraChari (Artesyn) [mailto:raghavendrachari.kams...@artesyn.com] Sent: Monday, May 25, 2015 2:31 PM To: Moshe Levi; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV FYI, Neutron-server logs, Ml2 config file on compute and controller Nova.conf file From: Moshe Levi [mailto:mosh...@mellanox.com] Sent: Saturday, May 23, 2015 7:53 PM To: OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: Re: [Openstack] [openstack-dev] PCI pass-through SRIOV Hi Kamsali, According to the logs you got binding failed error, which mean neutron failed to bind the port. Can you send the neutron server log and the your neutron ml2 conf file? Thank, Moshe Levi From: Kamsali, RaghavendraChari (Artesyn)mailto:raghavendrachari.kams...@artesyn.com Sent: Saturday, May 23, 2015 6:38 AM To: OpenStack Development Mailing List (not for usage questions)mailto:openstack-dev@lists.openstack.org, openst...@lists.openstack.orgmailto:openst
Re: [openstack-dev] PCI pass-through SRIOV
Hi, Yes I changed it on what you mentioned in ml2_conf_sriov.ini ,but same issue occurs. Thanks and Regards, Raghavendrachari kamsali, Embedded Computing and Power, Hyderabad, AndhraPradesh , India From: Moshe Levi [mailto:mosh...@mellanox.com] Sent: Tuesday, May 26, 2015 12:58 PM To: Kamsali, RaghavendraChari [ENGINEERING/IN]; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV Hi Kamsali, This is the error: Refusing to bind due to unsupported vnic_type: direct Please add the following to you ml2_conf.ini supported_pci_vendor_devs = 8086:154c Thanks, Moshe Levi From: Kamsali, RaghavendraChari (Artesyn) [mailto:raghavendrachari.kams...@artesyn.com] Sent: Monday, May 25, 2015 2:31 PM To: Moshe Levi; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV FYI, Neutron-server logs, Ml2 config file on compute and controller Nova.conf file From: Moshe Levi [mailto:mosh...@mellanox.com] Sent: Saturday, May 23, 2015 7:53 PM To: OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: Re: [Openstack] [openstack-dev] PCI pass-through SRIOV Hi Kamsali, According to the logs you got binding failed error, which mean neutron failed to bind the port. Can you send the neutron server log and the your neutron ml2 conf file? Thank, Moshe Levi From: Kamsali, RaghavendraChari (Artesyn)mailto:raghavendrachari.kams...@artesyn.com Sent: Saturday, May 23, 2015 6:38 AM To: OpenStack Development Mailing List (not for usage questions)mailto:openstack-dev@lists.openstack.org, openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Hi, Am deploying controller-compute openstack setup , in controller I configured openvswitch bridges and in computed node I configured PCI nic supported SRIOV capability and while am spawning VM am getting following error as in attached file: I followed the link for setting up the sriov https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking and http://www.qlogic.com/solutions/Documents/UsersGuide_OpenStack_SR-IOV.pdf Could any one help me regarding this issue Thanks and Regards, Raghavendrachari kamsali, Embedded Computing and Power, Hyderabad, AndhraPradesh , India __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] PCI pass-through SRIOV
This is a different error 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] libvirtError: internal error: process exited while connecting to monitor: 2015-05-26T04:34:07.980897Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: vfio: failed to open /dev/vfio/vfio: Operation not permitted 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] 2015-05-26T04:34:07.980951Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: vfio: failed to setup container for group 49 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] 2015-05-26T04:34:07.980970Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: vfio: failed to get group 49 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] 2015-05-26T04:34:07.980995Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: Device initialization failed. 2015-05-26 13:34:08.081 TRACE nova.compute.manager [instance: 101776a0-cd2e-47b9-bdc4-1097782201c6] 2015-05-26T04:34:07.981019Z qemu-kvm: -device vfio-pci,host=81:02.3,id=hostdev0,bus=pci.0,addr=0x4: Device 'vfio-pci' could not be initialized You are using intel card therefore I think you should contact them and ask if this card is supported. From: Kamsali, RaghavendraChari (Artesyn) [mailto:raghavendrachari.kams...@artesyn.com] Sent: Tuesday, May 26, 2015 4:49 PM To: Kamsali, RaghavendraChari (Artesyn); Moshe Levi; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV Please find the attachment for the logs when changed in ml2_conf_sriov.ini From: Kamsali, RaghavendraChari (Artesyn) [mailto:raghavendrachari.kams...@artesyn.com] Sent: Tuesday, May 26, 2015 1:36 PM To: Moshe Levi; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: Re: [Openstack] [openstack-dev] PCI pass-through SRIOV Hi, Yes I changed it on what you mentioned in ml2_conf_sriov.ini ,but same issue occurs. Thanks and Regards, Raghavendrachari kamsali, Embedded Computing and Power, Hyderabad, AndhraPradesh , India From: Moshe Levi [mailto:mosh...@mellanox.com] Sent: Tuesday, May 26, 2015 12:58 PM To: Kamsali, RaghavendraChari [ENGINEERING/IN]; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV Hi Kamsali, This is the error: Refusing to bind due to unsupported vnic_type: direct Please add the following to you ml2_conf.ini supported_pci_vendor_devs = 8086:154c Thanks, Moshe Levi From: Kamsali, RaghavendraChari (Artesyn) [mailto:raghavendrachari.kams...@artesyn.com] Sent: Monday, May 25, 2015 2:31 PM To: Moshe Levi; OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: RE: [openstack-dev] PCI pass-through SRIOV FYI, Neutron-server logs, Ml2 config file on compute and controller Nova.conf file From: Moshe Levi [mailto:mosh...@mellanox.com] Sent: Saturday, May 23, 2015 7:53 PM To: OpenStack Development Mailing List (not for usage questions); openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Subject: Re: [Openstack] [openstack-dev] PCI pass-through SRIOV Hi Kamsali, According to the logs you got binding failed error, which mean neutron failed to bind the port. Can you send the neutron server log and the your neutron ml2 conf file? Thank, Moshe Levi From: Kamsali, RaghavendraChari (Artesyn)mailto:raghavendrachari.kams...@artesyn.com Sent: Saturday, May 23, 2015 6:38 AM To: OpenStack Development Mailing List (not for usage questions)mailto:openstack-dev@lists.openstack.org, openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Hi, Am deploying controller-compute openstack setup , in controller I configured openvswitch bridges and in computed node I configured PCI nic supported SRIOV capability and while am spawning VM am getting following error as in attached file: I followed the link for setting up the sriov https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking and http://www.qlogic.com/solutions/Documents/UsersGuide_OpenStack_SR-IOV.pdf Could any one help me regarding this issue Thanks and Regards, Raghavendrachari kamsali, Embedded Computing and Power, Hyderabad, AndhraPradesh , India __ OpenStack Development Mailing
[openstack-dev] PCI pass-through SRIOV
Hi, Am deploying controller-compute openstack setup , in controller I configured openvswitch bridges and in computed node I configured PCI nic supported SRIOV capability and while am spawning VM am getting following error as in attached file: I followed the link for setting up the sriov https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking and http://www.qlogic.com/solutions/Documents/UsersGuide_OpenStack_SR-IOV.pdf Could any one help me regarding this issue Thanks and Regards, Raghavendrachari kamsali, Embedded Computing and Power, Hyderabad, AndhraPradesh , India 2015-05-23 21:24:35.061 DEBUG nova.virt.libvirt.vif [-] vif_type=binding_failed instance=Instance(access_ip_v4=Non e,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone=None,cell_name=None,cleaned=False,c onfig_drive='',created_at=2015-05-23T04:23:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=Fals e,deleted_at=None,disable_terminate=False,display_description='ubuntuvm',display_name='ubuntuvm',ephemeral_gb=0,ep hemeral_key_uuid=None,fault=?,host='atca7480',hostname='ubuntuvm',id=6,image_ref='0f945b95-df76-4ef1-9ed0-3d072b ac360f',info_cache=InstanceInfoCache,instance_type_id=5,kernel_id='',key_data=None,key_name=None,launch_index=0,la unched_at=None,launched_on='atca7480',locked=False,locked_by=None,memory_mb=2048,metadata={},node='atca7480',numa_ topology=None,os_type=None,pci_devices=PciDeviceList,power_state=0,progress=0,project_id='51b00a98b1ac471684cad9b1 ee248cc5',ramdisk_id='',reservation_id='r-2r0v9idg',root_device_name='/dev/vda',root_gb=20,scheduled_at=None,secur ity_groups=SecurityGroupList,shutdown_terminate=False,system_metadata={image_base_image_ref='0f945b95-df76-4ef1-9e d0-3d072bac360f',image_container_format='bare',image_disk_format='qcow2',image_min_disk='20',image_min_ram='0',ins tance_type_ephemeral_gb='0',instance_type_flavorid='2',instance_type_id='5',instance_type_memory_mb='2048',instanc e_type_name='m1.small',instance_type_root_gb='20',instance_type_rxtx_factor='1.0',instance_type_swap='0',instance_ type_vcpu_weight=None,instance_type_vcpus='1',network_allocated='True'},task_state='spawning',terminated_at=None,u pdated_at=2015-05-23T04:23:20Z,user_data=None,user_id='e51e176aee744f35bb1e2fb05ecd615f',uuid=39d27b92-295f-4f18-b b76-e0bba4d0666b,vcpus=1,vm_mode=None,vm_state='building') vif=VIF({'profile': {u'pci_slot': u':81:02.3', u'ph ysical_network': u'default', u'pci_vendor_info': u'8086:154c'}, 'ovs_interfaceid': None, 'network': Network({'brid ge': None, 'subnets': [Subnet({'ips': [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], 'ad dress': u'11.0.0.8'})], 'version': 4, 'meta': {'dhcp_server': u'11.0.0.7'}, 'dns': [], 'routes': [], 'cidr': u'11. 0.0.0/24', 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': u'11.0.0.1'})})], 'meta': {'inje cted': False, 'tenant_id': u'51b00a98b1ac471684cad9b1ee248cc5', 'physical_network': u'default'}, 'id': u'5ef1662f- 8bb4-4124-8b68-2a2fe240170e', 'label': u'sriov'}), 'devname': u'tap5281222e-4c', 'vnic_type': u'direct', 'qbh_para ms': None, 'meta': {}, 'details': {}, 'address': u'fa:16:3e:fd:55:1e', 'active': False, 'type': u'binding_failed', 'id': u'5281222e-4c3b-47af-a851-6b0254c0d85a', 'qbg_params': None}) virt_typekvm from (pid=29295) get_config /opt /stack/nova/nova/virt/libvirt/vif.py:342 2015-05-23 21:24:35.063 ERROR nova.compute.manager [-] [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] Instance f ailed to spawn 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] Traceback (mos t recent call last): 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] File /opt/s tack/nova/nova/compute/manager.py, line 2266, in _build_resources 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] yield reso urces 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] File /opt/s tack/nova/nova/compute/manager.py, line 2136, in _build_and_run_instance 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] block_device_info=block_device_info) 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] File /opt/stack/nova/nova/virt/libvirt/driver.py, line 2662, in spawn 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] write_to_disk=True) 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] File /opt/stack/nova/nova/virt/libvirt/driver.py, line 4200, in _get_guest_xml 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance: 39d27b92-295f-4f18-bb76-e0bba4d0666b] context) 2015-05-23 21:24:35.063 TRACE nova.compute.manager [instance:
Re: [openstack-dev] PCI pass-through SRIOV
Hi Kamsali, According to the logs you got binding failed error, which mean neutron failed to bind the port. Can you send the neutron server log and the your neutron ml2 conf file? Thank, Moshe Levi From: Kamsali, RaghavendraChari (Artesyn)mailto:raghavendrachari.kams...@artesyn.com Sent: ?Saturday?, ?May? ?23?, ?2015 ?6?:?38? ?AM To: OpenStack Development Mailing List (not for usage questions)mailto:openstack-dev@lists.openstack.org, openst...@lists.openstack.orgmailto:openst...@lists.openstack.org Hi, Am deploying controller-compute openstack setup , in controller I configured openvswitch bridges and in computed node I configured PCI nic supported SRIOV capability and while am spawning VM am getting following error as in attached file: I followed the link for setting up the sriov https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking and http://www.qlogic.com/solutions/Documents/UsersGuide_OpenStack_SR-IOV.pdf Could any one help me regarding this issue Thanks and Regards, Raghavendrachari kamsali, Embedded Computing and Power, Hyderabad, AndhraPradesh , India __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev