[Yahoo-eng-team] [Bug 1259114] [NEW] tempest.api.compute.v3.servers.test_instance_actions.InstanceActionsV3TestJSON fails

2013-12-09 Thread Daniel Berrange
Public bug reported: Gate check failed on https://review.openstack.org/#/c/59049/ http://logs.openstack.org/49/59049/1/gate/gate-tempest-dsvm-postgres- full/a1934fd/ 2013-12-08 14:30:09.915 | 2013-12-08 14:30:09.915 | ==

[Yahoo-eng-team] [Bug 1261475] [NEW] Nova should disable libguestfs' automatic cleanup

2013-12-16 Thread Daniel Berrange
Public bug reported: By default libguestfs will register an atexit() handler to cleanup any open libguestfs handles when the process exits. Since libguestfs does not provide any mutex locking in its APIs, the atexit handlers are not safe in multi-threaded processes. If they run they are liable to

[Yahoo-eng-team] [Bug 1261827] [NEW] Bare metal virt driver depends libvirt volume driver code

2013-12-17 Thread Daniel Berrange
Public bug reported: The code within each virt driver's directory nova/virt// is considered to be private to that virt driver. The baremetal driver, however, imports and depends on libvirt volume driver code $ grep libvirt volume_driver.py from nova.virt.libvirt import utils as

[Yahoo-eng-team] [Bug 1261826] [NEW] Bare metal virt driver depends libvirt image caching code

2013-12-17 Thread Daniel Berrange
Public bug reported: The code within each virt driver's directory nova/virt// is considered to be private to that virt driver. The baremetal driver, however, imports and depends on libvirt image caching code $ grep imagecache driver.py from nova.virt.libvirt import imagecache

[Yahoo-eng-team] [Bug 1261842] [NEW] Hacking checks should prevent virt drivers accessing each other's code

2013-12-17 Thread Daniel Berrange
Public bug reported: There have been 2 bugs where the bare metal driver is accessing libvirt private code https://bugs.launchpad.net/nova/+bug/1261826 https://bugs.launchpad.net/nova/+bug/1261827 This kind of mistake could be prevented using a custom pep8 hacking rule for Nova. Arguably the

[Yahoo-eng-team] [Bug 1362191] [NEW] Deprecated remove the libvirt volume_drivers config parameter

2014-08-27 Thread Daniel Berrange
Public bug reported: In this thread the topic of deprecating and removing config parameters related to extension points for non-public APIs was discussed. The consensus was that such extension points should not be exposed and that instead people wishing to develop extensions should be doing so on

[Yahoo-eng-team] [Bug 1369537] [NEW] LibvirtConnTestCase.test_create_propagates_exceptions takes 30 seconds to run

2014-09-15 Thread Daniel Berrange
._get_dev_retry_helper() File nova/virt/disk/mount/api.py, line 121, in _get_dev_retry_helper time.sleep(2) ** Affects: nova Importance: High Assignee: Daniel Berrange (berrange) Status: In Progress ** Changed in: nova Status: New = Confirmed ** Changed in: nova

[Yahoo-eng-team] [Bug 1371175] [NEW] Delete the libvirt volume_drivers config parameter

2014-09-18 Thread Daniel Berrange
Public bug reported: A followup from https://bugs.launchpad.net/nova/+bug/1362191 This bug is to track the actual deletion of the volume_drivers config parameter. ** Affects: nova Importance: Low Status: Confirmed ** Changed in: nova Status: New = Confirmed ** Changed

[Yahoo-eng-team] [Bug 1376307] Re: nova compute is crashing with the error TypeError: unsupported operand type(s) for /: 'NoneType' and 'int'

2014-10-02 Thread Daniel Berrange
Libvirt 0.9.8 is no longer a supported version for Juno or later. You must have libvirt = 0.9.11. If you really must stay on such old Ubuntu releases then enable their cloud archive repository which provides newer libvirt + QEMU ** Changed in: nova Status: In Progress = Won't Fix -- You

[Yahoo-eng-team] [Bug 1376651] [NEW] Enforce the minimum required libvirt in nova

2014-10-02 Thread Daniel Berrange
Public bug reported: In a number of cases now users are reporting bugs for features that don't work in Nova with versions of libvirt that are older than the minimum supported version. Most recently in Juno libvirt 0.9.11 is required but user reported bugs about a problem in 0.9.8

[Yahoo-eng-team] [Bug 1327212] [NEW] Instances cannot be booted using name of a non-public, but accessible, flavor

2014-06-06 Thread Daniel Berrange
Public bug reported: Setup credentials to allow access to Nova as an administrator account [root@localhost ] # . keystonerc_admin [root@localhost ~(keystone_admin)]# Now create a new flavor but mark it as non-public [root@localhost ~(keystone_admin)] # nova flavor-create --is-public False

[Yahoo-eng-team] [Bug 1327212] Re: Instances cannot be booted using name of a non-public, but accessible, flavor

2014-06-06 Thread Daniel Berrange
The problem turns out to be on the client side. In novaclient/v1_1/flavors.py the FlavorManager.list method defaults to is_public=True, which means that it will only ever resolve flavours which are marked public, even if the user has permission to access non- public flavours. If we change this

[Yahoo-eng-team] [Bug 1333219] [NEW] Virt driver impls don't match ComputeDriver base class API

2014-06-23 Thread Daniel Berrange
Assignee: Daniel Berrange (berrange) Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1333219 Title: Virt driver impls don't match ComputeDriver base

[Yahoo-eng-team] [Bug 1334151] [NEW] tempest.api.compute.servers.test_server_actions.ServerActionsTestXML.test_create_backup

2014-06-25 Thread Daniel Berrange
Public bug reported: http://logs.openstack.org/76/101876/1/gate/gate-tempest-dsvm- full/1543d84/ https://review.openstack.org/#/c/101876/ 2014-06-24 22:40:12.195 | == 2014-06-24 22:40:12.196 | Failed 1 tests - output below: 2014-06-24 22:40:12.196 |

[Yahoo-eng-team] [Bug 1334208] [NEW] tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name

2014-06-25 Thread Daniel Berrange
Public bug reported: http://logs.openstack.org/76/101876/1/check/check-tempest-dsvm- full/4d54979/console.html https://review.openstack.org/#/c/101876/ 2014-06-25 08:46:20.228 | == 2014-06-25 08:46:20.228 | Failed 1 tests - output below: 2014-06-25 08:46:20.228 |

[Yahoo-eng-team] [Bug 1334222] [NEW] Multiple nova network floating IP tests failed

2014-06-25 Thread Daniel Berrange
Public bug reported: http://logs.openstack.org/23/95723/8/gate/gate-nova- python26/6856934/console.html https://review.openstack.org/#/c/95723/ 2014-06-23 20:02:02.020 | Traceback (most recent call last): 2014-06-23 20:02:02.021 | File nova/tests/api/ec2/test_cloud.py, line 350, in

[Yahoo-eng-team] [Bug 1334247] [NEW] tempest.scenario.test_snapshot_pattern.TestSnapshotPattern.test_snapshot_pattern

2014-06-25 Thread Daniel Berrange
Public bug reported: http://logs.openstack.org/23/95723/8/check/check-tempest-dsvm-postgres- full/e1494ef/console.html https://review.openstack.org/#/c/95723/ 2014-06-25 11:28:22.947 | == 2014-06-25 11:28:22.947 | Failed 1 tests - output below: 2014-06-25

[Yahoo-eng-team] [Bug 1336417] [NEW] tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestXML.test_check_nova_notification

2014-07-01 Thread Daniel Berrange
Public bug reported: http://logs.openstack.org/83/101883/3/check/check-tempest-dsvm-postgres- full/4effbe3/ 2014-07-01 16:22:41.275 | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestXML.test_check_nova_notification[gate] 2014-07-01 16:22:41.275 |

[Yahoo-eng-team] [Bug 1323578] Re: randmly failing rebuild on ssh-key errors on a setup which is configured for non-migration resize

2014-07-08 Thread Daniel Berrange
Proposing a blueprint/nova-specs is only appropriate if the submitter actually intends to provide a solution. We're not wanting nova-specs for arbitrary user reported wish-list items. For user wish list items like this, they should be status: confirmed/triaged, importance: wishlist ** Changed

[Yahoo-eng-team] [Bug 1346191] [NEW] libvirt _live_snapshot _swap_volume functions re-define guest with wrong XML document

2014-07-21 Thread Daniel Berrange
Public bug reported: In the nova/virt/libvirt/driver.py file, the '_live_snapshot' and '_swap_volume' methods have the following code flow xml = dom.XMLDesc(0) dom.undefine() dom.blockRebase() dom.defineXML(xml) The reason for this is that 'blockRebase' requires the guest to be

[Yahoo-eng-team] [Bug 1346327] [NEW] libvirt swap_volume and live_snapshot methods have no unit tests

2014-07-21 Thread Daniel Berrange
Public bug reported: Neither the swap_volume or live_snapshot methods in the libvirt driver have any corresponding coverage in the test_driver.py unit test suite. ** Affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of

[Yahoo-eng-team] [Bug 1348623] [NEW] XenAPI and Baremetal drivers use bogus hypervisor type for supported instances

2014-07-25 Thread Daniel Berrange
Public bug reported: The XenAPI driver reports a hypervisor type of 'xapi' for supported instances. This is confusing the hypervisor type, which should be 'xen', with the management API type which is 'xapi'. The Baremetal driver reports a hypervisor type of 'baremetal' for supported instances.

[Yahoo-eng-team] [Bug 1350287] [NEW] Many tests fail when run with random hash seed value

2014-07-30 Thread Daniel Berrange
Public bug reported: When runing the test suite with a random hash seed, eg PYTHONHASHSEED=666 ./run_tests.sh many tests will fail as iterators over hash keys/values change their ordering. For example there are many failures in libvirt like

[Yahoo-eng-team] [Bug 1304107] Re: Libvirt error launching instance - Device 'virtio-net-pci' could not be initialized

2014-04-08 Thread Daniel Berrange
Ok that log is interesting as it shows that Ubuntu have re-named the QEMU machine types ... -machine trusty,accel=tcg,usb=off ... See 'trusty' is the machine type there instead of the more usual pc- i440fx-1.6 This unfortunately breaks the ability of libvirt to figure out what type of base

[Yahoo-eng-team] [Bug 1386162] [NEW] Nova libvirt driver does not bind emulator threads to host CPUs

2014-10-27 Thread Daniel Berrange
are pinned to the union of host CPUs that all vCPUs are pinned to. ** Affects: nova Importance: Medium Assignee: Daniel Berrange (berrange) Status: In Progress ** Changed in: nova Assignee: (unassigned) = Daniel Berrange (berrange) ** Changed in: nova Importance

[Yahoo-eng-team] [Bug 1313477] Re: libvirt driver hang with genisoimage when boot new instance

2014-11-13 Thread Daniel Berrange
Marked this as wontfix, because this is not a problem we can resolve in Nova codebase. The fix either has to be in upstream Python runtime, or in a workaround in libguestfs (available in current libguestfs releases) ** Changed in: nova Status: Confirmed = Won't Fix -- You received this

[Yahoo-eng-team] [Bug 1312133] Re: Cannot launch VMs with KVM since Icehouse upgrade

2014-11-19 Thread Daniel Berrange
Since I upgraded my deployment from Havana to Icehouse, I can no longer launch VMs when the hypervisor is KVM. However, with QEMU it works perfectly. I can see the qemu-system-x86_64 process taking up 100% CPU. I can't find any relevant logs to further understand what's happening. These are

[Yahoo-eng-team] [Bug 1272447] Re: Instances fail to boot properly with more than 5 cinder volumes attached

2014-11-19 Thread Daniel Berrange
Marking as Invalid since there's been no response from reporter in 6 months and others confirmed it works for them. ** Changed in: nova Status: Incomplete = Invalid ** Changed in: cinder Status: Incomplete = Opinion ** Changed in: cinder Status: Opinion = Invalid -- You

[Yahoo-eng-team] [Bug 1400315] [NEW] Add hyper-v timer enlightenments for windows guests

2014-12-08 Thread Daniel Berrange
Public bug reported: Back in Folsom we added some special timer settings to improve the reliability of guest time keeping and performance https://bugs.launchpad.net/nova/+bug/1011848 These were useful for both Windows and Linux guests, but since that time, KVM has gained support for a number

[Yahoo-eng-team] [Bug 1401647] Re: Huge pages: Compute driver fails to set appropriate page size when using flavor extra spec -- 'hw:mem_page_size=any'

2014-12-12 Thread Daniel Berrange
Indeed, it is not appropriate to post bug reports for code which is not even merged yet. Put your feedback in gerrit if you have found problems with the proposed code. ** Changed in: nova Status: Confirmed = Invalid -- You received this bug notification because you are a member of

[Yahoo-eng-team] [Bug 1403051] [NEW] periodic task runs during nova.tests.unit.compute.test_compute unit test

2014-12-16 Thread Daniel Berrange
Public bug reported: While running the nova.tests.unit.compute.test_compute unit test, I noticed that it throws a lot of exceptions, which don't actually cause the test suite to report failure. It appears that these are caused by some periodic background task being executed. Such tasks should be

[Yahoo-eng-team] [Bug 1404196] [NEW] many codepaths do not pass image_meta to libvirt blockinfo APIs

2014-12-19 Thread Daniel Berrange
all callers are forced to pass it, which should reduce the scale of the problem ** Affects: nova Importance: Medium Assignee: Daniel Berrange (berrange) Status: Confirmed ** Tags: libvirt ** Tags added: libvirt ** Changed in: nova Assignee: (unassigned) = Daniel Berrange

[Yahoo-eng-team] [Bug 1412742] [NEW] tests randomly hang in oslo.messaging fake driver

2015-01-20 Thread Daniel Berrange
Public bug reported: The following change has been getting random failures in the py27 test job where it would time out after 50 minutes. https://review.openstack.org/#/c/140725/ eg this test run: http://logs.openstack.org/25/140725/11/gate/gate-nova-python27/0dabb50/ Strangely other stuff

[Yahoo-eng-team] [Bug 1432905] Re: Launching an instance fails when using a port with vnic_type=direct

2015-03-18 Thread Daniel Berrange
Upstream code uses 'numa_node': fields.IntegerField(nullable=True), So this extra_info['numa_node'] must be a RHEL specific fork, so closing this as invalid. ** Changed in: nova Status: New = Invalid -- You received this bug notification because you are a member of Yahoo!

[Yahoo-eng-team] [Bug 1429220] [NEW] libvirt does ensure live migration will eventually complete (or abort)

2015-03-06 Thread Daniel Berrange
: High Assignee: Daniel Berrange (berrange) Status: In Progress ** Changed in: nova Importance: Undecided = High ** Changed in: nova Assignee: (unassigned) = Daniel Berrange (berrange) ** Changed in: nova Status: New = Confirmed -- You received this bug notification

[Yahoo-eng-team] [Bug 1414065] [NEW] Nova can loose track of running VM if live migration raises an exception

2015-01-23 Thread Daniel Berrange
Public bug reported: There is a fairly serious bug in VM state handling during live migration, with a result that if libvirt raises an error *after* the VM has successfully live migrated to the target host, Nova can end up thinking the VM is shutoff everywhere, despite it still being active. The

[Yahoo-eng-team] [Bug 1447079] [NEW] Libvirt KVM: Huge pages need to be mapped shared to allow vhostuser access

2015-04-22 Thread Daniel Berrange
Public bug reported: By default, when a KVM guest is setup using huge pages, the pages are mapped using the MAP_PRIVATE flag to mmap(). The vhostuser VIF backend is designed to allow an external process to provide the QEMU network driver functionality. For some usecases of vhostuser, this

[Yahoo-eng-team] [Bug 1459760] [NEW] Incorrect dropping of image meta properties not wanted for snapshotting

2015-05-28 Thread Daniel Berrange
Public bug reported: Back in July 20, there was a 'non_inheritable_image_properties' flag added which filtered out a couple of image metadata properties when the XenAPI driver uploaded images to glance. commit ae7adbb92babf2dfc928daa76474aaba8e325d9c Author: Rick Harris rconradhar...@gmail.com

[Yahoo-eng-team] [Bug 1460079] [NEW] Instance system metadata is sometimes overwritten by image metadata

2015-05-29 Thread Daniel Berrange
Public bug reported: When an instance is first created, a copy of the metadata from the image/volume is saved into the instance system metadata. This provides an accurate point in time record of the metadata used to configure operate instance, even if the metadata on the image is later changed.

[Yahoo-eng-team] [Bug 1471187] [NEW] CPU topology does not honour cpu_max_threads when NUMA topology is used

2015-07-03 Thread Daniel Berrange
Public bug reported: Consider a flavour with 4 vcpus, and image property hw:cpu_threads==2. Now the NUMA topology may prefer a thread count of 4, but best of the thread preference set, the guest will end up with 2 sockets, 1 core and 2 threads. Now consider a flavour with 4 vcpus, and image

[Yahoo-eng-team] [Bug 1484992] [NEW] Converting image from qcow2 to raw is slow for images with large virtual size

2015-08-14 Thread Daniel Berrange
Public bug reported: In this thread: http://lists.openstack.org/pipermail/openstack/2015-August/013614.html [qote] Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf qemu-img convert -O raw /var/lib/nova/instances/_base/999f7fff2521e4a7243c9e1d21599fd64a19b42e

[Yahoo-eng-team] [Bug 1510328] [NEW] Nova pre-allocation of qcow2 is flawed

2015-10-26 Thread Daniel Berrange
Public bug reported: The nova/virt/libvirt/imagebackend.py file contains code for pre- allocating image files, so that sufficient space is guaranteed available for the VM's full disk size. As well as preventing accidental out-of- space conditions, this is important for maximising performance. It

[Yahoo-eng-team] [Bug 1506012] [NEW] Gate tests randomly failing qemu-img info calls

2015-10-14 Thread Daniel Berrange
Public bug reported: Since yesterday we see a spike in qemu-img info calls failing:

[Yahoo-eng-team] [Bug 1321785] Re: RFE: block_device_info dict should have a password key rather than clear password

2016-03-04 Thread Daniel Berrange
ged in the immediate known locations, but this could continue to crop up so we should change the design such that the block_device_info dict doesn't contain the password but rather a key to a store that nova can retrieve the password for use. Comment from Daniel Berrange in the patch ab

[Yahoo-eng-team] [Bug 1331537] Re: nova service-list shows nova-compute as down and is required to be restarted frequently in order to provision new vms

2016-04-05 Thread Daniel Berrange
** Changed in: nova Status: Won't Fix => New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1331537 Title: nova service-list shows nova-compute as down and is

[Yahoo-eng-team] [Bug 1578150] Re: hw:cpu_thread_policy=isolated allows allocation of siblings

2016-05-06 Thread Daniel Berrange
> If we boot a VM with one vCPU with m1.tiny flavor, it will be allowed: > > nova boot test --flavor 1 --image cirros --nic net-id=$NET_ID This is invalid test scenario. When using strict CPU pinning, you are *required* to setup host-aggregates to split your compute hosts into 2 groups. One

[Yahoo-eng-team] [Bug 1528349] Re: Nova and Glance contain a near-identical signature_utils module

2016-07-14 Thread Daniel Berrange
This isn't a bug - its a feature request to switch to using a new library from Nova. I'm fine with that as a suggestion, but it should be file as a blueprint - probably can be a specless blueprint. ** Changed in: nova Status: Confirmed => Invalid -- You received this bug notification

[Yahoo-eng-team] [Bug 1612281] Re: Neutron Linuxbridge jobs failing with 'operation failed: failed to read XML'

2016-08-11 Thread Daniel Berrange
Fixed in Nova by https://review.openstack.org/#/c/354143/ ** Changed in: nova Importance: Undecided => Critical ** Changed in: nova Status: New => Fix Committed ** Changed in: neutron Status: New => Invalid ** Changed in: os-vif Status: New => Invalid -- You received

[Yahoo-eng-team] [Bug 1612953] Re: fail to boot instance with port of specfic subnet (regression)

2016-08-15 Thread Daniel Berrange
*** This bug is a duplicate of bug 1612812 *** https://bugs.launchpad.net/bugs/1612812 ** This bug has been marked a duplicate of bug 1612812 OS-VIF: Interface missing from Route Object. (OVS) -- You received this bug notification because you are a member of Yahoo! Engineering Team,

[Yahoo-eng-team] [Bug 1601994] Re: instances always packed to NUMA node 0

2016-07-18 Thread Daniel Berrange
Nova fully fills each node before considering placing a guest on the next node. This isn't a bug - its expected behaviour intended to maximise number of guests that can be packed onto each compute host. If you want to suggest alternative strategies please submit a blueprint + spec with the

[Yahoo-eng-team] [Bug 1601994] Re: instances always packed to NUMA node 0

2016-07-19 Thread Daniel Berrange
** Changed in: nova Status: Invalid => Confirmed -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1601994 Title: instances always packed to NUMA node 0 Status in

[Yahoo-eng-team] [Bug 1616782] Re: driver_discard='unmap' is written without considering the configuration

2016-09-05 Thread Daniel Berrange
This is not a bug - there are two completely independent settings here - nova.conf hw_disk_discard is applicable to compute node local ephemeral storage - cinder 'discard' property is applicable to cinder volume storage Using hw_disk_discard when configuring cinder volumes is not

[Yahoo-eng-team] [Bug 1428551] Re: creating vm may fails with large page vm and ordinary vm on the same numa node

2016-09-28 Thread Daniel Berrange
Mixing guests with huge pages and non-huge pages on the same host opens up a huge can of worms, adding complexity to nova, and resulting in a much unreliable system overall. With our current requirement that guests using huge pages must run on hosts dedicated to the use of huge pages, we can setup

[Yahoo-eng-team] [Bug 1638889] [NEW] Libvirt get_available_resource is reporting incorrect vcpus_used data for QEMU/LXC instances

2016-11-03 Thread Daniel Berrange
by this libvirt bug - it merely causes mis-leading log messages to be emitted. None the less we should fix the libvirt reporting so that it is possible to have resource tracker honour this data in the future. ** Affects: nova Importance: Undecided Assignee: Daniel Berrange (berrange

[Yahoo-eng-team] [Bug 1639221] [NEW] 'CryptsetupEncryptor' will silently enable corrupt data read if cryptsetup defaults change

2016-11-04 Thread Daniel Berrange
Public bug reported: The CryptsetupEncryptor impl for volume encryption uses the cryptsetup 'plain' mode for encrypting the volumes. When opening a volume it treats cipher and key_size as optional parameters: cipher = kwargs.get("cipher", None) if cipher is not None:

[Yahoo-eng-team] [Bug 1639293] [NEW] Cinder encrypted vol connection info include full nova internal class name

2016-11-04 Thread Daniel Berrange
Public bug reported: When making an API call to Cinder to get the volume encryption metadata: 2016-10-25 05:30:47.048 6699 DEBUG cinderclient.v2.client [req-7fe1959f- 36f6-4dd6-bf47-f5e550d59530 3fdb4fc839fc44a9a99006d3fb75ac4d c6b14fd5fffa48aa8eb869f30c80e409 - - -] REQ: curl -g -i -X GET

[Yahoo-eng-team] [Bug 1771773] Re: Ssl2/3 should not be used for secure VNC access

2018-08-10 Thread Daniel Berrange
Sorry, I didn't mean to suggest we should abandon the change/bug, as not all distros have crypto policy support systemwide. Rather, that we should 1. make sure the out of the box behaviour is to honour openssl defaults 2. provide a nova.conf setting for the protocol version, which allows an

[Yahoo-eng-team] [Bug 1753558] [NEW] NoCloud data source is mis-using the "system-serial-number" SMBIOS field, should use "OEM Strings" instead

2018-03-05 Thread Daniel Berrange
Public bug reported: As the name suggests, the "system-serial-number" field in SMBIOS is intended for exposing a serial number identifying the hardware, to the operating system. The NoCloud data source is mis-using this field for receiving metadata for initializing cloud-init. Admittedly there