[Yahoo-eng-team] [Bug 1847999] [NEW] vmware virt driver's report of VCPU can be inaccurate in some cases

2019-10-14 Thread Chris Dent
attributes: numCpuThreads, cpuMhz, and numCpuCores. Probably with some "what features are turned on" magic for extra accuracy. The correct math is being researched, I'll hang it on this bug when it is figured out. ** Affects: nova Importance: Low Assignee: Chris Dent (cdent) Status:

[Yahoo-eng-team] [Bug 1837995] Re: "Unexpected API Error" when use "openstack usage show" command

2019-08-02 Thread Chris Dent
** Changed in: nova Status: Incomplete => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1837995 Title: "Unexpected API Error" when use "openstack usage

[Yahoo-eng-team] [Bug 1829472] Re: [placement] install and configure controller node in nova (STEIN)

2019-05-17 Thread Chris Dent
The [placement] section is still necessary for nova.conf to configure how nova talks to the placement service. As it says in there you are configuring "access to the Placement service". So I'm pretty sure this is not a bug, and will mark it as such. However, if I've missed your point, please

[Yahoo-eng-team] [Bug 1782690] Re: Consider forbidden traits in early exit of AllocationCandidates

2019-04-12 Thread Chris Dent
** Changed in: nova Status: In Progress => Won't Fix -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1782690 Title: Consider forbidden traits in early exit of

[Yahoo-eng-team] [Bug 1771325] Re: placement trait and inventory handler use nonstandard HTTP error message details

2019-04-04 Thread Chris Dent
** Changed in: nova/pike Status: Fix Committed => Fix Released ** Changed in: nova Status: Confirmed => Fix Committed -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova).

[Yahoo-eng-team] [Bug 1778591] Re: GET /allocations/{uuid} on a consumer with no allocations provides no generation

2019-04-04 Thread Chris Dent
Since there's been a lot of churn since this conversation started, and because we're over on storyboard now, and other issues have taken greater priority, I'm going to mark this as a wontfix. Not because we won't fix the conceptual situation, but that the concept isn't really caught by the bug.

[Yahoo-eng-team] [Bug 1823043] [NEW] Docs insufficiently clear on the intersection of availalability zones, force, and cold and live migrations

2019-04-03 Thread Chris Dent
Public bug reported: It's hard to find a single place in the nova docs where the impact of availability zones (including default) on the capabilities of live or cold migrations is clear In https://docs.openstack.org/nova/latest/user/aggregates.html #availability-zones-azs is probably a good

[Yahoo-eng-team] [Bug 1821737] [NEW] simple_cell_setup reports "exiting" when it is not

2019-03-26 Thread Chris Dent
Public bug reported: When running 'nova-manage simple_cell_setup ...' if hosts are already the _map_cell_and_hosts method prints a message of 'All hosts are already mapped to cell(s), exiting.' and then proceeds to map instances. It does not, in fact, exit. This isn't the end of the world, but

[Yahoo-eng-team] [Bug 1696830] Re: nova-placement-api default config files is too strict

2019-03-11 Thread Chris Dent
After speaking with coreycb we're going to drop nova/placement from this as it no longer quite fits and the existing snap related bugs are sufficient to provide an aide-mémoire. ** Changed in: nova Status: In Progress => Won't Fix -- You received this bug notification because you are a

[Yahoo-eng-team] [Bug 1818560] [NEW] Nova's use of the placement database fixture from test_report_client doesn't register opts

2019-03-04 Thread Chris Dent
Public bug reported: See: http://logs.openstack.org/98/538498/22/gate/nova-tox-functional- py35/7673d3e/testr_results.html.gz The failing tests there are failing because the Database fixture from placement is used directly, and configuration opts are not being registered properly. This was an

[Yahoo-eng-team] [Bug 1792503] Re: allocation candidates "?member_of=" doesn't work with nested providers

2019-03-04 Thread Chris Dent
** Changed in: nova/rocky Status: In Progress => Won't Fix ** Changed in: nova Status: In Progress => Fix Committed -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova).

[Yahoo-eng-team] [Bug 1809401] Re: os-resource-classes: Could not satisfy constraints for 'os-resource-classes': installation from path or url cannot be constrained to a version

2019-03-04 Thread Chris Dent
** Changed in: nova Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1809401 Title: os-resource-classes: Could not satisfy

[Yahoo-eng-team] [Bug 1818498] [NEW] Placement aggregate creation continues to be unstable under very high load

2019-03-04 Thread Chris Dent
Public bug reported: See: http://logs.openstack.org/89/639889/3/check/placement- perfload/e56f0a0/logs/placement-api.log (or any other recent perfload run) where there are multiple errors when trying to create aggregates. Various bits of work have been done to try to fix that up, but apparently

[Yahoo-eng-team] [Bug 1817633] [NEW] Listing placement usages causes a circular reference error

2019-02-25 Thread Chris Dent
/607508/14/check/placement-gabbi- tempest/f7c3eca/controller/logs/screen-placement- api.txt.gz#_Feb_25_22_37_31_423135 for an example. This can be fixed by casting the 'used' value to an int when creating a Usage. ** Affects: nova Importance: High Assignee: Chris Dent (cdent

[Yahoo-eng-team] [Bug 1816230] [NEW] allocations by consumer and resource provider use wrong timestamp

2019-02-16 Thread Chris Dent
Public bug reported: When listing allocations by resource provider or consumer uuid, the updated_at and created_at fields in the database are not loaded into the object, so default to now when their times are used to generate last- modified headers in http responses. This isn't a huge problem

[Yahoo-eng-team] [Bug 1807976] [NEW] In python 3.7 the definition of a printable character is changed so test_flavors fails

2018-12-11 Thread Chris Dent
Public bug reported: 'test_name_with_non_printable_characters' in the 'test_flavors' unit tests checks to see that a non-printable character cannot be allowed in a flavor name. This fails in python 3.7. The reason it fails is because in Python 3.7 the 'unicodedata' package was updated [1] to

[Yahoo-eng-team] [Bug 1807970] [NEW] test_multi_cell_list fails in python 3.7

2018-12-11 Thread Chris Dent
Public bug reported: Generators used in multi cell list handling raise StopIteration, which is not something python 3.7 likes. Efforts to add python 3.7 testing to nova [1] revealed this (and similar for neighboring tests):

[Yahoo-eng-team] [Bug 1805858] [NEW] placement/objects/resource_provider.py missing test coverage for several methods

2018-11-29 Thread Chris Dent
Public bug reported: In the extracted placement, the coverage tests run both unit and functional tests. This is because so much of the functionality is tested by gabbi. In those runs we can see that a few methods in placement/objects/resource_provider.py are not reached. They are: def

[Yahoo-eng-team] [Bug 1805408] [NEW] ServerGroupTestV21.test_boot_servers_with_anti_affinity and related tests can race

2018-11-27 Thread Chris Dent
Public bug reported: The ServerGroup functional tests do not adequately manage the _SUPPORTS* globals used at https://github.com/openstack/nova/blob/1a1ea8e2aa66a2654e6cc141c735e47bbd8c4fef/nova/scheduler/utils.py#L805 leading to tests that come sometimes fail. The easy fix is to reset the

[Yahoo-eng-team] [Bug 1804453] [NEW] maximum recursion possible while setting aggregates in placement

2018-11-21 Thread Chris Dent
Public bug reported: It's possible for the _ensure_aggregate code in objects/resource_provider.py to, under unusual circumstances, reach a maximum recursion error, because it calls itself when there is a DBDuplicateEntry error. http://logs.openstack.org/84/602484/30/check/placement-

[Yahoo-eng-team] [Bug 1804062] [NEW] test_hacking fails for python 3.6.7 and newer

2018-11-19 Thread Chris Dent
Public bug reported: The check for double words in test_hacking is failing in python 3.6.7 (released in ubuntu 18.04 within the last few days) and in new versions of 3.7.x. This is is because of this change to python: https://bugs.python.org/issue33899 . This is causing failures in python 36

[Yahoo-eng-team] [Bug 1802925] [NEW] Unable to start placement wsgi app without conf file

2018-11-12 Thread Chris Dent
Public bug reported: oslo_config allows configuration to come from the process environment (e.g., OS_PLACEMENT_DATABASE__CONNECTION). This was developed to allow services that use oslo_config to hosted within immutable containers. However, as currently written, the placement-wsgi app (in both

[Yahoo-eng-team] [Bug 1800124] [NEW] internal NotFound error can lead to 500 error in modern devstack setup

2018-10-26 Thread Chris Dent
Public bug reported: I'm using a recent devstack in late October 2018, no special keystone configuration, it is running under uwsgi and apache2. If I make a request of the service to a bogus URL: curl -v http://localhost/identity/v3/narf > GET /identity/v3/narf HTTP/1.1 > Host: localhost

[Yahoo-eng-team] [Bug 1778227] Re: Docs needed for optional placement database

2018-10-04 Thread Chris Dent
This is differently out of date now that we have an extracted placement. ** Changed in: nova Status: In Progress => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova).

[Yahoo-eng-team] [Bug 1795502] [NEW] running nova-api-wsgi from the command line fails in python3.6

2018-10-01 Thread Chris Dent
Public bug reported: The nova-api-wsgi script provides a quick and easy way to run the nova- api from the command line. In at least python3.6 it fails with: ERROR nova Traceback (most recent call last): ERROR nova File "/usr/local/bin/nova-api-wsgi", line 50, in ERROR nova

[Yahoo-eng-team] [Bug 1795425] [NEW] create server api sends location header as bytestring in py3

2018-10-01 Thread Chris Dent
catenating the response header with other values, such as base URLs. ** Affects: nova Importance: Undecided Assignee: Chris Dent (cdent) Status: In Progress ** Tags: api -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is

[Yahoo-eng-team] [Bug 1789633] [NEW] placement aggregate handling has lock trouble with sqlite files

2018-08-29 Thread Chris Dent
Public bug reported: Not sure if this is in itself a bug, but instead indicates that there are issues with aggregate handling that may show up in the real world under some conditions. The placecat tooling at https://github.com/cdent/placecat has a suite of automated tests that run every now and

[Yahoo-eng-team] [Bug 1788176] [NEW] placement functional tests can variably fail because of conf

2018-08-21 Thread Chris Dent
long term global conf leakage that we may wish to consider fixing, but the short term fix is to register the opts in the gabbi fixture. Patch forthcoming. ** Affects: nova Importance: Medium Assignee: Chris Dent (cdent) Status: In Progress ** Tags: placement testing -- You receive

[Yahoo-eng-team] [Bug 1786703] [NEW] Placement duplicate aggregate uuid handling during concurrent aggregate create insufficiently robust

2018-08-12 Thread Chris Dent
Public bug reported: NOTE: This may be just a postgresql problem, not sure. When doing some further experiments with load testing placement, my resource provider create script, which uses asyncio was able to cause several 500 errors from the placement service of the following form: ```

[Yahoo-eng-team] [Bug 1786519] [NEW] debugging why NoValidHost with placement challenging

2018-08-10 Thread Chris Dent
Public bug reported: With the advent of placement, the FilterScheduler no longer provides granular information about which class of resource (disk, VCPU, RAM) is not available in sufficient quantities to allow a host to be found. This is because placement is now making those choices and does not

[Yahoo-eng-team] [Bug 1786498] [NEW] placement api produces many warnings about policy scope check failures

2018-08-10 Thread Chris Dent
Public bug reported: When oslo policy checks were added to placement, fixtures and functional tests were updated to hide warnings related to scope checks that cannot (yet) work in the way placement is managing policy. Those some warnings happen with every request on an actually running service.

[Yahoo-eng-team] [Bug 1786055] [NEW] performance degradation in placement with large number of resource providers

2018-08-08 Thread Chris Dent
Public bug reported: Using today's master, there is a big performance degradation in GET /allocation_candidates when there is a large number of resource providers (in my tests 1000, each with the same inventory as described in [1]). 17s when querying all three resource classes with

[Yahoo-eng-team] [Bug 1784664] [NEW] cors.set_defaults does not have real test coverage in placement and probably not nova either

2018-07-31 Thread Chris Dent
Public bug reported: Both the placement and nova apis allow oslo_middleware.cors in their WSGI middleware stacks. Placement has some gabbi functional tests which test that the middleware is present and does the right thing when using the middleware's own configuration defaults. Both when it is

[Yahoo-eng-team] [Bug 1784663] [NEW] cors.set_defaults does not have real test coverage in placement and probably not nova either

2018-07-31 Thread Chris Dent
Public bug reported: Both the placement and nova apis allow oslo_middleware.cors in their WSGI middleware stacks. Placement has some gabbi functional tests which test that the middleware is present and does the right thing when using the middleware's own configuration defaults. Both when it is

[Yahoo-eng-team] [Bug 1784577] [NEW] Some allocation candidate tests for sharing providers fail in python 3.6 (and work in python 3.5)

2018-07-31 Thread Chris Dent
Public bug reported: When running the nova functional tests under python 3.6 the nova.tests.functional.api.openstack.placement.db.test_allocation_candidates.AllocationCandidatesTestCase.test_all_sharing_providers.* tests (there are 3) all fail because incorrect results are produced on the call to

[Yahoo-eng-team] [Bug 1736101] Re: nova placement resource_providers DBDuplicateEntry when moving host between cells

2018-07-25 Thread Chris Dent
While the behavior on this is as described: you can't move a resource provider between cells, that's how things are designed. You no longer get the DB error, instead the 409 happens. So I think this is invalid, working as designed. That the design is imperfect is a different problem... **

[Yahoo-eng-team] [Bug 1783130] [NEW] placement reshaper doesn't clearing all inventories for a resource provider

2018-07-23 Thread Chris Dent
Public bug reported: The /reshaper API is willing to accept an empty dictionary for the inventories attribute of a resource provider. This is intended to mean "clear all the inventory". However, the backend transformer code is not prepared to handle this: File

[Yahoo-eng-team] [Bug 1782340] [NEW] allocation schema does not set additionalProperties False in all the right places

2018-07-18 Thread Chris Dent
Public bug reported: In microversion 1.12 of placement, a schema for allocations was introduced that required the allocations, project_id and user_id fields. This schema is used for subsequent microversions, copied and manipulated as required. However, it has a flaw. It does not set

[Yahoo-eng-team] [Bug 1731072] Re: AllocationCandidates.get_by_filters returns garbage with multiple aggregates

2018-07-06 Thread Chris Dent
As the main issue here has been sort of addressed and there are many related other issues, it's better to close this and deal with the more granular issues as they come up. ** Changed in: nova Status: Confirmed => Fix Released -- You received this bug notification because you are a

[Yahoo-eng-team] [Bug 1765376] Re: nova scheduler log contains html

2018-07-06 Thread Chris Dent
Marking as fix released. If it becomes an issue we can consider backporting it. ** Changed in: nova Status: Confirmed => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova).

[Yahoo-eng-team] [Bug 1683858] Re: Allocation records do not contain overhead information

2018-06-27 Thread Chris Dent
Gonna kills this one. We seem to have reached the consensus that overhead that an operator may manage however they like, it is not something we will generically manage. In the future it might make sense for the virt drivers to handle overhead via resereved when they are working with

[Yahoo-eng-team] [Bug 1708958] Re: disabling a compute service does not disable the resource provider

2018-06-27 Thread Chris Dent
** Changed in: nova Status: Confirmed => Won't Fix -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1708958 Title: disabling a compute service does not disable the

[Yahoo-eng-team] [Bug 1778743] [NEW] When POSTing to /allocations with multiple consumers it is possible violate inventory capacity constraints

2018-06-26 Thread Chris Dent
Public bug reported: This is using microversion 1.28 of the placement API. I will start the process of finding when this went wrong after submitting this bug. I'm guessing at the start of POST to /allocations, but we'll see. When a POST to /allocations contains multiple consumers each writing

[Yahoo-eng-team] [Bug 1778591] [NEW] GET /allocations/{uuid} on a consumer with no allocations provides no generation

2018-06-25 Thread Chris Dent
Public bug reported: If we write some allocations with PUT /allocations/{uuid} at modern microversions, a consumer record is created for {uuid} and a generation is created for that consumer. Each subsequent attempt to PUT /allocations/{uuid} must include a matching consumer generation. If the

[Yahoo-eng-team] [Bug 1778576] [NEW] making new allocations for one consumer against multiple resource providers fails with 409

2018-06-25 Thread Chris Dent
: Chris Dent (cdent) Status: New ** Tags: placement -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1778576 Title: making new allocations for one consumer against

[Yahoo-eng-team] [Bug 1778071] [NEW] The placement consumer generation conflict error message can be misleading

2018-06-21 Thread Chris Dent
Public bug reported: When using consumer generations to create new allocations, the value of the generation is expected to be None on the python side, and 'null' in JSON. The error response sent over the API says "expected None but got 1" which doesn't help much since the api is in JSON. **

[Yahoo-eng-team] [Bug 1776668] [NEW] the placement version discovery doc at / does't have a status field, it should

2018-06-13 Thread Chris Dent
placement only has one version. This is easily fixable and easily backportable, so I'll get on that. This is causing problems for at least mnaser when trying to write his own client code. ** Affects: nova Importance: Medium Assignee: Chris Dent (cdent) Status: Triaged ** Tags

[Yahoo-eng-team] [Bug 1775308] [NEW] Listing placement usages (total or per resource provider) in a new process can result in a 500

2018-06-05 Thread Chris Dent
he caching or syncing a bit differently (see https://review.openstack.org/#/c/553857/ for an example). ** Affects: nova Importance: Medium Assignee: Chris Dent (cdent) Status: Triaged ** Tags: placement -- You received this bug notification because you are a member of Yahoo! Engine

[Yahoo-eng-team] [Bug 1773225] [NEW] placement needs to stop using accept.best_match from webob it is deprecated

2018-05-24 Thread Chris Dent
Public bug reported: Modern webob has improved its management of accept headers to be more in alignment with the HTTP RFCs (see bug https://bugs.launchpad.net/nova/+bug/1765748 ), deprecating their old handling: DeprecationWarning: The behavior of AcceptValidHeader.best_match is currently being

[Yahoo-eng-team] [Bug 1771384] [NEW] placement api send text/html error responses when accept headers is '*/*'

2018-05-15 Thread Chris Dent
nova Importance: Undecided Assignee: Chris Dent (cdent) Status: In Progress ** Tags: placement -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1771384 Title:

[Yahoo-eng-team] [Bug 1770220] [NEW] report client allocation retry handling insufficient

2018-05-09 Thread Chris Dent
Public bug reported: In stress testing of a nova+placement scenario where there is only one nova-compute process (and thus only one resource provider) but more than one thread worth of nova-scheduler it is fairly easy to trigger the "Failed scheduler client operation claim_resources: out of

[Yahoo-eng-team] [Bug 1765204] [NEW] Listing resource providers in placement with a postgresql backend gets a group by error

2018-04-18 Thread Chris Dent
perimental job for checking with postgres every now and again. [1] https://hub.docker.com/r/cdent/placedock/ ** Affects: nova Importance: Low Assignee: Chris Dent (cdent) Status: In Progress ** Tags: placement -- You received this bug notification because you are a membe

[Yahoo-eng-team] [Bug 1761295] [NEW] placement aggregate handler imports wrong exception module

2018-04-04 Thread Chris Dent
this piece of code is very very rarely called and we don't have tests (can) cover it. I just happened to notice while doing a readthrough. ** Affects: nova Importance: Medium Assignee: Chris Dent (cdent) Status: In Progress ** Tags: placement -- You received this bug notification

[Yahoo-eng-team] [Bug 1759863] [NEW] placement functional tests can collide when synchronising the traits table

2018-03-29 Thread Chris Dent
t it wrong). ** Affects: nova Importance: Medium Assignee: Chris Dent (cdent) Status: Triaged ** Tags: placement testing -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.lau

[Yahoo-eng-team] [Bug 1758057] [NEW] When creating uuid-based entities we can duplicate UUIDs

2018-03-22 Thread Chris Dent
Public bug reported: It is possible to create two different resource providers (and probably other entities) with the same UUID by creating one with '-' and the other without. This is because in both json schema and ovo validate UUIDs using the same route (different code but same concept): with

[Yahoo-eng-team] [Bug 1756151] [NEW] placement os-traits sync checked every request

2018-03-15 Thread Chris Dent
Public bug reported: Most requests to the placement service eventually reach the database code in the resource_provider.py file and as a result eventually run _ensure_trait_sync to make sure that this process has synced the os- traits library to its traits database table. While there is a flag

[Yahoo-eng-team] [Bug 1749797] Re: placement returns 503 when keystone is down

2018-03-09 Thread Chris Dent
** Changed in: nova Status: Confirmed => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1749797 Title: placement returns 503 when keystone is down

[Yahoo-eng-team] [Bug 1632852] Re: placement api responses should not be cacheable

2018-02-19 Thread Chris Dent
This is actually done now, but my use of partial-bug on both changes made the automation not happen. ** Changed in: nova Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute

[Yahoo-eng-team] [Bug 1750355] [NEW] nova.tests.unit.test_api_validation.PatternPropertiesTestCase.test_validate_patternProperties_fails fails in 3.6 because py3 check is limited to 3.5

2018-02-19 Thread Chris Dent
cts: nova Importance: Undecided Assignee: Chris Dent (cdent) Status: In Progress ** Tags: low-hanging-fruit testing -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nov

[Yahoo-eng-team] [Bug 1749797] Re: placement returns 503 when keystone is down

2018-02-16 Thread Chris Dent
** Also affects: keystonemiddleware Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1749797 Title: placement returns 503 when

[Yahoo-eng-team] [Bug 1749404] Re: nova-compute resource tracker ignores 'reserved' while reporting 'max_unit'

2018-02-14 Thread Chris Dent
I disagree with Sylvain on this one so going to re-open, but it is low- ish priority because the impact isn't significant: if max_unit is greater than reserved and allocation_ratio is 1 requesting a single max_unit resource will fail in an expected way that does not involve max_unit:

[Yahoo-eng-team] [Bug 1747000] Re: Use of parse.urlencode with dict in nova/tests/unit/scheduler/client/test_report.py can result in unpredictable query strings and thus unreliable tests

2018-02-12 Thread Chris Dent
It is, yes. I think the duplicate was created during one of those times when launchpad was doing timeouts and I didn't notice that I created it twice. ** Changed in: nova Status: Triaged => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering

[Yahoo-eng-team] [Bug 1739042] Re: _move_operation_alloc_request fails with TypeError when using 1.12 version allocation request

2018-02-09 Thread Chris Dent
The strings in the log don't seem to be showing up in recent logstash, so I'm going to mark this one dead, so it's not lingering. ** Changed in: nova Status: Triaged => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed

[Yahoo-eng-team] [Bug 1747935] Re: Openstack APIs and RFC 7234 HTTP caching

2018-02-07 Thread Chris Dent
I've added api-sig to this because the fact that this issue has shown up in the wild should be good motivation for us to make a guideline about how to address it. The code for adding the requisite headers to placement may be a useful starting point: https://review.openstack.org/#/c/521640/ **

[Yahoo-eng-team] [Bug 1747000] [NEW] Use of parse.urlencode with dict in nova/tests/unit/scheduler/client/test_report.py can result in unpredictable query strings and thus unreliable tests

2018-02-02 Thread Chris Dent
Public bug reported: In nova/tests/unit/scheduler/client/test_report.py there are several tests which confirm the URLs that get passed to the placement service. These create query strings by using code like: expected_url = '/allocation_candidates?%s' % parse.urlencode(

[Yahoo-eng-team] [Bug 1747001] [NEW] Use of parse.urlencode with dict in nova/tests/unit/scheduler/client/test_report.py can result in unpredictable query strings and thus unreliable tests

2018-02-02 Thread Chris Dent
Public bug reported: In nova/tests/unit/scheduler/client/test_report.py there are several tests which confirm the URLs that get passed to the placement service. These create query strings by using code like: expected_url = '/allocation_candidates?%s' % parse.urlencode(

[Yahoo-eng-team] [Bug 1747003] [NEW] A bad _RC_CACHE can rarely cause unit tests to fail

2018-02-02 Thread Chris Dent
Public bug reported: Very rarely (so rarely in fact that it only seems to happen when test order is much different from the norm) some unit tests which encounter the resource_class_cache can fail as follows: http://logs.openstack.org/49/540049/2/check/openstack-tox-

[Yahoo-eng-team] [Bug 1743860] Re: allocation candidates db backend can handle traits but the HTTP front end is not turned on

2018-01-22 Thread Chris Dent
Apparently this was mostly expected, but not fully documented, so going to invalidate the bug. https://review.openstack.org/#/c/535642/ ** Changed in: nova Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is

[Yahoo-eng-team] [Bug 1743860] [NEW] allocation candidates db backend can handle non-nested traits but the HTTP front end is not turned on

2018-01-17 Thread Chris Dent
Public bug reported: The code for /allocation_candidates is set up to be able to process a 'required' parameter alongside the 'resources' parameter. This results in a collection of RequestGroups which are used by the AllocationCandidates code in nova/objects/resource_provider.py But we can't

[Yahoo-eng-team] [Bug 1743120] [NEW] placement inadvertently imports many python modules it does not need

2018-01-13 Thread Chris Dent
that this is not the only case of inadvertent imports, but is one of the main vectors. Others will be identified and additional bugs created. ** Affects: nova Importance: Low Assignee: Chris Dent (cdent) Status: Triaged ** Tags: placement -- You received this bug notification

[Yahoo-eng-team] [Bug 1736385] [NEW] placement is not being properly restarted in grenade (pike to master)

2017-12-05 Thread Chris Dent
Public bug reported: When the placement service is supposed to restart in grenade (pike to master) it doesn't actually restart: http://logs.openstack.org/93/385693/84/check/legacy-grenade-dsvm- neutron-multinode-live- migration/9fa93e0/logs/grenade.sh.txt.gz#_2017-12-05_00_08_01_111 This leads

[Yahoo-eng-team] [Bug 1735405] [NEW] Error message from placement when creating resource provider uses ambiguous identifier

2017-11-30 Thread Chris Dent
Public bug reported: Nova master, late november When a resource provider fails to create after a POST /resource_providers for some reason, the error message identifies the provider by uuid. However, the uuid may not have been supplied by the client, it may be generated server side. So the name

[Yahoo-eng-team] [Bug 1734491] [NEW] placement keystonemiddleware_authtoken ignores OS_PLACEMENT_CONFIG_DIR

2017-11-25 Thread Chris Dent
file handling as used in wsgi.py, but it's not clear if the arg will get passed through. Further experimentation required. ** Affects: nova Importance: Undecided Assignee: Chris Dent (cdent) Status: New ** Tags: placement -- You received this bug notification because you

[Yahoo-eng-team] [Bug 1728934] [NEW] placement gabbi tests that manipulate microversion can intermittently fail

2017-10-31 Thread Chris Dent
because it provides control and possibility to test exactly this problem. ** Affects: nova Importance: Medium Assignee: Chris Dent (cdent) Status: Triaged ** Tags: placement testing -- You received this bug notification because you are a member of Yahoo! Engineering Team

[Yahoo-eng-team] [Bug 1724065] [NEW] Requesting an out of range microversion without an accept header in placement results in a KeyError

2017-10-16 Thread Chris Dent
Public bug reported: If the placement service (as of microversion 1.10) if you request a microversion that is outside the acceptable range of VERSIONS and do _not_ include an 'Accept' header in the request, there is a 500 and a KeyError while webob tries to look up the Accept header. The issue

[Yahoo-eng-team] [Bug 1723122] [NEW] missing gabbi coverage for empty resources query string

2017-10-12 Thread Chris Dent
Public bug reported: This is a note to self for sake of bookkeeping. Coverage reports show that there's zero gabbi coverage for a request with an empty `resources` query string. As this is relatively simple to add, may as well have it. ** Affects: nova Importance: Low Assignee: Chris

[Yahoo-eng-team] [Bug 1723123] [NEW] missing coverage for trying to update a standard resource class in placement api

2017-10-12 Thread Chris Dent
Public bug reported: This is a note to self for sake of bookkeeping. Coverage reports show that there's zero gabbi coverage for a request that attempts to PUT to update a standard resource class. This is easy to fix, so may as well. ** Affects: nova Importance: Low Assignee: Chris

[Yahoo-eng-team] [Bug 1692375] Re: Placement install process isn't documented

2017-10-06 Thread Chris Dent
I think the above patch got us far as we're going to get on this issue for now, so gonna mark it done. ** Changed in: nova Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack

[Yahoo-eng-team] [Bug 1719933] [NEW] placement server needs to retry allocations, server-side

2017-09-27 Thread Chris Dent
Public bug reported: Long time ago a todo was made in placement: https://github.com/openstack/nova/blob/faede889d3620f8ff0131a7a4c6b9c1bc844cd06/nova/objects/resource_provider.py#L1837-L1839 We need to implement that TODO, this is a note to self. This is related to what may be a different bug:

[Yahoo-eng-team] [Bug 1716247] [NEW] api_sample_tests.test_aggregates.AggregatesSampleJsonTest failing due to change in aggregates

2017-09-10 Thread Chris Dent
Importance: Undecided Assignee: Chris Dent (cdent) Status: In Progress -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1716247 Title

[Yahoo-eng-team] [Bug 1714402] [NEW] When setting an allocation with multiple resource providers and one of them does not exist the error message can be wrong

2017-08-31 Thread Chris Dent
Public bug reported: nova master as of 20170831 The _set_allocations method used to write allocations to the placement API will raise a 400 when a resource class results in a NotFound exception. We want that 400. The problem is that the message associated with the error users the resource

[Yahoo-eng-team] [Bug 1708205] Re: placement allocation representation asymetric on PUT and GET

2017-08-25 Thread Chris Dent
** Changed in: nova Status: Incomplete => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1708205 Title: placement allocation representation asymetric on

[Yahoo-eng-team] [Bug 1621709] Re: There is no allocation record for migration action

2017-08-18 Thread Chris Dent
This is effectively a duplicate of #1707071 , which has been released, so I'm going to mark this as such. ** Changed in: nova Status: Confirmed => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack

[Yahoo-eng-team] [Bug 1653122] Re: Placement API should support DELETE /resource-providers/{uuid}/inventories

2017-08-18 Thread Chris Dent
** Changed in: nova Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1653122 Title: Placement API should support DELETE

[Yahoo-eng-team] [Bug 1661312] Re: Evacuation will corrupt instance allocations

2017-08-18 Thread Chris Dent
https://bugs.launchpad.net/nova/+bug/1709902 duplcates this, and that one has code, so invalidating this one. ** Changed in: nova Status: Incomplete => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack

[Yahoo-eng-team] [Bug 1710908] [NEW] scheduler.utils.merge_resources allows zero value resources

2017-08-15 Thread Chris Dent
Public bug reported: (master as of 2017-08-15) If the merge of two resources of the same class can result in a sum of zero, or one of the provided keys has a value of zero in the first place and it is only in one of the provided resource dicts, the result dict of resources will have a zero value

[Yahoo-eng-team] [Bug 1710509] [NEW] ServerMovingTests.test_evacuate sometimes fails but not always

2017-08-13 Thread Chris Dent
Public bug reported: The newly added test_evacuate test in ServerMovingTests is lightly racey. It seems to fail about 1 in 10 times. A recent failure is at http://logs.openstack.org/72/489772/2/gate/gate-nova-tox-functional-py35 -ubuntu-xenial/07f4a29/console.html#_2017-08-12_12_51_52_867765

[Yahoo-eng-team] [Bug 1708961] [NEW] migration of single instance from multi-instance request spec fails with IndexError

2017-08-06 Thread Chris Dent
Public bug reported: Nova master, as of August 6th, 2017 (head is 5971dde5d945bcbe1e81b87d342887abd5d2eece). If you make multiple instances from one request: openstack server create --flavor c1 --image $IMAGE --nic net- id=$NET_ID --min 5 --max 10 x2 and then try to migrate just one of

[Yahoo-eng-team] [Bug 1708958] [NEW] disabling a compute service does not disable the resource provider

2017-08-06 Thread Chris Dent
Public bug reported: If you make a multi node devstack (nova master as of August 6th, 2017), or otherwise have multiple compute nodes, all of those compute nodes will create resource providers and relevant inventory. Later if you disable one of the compute nodes with a nova service- disable

[Yahoo-eng-team] [Bug 1708260] [NEW] Sending empty allocations list on a PUT /allocations/{consumer_uuid} results in 500

2017-08-02 Thread Chris Dent
. ** Affects: nova Importance: Medium Assignee: Chris Dent (cdent) Status: Confirmed ** Tags: pike-rc-potential placment -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https

[Yahoo-eng-team] [Bug 1708252] [NEW] resource tracker updates its map of aggregates too often

2017-08-02 Thread Chris Dent
, as updates of those on the placement server side are relatively infrequent. We need to balance between doing the updates too often and there being a gap between when an aggregate change does happen and the map getting updated. ** Affects: nova Importance: Low Assignee: Chris Dent (cdent

[Yahoo-eng-team] [Bug 1708204] [NEW] placement allocation representation asymetric on PUT and GET

2017-08-02 Thread Chris Dent
Public bug reported: GET /allocations/{consumer_uuid} is a dict keyed by resource provider uuid. PUT /allocations/{consumer_uuid} is an array of anonymous json objects with 'resource_provider' and 'resources' objects This asymmetry is undesirable and confusing. It's probably the result of

[Yahoo-eng-team] [Bug 1708205] [NEW] placement allocation representation asymetric on PUT and GET

2017-08-02 Thread Chris Dent
Public bug reported: GET /allocations/{consumer_uuid} is a dict keyed by resource provider uuid. PUT /allocations/{consumer_uuid} is an array of anonymous json objects with 'resource_provider' and 'resources' objects This asymmetry is undesirable and confusing. It's probably the result of

[Yahoo-eng-team] [Bug 1708167] [NEW] placement services logs 405 response as untrapped error

2017-08-02 Thread Chris Dent
to deal with. ** Affects: nova Importance: Low Assignee: Chris Dent (cdent) Status: In Progress ** Tags: placement -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https

[Yahoo-eng-team] [Bug 1708037] [NEW] scheduler/resource tracker report client should send accept header on all requests

2017-08-01 Thread Chris Dent
Public bug reported: Currently the report client doesn't consisently use an accept header of 'application/json' when making requests of the placement API. This means that sometimes the bodies of the error responses are in HTML which means processing and inspection of the error response is

[Yahoo-eng-team] [Bug 1707669] [NEW] [placement] put allocations does not do a full overwrite of existing allocations

2017-07-31 Thread Chris Dent
Public bug reported: The presumption all along has been that when doing a PUT /allocations/{consumer_uuid} that the body of that request would fully replace any allocations associated with that consumer. This has turned out not to be the case. The code [1] to clean up the current allocations was

[Yahoo-eng-team] [Bug 1707168] [NEW] [placement] resource provider trait-related query creates unicode warning

2017-07-28 Thread Chris Dent
be suppressed after 10 occurrences) (util.ellipses_string(value),)) This is annoying when trying to evaluate test logs. It's noise. ** Affects: nova Importance: Low Assignee: Chris Dent (cdent) Status: In Progress ** Tags: placement -- You received this bug notification

[Yahoo-eng-team] [Bug 1705161] Re: Instance is not able to launch

2017-07-20 Thread Chris Dent
Looks like your database connection setup is not correct, either in nova.conf or with username and password on the databasea: 2017-07-19 02:14:14.901 24784 ERROR nova.api.openstack.extensions OperationalError: (pymysql.err.OperationalError) (1045, u"Access denied for user 'nova'@'controller'

[Yahoo-eng-team] [Bug 1704574] [NEW] [placement] attempt to put allocation to resource provide that does not host class of resource causes 500

2017-07-15 Thread Chris Dent
Public bug reported: I made a typo while writing some gabbi tests and uncovered a 500 in the placement service. If you try to allocate to a resource provider that does not host that class of resource it can have a KeyError during capacity checking. given the following gabbi in microversion 1.10:

[Yahoo-eng-team] [Bug 1619723] Re: in placement api an allocation reporter sometimes needs to be able to report an allocation even if it violates capacity constraints

2017-06-24 Thread Chris Dent
** Changed in: nova Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1619723 Title: in placement api an allocation reporter sometimes needs

  1   2   >