Public bug reported: stack@aio:/opt/stack/python-openstackclient$ openstack server evacuate vm1 BadRequestException: 400: Client Error for url: http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action, {'currently': 0, 'expected': 62}
* osc 7.1.1 * single node devstack from master * create an instance * disable and force down the compute * try to evacuate the instance client log: ``` REQ: curl -g -i -X POST http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action -H "Accept: " -H "Content-Type: application/json" -H "OpenStack-API-Version: compute 2.96" -H "User-Agent: openstacksdk/4.1.0 keystoneauth1/5.8.0 python-requests/2.32.3 CPython/3.12.3" -H "X-Auth-Token: {SHA256}7377cce62f0cb1078b3614b9a11845b1aadd0bd1f05c6c708b353cbeb23c3677" -H "X-OpenStack-Nova-API-Version: 2.96" -d '{"evacuate": {}}' Resetting dropped connection: 192.168.121.9 http://192.168.121.9:80 "POST /compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action HTTP/1.1" 400 76 RESP: [400] Connection: close Content-Length: 76 Content-Type: application/json; charset=UTF-8 Date: Wed, 18 Sep 2024 06:53:55 GMT OpenStack-API-Version: compute 2.96 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.96 x-compute-request-id: req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae x-openstack-request-id: req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae RESP BODY: {"badRequest": {"code": 400, "message": "{'currently': 0, 'expected': 62}"}} POST call to compute for http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action used request id req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae BadRequestException: 400: Client Error for url: http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action, {'currently': 0, 'expected': 62} Traceback (most recent call last): File "/opt/stack/data/venv/lib/python3.12/site-packages/cliff/app.py", line 431, in run_subcommand result = cmd.run(parsed_args) ^^^^^^^^^^^^^^^^^^^^ File "/opt/stack/data/venv/lib/python3.12/site-packages/osc_lib/command/command.py", line 38, in run return super(Command, self).run(parsed_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/stack/data/venv/lib/python3.12/site-packages/cliff/display.py", line 121, in run column_names, data = self.take_action(parsed_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/stack/python-openstackclient/openstackclient/compute/v2/server.py", line 3884, in take_action compute_client.evacuate_server(server, **kwargs) File "/opt/stack/openstacksdk/openstack/compute/v2/_proxy.py", line 1114, in evacuate_server server.evacuate( File "/opt/stack/openstacksdk/openstack/compute/v2/server.py", line 772, in evacuate self._action(session, body) File "/opt/stack/openstacksdk/openstack/compute/v2/server.py", line 343, in _action exceptions.raise_from_response(response) File "/opt/stack/openstacksdk/openstack/exceptions.py", line 244, in raise_from_response raise cls( openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action, {'currently': 0, 'expected': 62} clean_up EvacuateServer: BadRequestException: 400: Client Error for url: http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action, {'currently': 0, 'expected': 62} ``` nova-api log: ``` Sep 18 06:53:55 aio [email protected][87253]: DEBUG nova.api.openstack.wsgi [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Action: 'action', calling method: <bound method EvacuateController._evacuate of <nova.api.openstack.compute.evacuate.EvacuateController object at 0x72087167cb90>>, body: {"evacuate": {}} {{(pid=87253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG nova.compute.api [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] [instance: 2ed7c251-fbd2-47e5-acc9-090a32baffec] Fetching instance by UUID {{(pid=87253) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Acquiring lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:402}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:407}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:421}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Acquiring lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:402}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:407}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:421}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:402}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:407}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:421}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Acquiring lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:402}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:407}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:421}} Sep 18 06:53:55 aio [email protected][87253]: INFO nova.api.openstack.wsgi [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] HTTP exception thrown: {'currently': 0, 'expected': 62} Sep 18 06:53:55 aio [email protected][87253]: DEBUG nova.api.openstack.wsgi [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Returning 400 to user: {'currently': 0, 'expected': 62} {{(pid=87253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:956}} Sep 18 06:53:55 aio [email protected][87253]: INFO nova.api.openstack.requestlog [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] 192.168.121.9 "POST /compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action" status: 400 len: 76 microversion: 2.96 time: 0.011445 ``` Using older microversion works: ``` stack@aio:/opt/stack/python-openstackclient$ openstack --os-compute-api-version 2.94 server evacuate vm1 compute version 2.94 is not in supported versions: 2, 2.1 +-------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +-------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | nova | | OS-EXT-SRV-ATTR:host | aio | | OS-EXT-SRV-ATTR:hostname | vm1 | | OS-EXT-SRV-ATTR:hypervisor_hostname | aio | | OS-EXT-SRV-ATTR:instance_name | instance-00000001 | | OS-EXT-SRV-ATTR:kernel_id | | | OS-EXT-SRV-ATTR:launch_index | 0 | | OS-EXT-SRV-ATTR:ramdisk_id | | | OS-EXT-SRV-ATTR:reservation_id | r-4nynd1i3 | | OS-EXT-SRV-ATTR:root_device_name | /dev/vda | | OS-EXT-SRV-ATTR:user_data | None | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | rebuilding | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2024-09-18T06:50:27.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | config_drive | | | created | 2024-09-18T06:50:18Z | | description | None | | flavor | description=, disk='1', ephemeral='0', extra_specs.hw_rng:allowed='True', id='cirros256', is_disabled=, is_public='True', location=, name='cirros256', | | | original_name='cirros256', ram='256', rxtx_factor=, swap='0', vcpus='1' | | hostId | 33f32221dc88921a2357f89abfaa8ff5833af1806f0df79ee3ea05d4 | | host_status | DOWN | | id | 2ed7c251-fbd2-47e5-acc9-090a32baffec | | image | cirros-0.6.2-x86_64-disk (fb2499b2-c5dd-48d2-8493-b52741253912) | | key_name | None | | locked | False | | locked_reason | None | | name | vm1 | | pinned_availability_zone | None | | progress | 0 | | project_id | b98570e0e8204322a3528e65024d9045 | | properties | | | server_groups | None | | status | REBUILD | | tags | | | trusted_image_certificates | None | | updated | 2024-09-18T06:58:13Z | | user_id | 5bd4392f854b41ec8dd6e053d6d778ec | | volumes_attached | | +-------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ``` The error message is totally useless for the user as it does not state what are those numbers returned. Based on the code this is the current and the minimum service version required for evacuation to stopped state. https://github.com/openstack/nova/blob/b16445df86e76fa4ed299f4002d78f03dbfd0921/nova/api/openstack/compute/evacuate.py#L107-L113 In a system where all the computes are forced down the minimum service version returns 0 causing the rejected evacuation. Such evacuation would fail anyhow as all the compute is forced down so probably having a proper error returned would be enough. ** Affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/2081023 Title: evacuate with microversion 2.95 fails with BadRequest {'currently': 0, 'expected': 62} Status in OpenStack Compute (nova): New Bug description: stack@aio:/opt/stack/python-openstackclient$ openstack server evacuate vm1 BadRequestException: 400: Client Error for url: http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action, {'currently': 0, 'expected': 62} * osc 7.1.1 * single node devstack from master * create an instance * disable and force down the compute * try to evacuate the instance client log: ``` REQ: curl -g -i -X POST http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action -H "Accept: " -H "Content-Type: application/json" -H "OpenStack-API-Version: compute 2.96" -H "User-Agent: openstacksdk/4.1.0 keystoneauth1/5.8.0 python-requests/2.32.3 CPython/3.12.3" -H "X-Auth-Token: {SHA256}7377cce62f0cb1078b3614b9a11845b1aadd0bd1f05c6c708b353cbeb23c3677" -H "X-OpenStack-Nova-API-Version: 2.96" -d '{"evacuate": {}}' Resetting dropped connection: 192.168.121.9 http://192.168.121.9:80 "POST /compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action HTTP/1.1" 400 76 RESP: [400] Connection: close Content-Length: 76 Content-Type: application/json; charset=UTF-8 Date: Wed, 18 Sep 2024 06:53:55 GMT OpenStack-API-Version: compute 2.96 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.96 x-compute-request-id: req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae x-openstack-request-id: req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae RESP BODY: {"badRequest": {"code": 400, "message": "{'currently': 0, 'expected': 62}"}} POST call to compute for http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action used request id req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae BadRequestException: 400: Client Error for url: http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action, {'currently': 0, 'expected': 62} Traceback (most recent call last): File "/opt/stack/data/venv/lib/python3.12/site-packages/cliff/app.py", line 431, in run_subcommand result = cmd.run(parsed_args) ^^^^^^^^^^^^^^^^^^^^ File "/opt/stack/data/venv/lib/python3.12/site-packages/osc_lib/command/command.py", line 38, in run return super(Command, self).run(parsed_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/stack/data/venv/lib/python3.12/site-packages/cliff/display.py", line 121, in run column_names, data = self.take_action(parsed_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/stack/python-openstackclient/openstackclient/compute/v2/server.py", line 3884, in take_action compute_client.evacuate_server(server, **kwargs) File "/opt/stack/openstacksdk/openstack/compute/v2/_proxy.py", line 1114, in evacuate_server server.evacuate( File "/opt/stack/openstacksdk/openstack/compute/v2/server.py", line 772, in evacuate self._action(session, body) File "/opt/stack/openstacksdk/openstack/compute/v2/server.py", line 343, in _action exceptions.raise_from_response(response) File "/opt/stack/openstacksdk/openstack/exceptions.py", line 244, in raise_from_response raise cls( openstack.exceptions.BadRequestException: BadRequestException: 400: Client Error for url: http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action, {'currently': 0, 'expected': 62} clean_up EvacuateServer: BadRequestException: 400: Client Error for url: http://192.168.121.9/compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action, {'currently': 0, 'expected': 62} ``` nova-api log: ``` Sep 18 06:53:55 aio [email protected][87253]: DEBUG nova.api.openstack.wsgi [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Action: 'action', calling method: <bound method EvacuateController._evacuate of <nova.api.openstack.compute.evacuate.EvacuateController object at 0x72087167cb90>>, body: {"evacuate": {}} {{(pid=87253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:518}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG nova.compute.api [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] [instance: 2ed7c251-fbd2-47e5-acc9-090a32baffec] Fetching instance by UUID {{(pid=87253) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Acquiring lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:402}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:407}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:421}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Acquiring lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:402}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:407}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:421}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:402}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:407}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:421}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Acquiring lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:402}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:407}} Sep 18 06:53:55 aio [email protected][87253]: DEBUG oslo_concurrency.lockutils [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Lock "747fb487-bfc9-47fb-b68a-9cecdacd6573" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87253) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:421}} Sep 18 06:53:55 aio [email protected][87253]: INFO nova.api.openstack.wsgi [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] HTTP exception thrown: {'currently': 0, 'expected': 62} Sep 18 06:53:55 aio [email protected][87253]: DEBUG nova.api.openstack.wsgi [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] Returning 400 to user: {'currently': 0, 'expected': 62} {{(pid=87253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:956}} Sep 18 06:53:55 aio [email protected][87253]: INFO nova.api.openstack.requestlog [None req-748963e3-cbe0-4e4a-a25a-df67efc8f4ae admin admin] 192.168.121.9 "POST /compute/v2.1/servers/2ed7c251-fbd2-47e5-acc9-090a32baffec/action" status: 400 len: 76 microversion: 2.96 time: 0.011445 ``` Using older microversion works: ``` stack@aio:/opt/stack/python-openstackclient$ openstack --os-compute-api-version 2.94 server evacuate vm1 compute version 2.94 is not in supported versions: 2, 2.1 +-------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +-------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | nova | | OS-EXT-SRV-ATTR:host | aio | | OS-EXT-SRV-ATTR:hostname | vm1 | | OS-EXT-SRV-ATTR:hypervisor_hostname | aio | | OS-EXT-SRV-ATTR:instance_name | instance-00000001 | | OS-EXT-SRV-ATTR:kernel_id | | | OS-EXT-SRV-ATTR:launch_index | 0 | | OS-EXT-SRV-ATTR:ramdisk_id | | | OS-EXT-SRV-ATTR:reservation_id | r-4nynd1i3 | | OS-EXT-SRV-ATTR:root_device_name | /dev/vda | | OS-EXT-SRV-ATTR:user_data | None | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | rebuilding | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2024-09-18T06:50:27.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | config_drive | | | created | 2024-09-18T06:50:18Z | | description | None | | flavor | description=, disk='1', ephemeral='0', extra_specs.hw_rng:allowed='True', id='cirros256', is_disabled=, is_public='True', location=, name='cirros256', | | | original_name='cirros256', ram='256', rxtx_factor=, swap='0', vcpus='1' | | hostId | 33f32221dc88921a2357f89abfaa8ff5833af1806f0df79ee3ea05d4 | | host_status | DOWN | | id | 2ed7c251-fbd2-47e5-acc9-090a32baffec | | image | cirros-0.6.2-x86_64-disk (fb2499b2-c5dd-48d2-8493-b52741253912) | | key_name | None | | locked | False | | locked_reason | None | | name | vm1 | | pinned_availability_zone | None | | progress | 0 | | project_id | b98570e0e8204322a3528e65024d9045 | | properties | | | server_groups | None | | status | REBUILD | | tags | | | trusted_image_certificates | None | | updated | 2024-09-18T06:58:13Z | | user_id | 5bd4392f854b41ec8dd6e053d6d778ec | | volumes_attached | | +-------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ``` The error message is totally useless for the user as it does not state what are those numbers returned. Based on the code this is the current and the minimum service version required for evacuation to stopped state. https://github.com/openstack/nova/blob/b16445df86e76fa4ed299f4002d78f03dbfd0921/nova/api/openstack/compute/evacuate.py#L107-L113 In a system where all the computes are forced down the minimum service version returns 0 causing the rejected evacuation. Such evacuation would fail anyhow as all the compute is forced down so probably having a proper error returned would be enough. To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/2081023/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : [email protected] Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
