[Yahoo-eng-team] [Bug 2052484] Re: [DEFAULT] rpc_worker=0 leaves one rpc worker
Reviewed: https://review.opendev.org/c/openstack/neutron/+/908173 Committed: https://opendev.org/openstack/neutron/commit/b38f72b2129ee377cb80132ca9c0794b60585be6 Submitter: "Zuul (22348)" Branch:master commit b38f72b2129ee377cb80132ca9c0794b60585be6 Author: Takashi Kajinami Date: Wed Feb 7 01:46:47 2024 +0900 Completely disable rpc workers when rpc_workers=0 Currently at least 1 rpc worker is launched even when a user requests zero workers by setting rpc_workers=0. The setting of rpc_workers=0 is used when ml2-ovn plugin is used without any additional agent, and in this deployment pattern the single rpc worker is not at all used. This change ensures no rpc worker is launched when rpc_workers options is explicitly set to 0. This may be classified as a breaking change, but is consistent with the earlier change[1] for rpc_workers=0. [1] 3e1e2d63b3383d28c9a36b0ab89caffa3829 Closes-Bug: #2052484 Change-Id: I878e50c3192ecd3b145ded0ab8394845a089696e ** Changed in: neutron Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2052484 Title: [DEFAULT] rpc_worker=0 leaves one rpc worker Status in neutron: Fix Released Bug description: Since https://review.opendev.org/c/openstack/neutron/+/823637 was merged, neutron-server allows disabling rpc worker by setting:: [DEFAULT] rpc_worker=0 However, I observe one rpc worker is still kept even with this setting. From neutron-server log, rpc_workers and rpc_state_report_workers are set to 0. 2024-02-05 13:05:33.159 70458 DEBUG neutron.common.config [-] rpc_state_report_workers = 0 log_opt_values /usr/lib/python3.9/site-packages/oslo_config/cfg.py:2602 2024-02-05 13:05:33.159 70458 DEBUG neutron.common.config [-] rpc_workers = 0 log_opt_values /usr/lib/python3.9/site-packages/oslo_config/cfg.py:2602 ps shows there is one rpc worker running. neutron70458 1 70458 0.3 1.8 133664 144496 /usr/bin/python3 -s /usr/bin/neutron-server ... neutron70499 70458 70499 11.4 3.1 246792 248240 neutron-server: api worker (...) neutron70500 70458 70500 11.0 3.1 243640 249488 neutron-server: api worker (...) neutron70502 70458 70502 0.3 1.7 141196 142132 neutron-server: rpc worker (...) neutron70503 70458 70503 0.3 1.8 145256 146356 neutron-server: MaintenanceWorker (...) neutron70504 70458 70504 0.0 1.7 135472 135604 neutron-server: periodic worker (...) I've noticed this in Puppet OpenStack jobs which uses RDO master packages. The package versions currently used are:: openstack-neutron-24.0.0-0.20240131211457.b85b19e.el9.noarch openstack-neutron-common-24.0.0-0.20240131211457.b85b19e.el9.noarch openstack-neutron-ml2-24.0.0-0.20240131211457.b85b19e.el9.noarch openstack-neutron-ovn-agent-24.0.0-0.20240131211457.b85b19e.el9.noarch openstack-neutron-ovn-metadata-agent-24.0.0-0.20240131211457.b85b19e.el9.noarch openstack-neutron-rpc-server-24.0.0-0.20240131211457.b85b19e.el9.noarch To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2052484/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 2052509] Re: [CI][ovs/ovn sqlalchemy master] jobs broken with Exception: Not enough arguments given
Reviewed: https://review.opendev.org/c/openstack/devstack/+/908572
Committed:
https://opendev.org/openstack/devstack/commit/4ddd456dd3e71bcdf9a02a12dd5914b82ec48e91
Submitter: "Zuul (22348)"
Branch:master
commit 4ddd456dd3e71bcdf9a02a12dd5914b82ec48e91
Author: Slawek Kaplonski
Date: Fri Feb 9 14:11:44 2024 +0100
Add support for the pyproject.toml file in setup with constraints
In the _setup_package_with_constraints_edit name of the package was
always discovered from the setup.cfg file. But as some projects
implements PEP-621 (see [1] for the SQLAlchemy for example) it is not
enough now.
This patch adds parsing pyproject.toml file also if name is not found in
the setup.cfg file.
[1]
https://github.com/sqlalchemy/sqlalchemy/commit/a8dbf8763a8fa2ca53cc01033f06681a421bf60b
Closes-Bug: #2052509
Change-Id: Iee9262079d09a8bd22cd05a8f17950a41a0d1f9d
** Changed in: devstack
Status: In Progress => Fix Released
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2052509
Title:
[CI][ovs/ovn sqlalchemy master] jobs broken with Exception: Not enough
arguments given
Status in devstack:
Fix Released
Status in neutron:
In Progress
Bug description:
Fails like:-
2024-02-06 02:28:34.618579 | controller | ++
inc/python:_setup_package_with_constraints_edit:400 : cd /opt/stack/sqlalchemy
2024-02-06 02:28:34.621804 | controller | ++
inc/python:_setup_package_with_constraints_edit:400 : pwd
2024-02-06 02:28:34.624859 | controller | +
inc/python:_setup_package_with_constraints_edit:400 :
project_dir=/opt/stack/sqlalchemy
2024-02-06 02:28:34.627646 | controller | +
inc/python:_setup_package_with_constraints_edit:402 : '[' -n
/opt/stack/requirements ']'
2024-02-06 02:28:34.630146 | controller | +
inc/python:_setup_package_with_constraints_edit:406 : local name
2024-02-06 02:28:34.633640 | controller | ++
inc/python:_setup_package_with_constraints_edit:407 : awk '/^name.*=/ {print
$3}' /opt/stack/sqlalchemy/setup.cfg
2024-02-06 02:28:34.639338 | controller | +
inc/python:_setup_package_with_constraints_edit:407 : name=
2024-02-06 02:28:34.641840 | controller | +
inc/python:_setup_package_with_constraints_edit:409 :
/opt/stack/requirements/.venv/bin/edit-constraints
/opt/stack/requirements/upper-constraints.txt --
2024-02-06 02:28:34.784286 | controller | Traceback (most recent call last):
2024-02-06 02:28:34.784331 | controller | File
"/opt/stack/requirements/.venv/bin/edit-constraints", line 10, in
2024-02-06 02:28:34.784449 | controller | sys.exit(main())
2024-02-06 02:28:34.784484 | controller | File
"/opt/stack/requirements/.venv/lib/python3.10/site-packages/openstack_requirements/cmds/edit_constraint.py",
line 66, in main
2024-02-06 02:28:34.784629 | controller | _validate_options(options, args)
2024-02-06 02:28:34.784661 | controller | File
"/opt/stack/requirements/.venv/lib/python3.10/site-packages/openstack_requirements/cmds/edit_constraint.py",
line 47, in _validate_options
2024-02-06 02:28:34.784783 | controller | raise Exception("Not enough
arguments given")
2024-02-06 02:28:34.784821 | controller | Exception: Not enough arguments
given
2024-02-06 02:28:34.805546 | controller | +
inc/python:_setup_package_with_constraints_edit:1 : exit_trap
2024-02-06 02:28:34.808305 | controller | + ./stack.sh:exit_trap:549
: local r=1
Example log:-
https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_22d/periodic/opendev.org/openstack/neutron/master/neutron-
ovs-tempest-with-sqlalchemy-master/22dfd7f/job-output.txt
Builds:- https://zuul.openstack.org/builds?job_name=neutron-ovs-
tempest-with-sqlalchemy-master&job_name=neutron-ovn-tempest-with-
sqlalchemy-master
Broken since
https://github.com/sqlalchemy/sqlalchemy/commit/a8dbf8763a8fa2ca53cc01033f06681a421bf60b
To manage notifications about this bug go to:
https://bugs.launchpad.net/devstack/+bug/2052509/+subscriptions
--
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 2052937] [NEW] Policy: binding operations are prohibited for service role
Public bug reported: Create/update port binding:* policies are admin only, which prevents for example ironic service user with service role to manage baremetal ports: "http://192.0.2.10:9292";, "region": "RegionOne"}], "id": "e6e42ef4fc984e71b575150e59a92704", "type": "image", "name": "glance"}]}} get_auth_ref /var/lib/kolla/venv/lib64/python3.9/site-packages/keystoneauth1/identity/v3/base.py:189 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron [None req-6737aef3-c823-4f7c-95ec-1c9f38b14faa a4dbb0dc59024c199843cea86603308b 9fd64a4cbd774756869cb3968de2e9b6 - - default default] Unable to clear binding profile for neutron port 291dbb7b-5cc8-480d-b39d-eb849bcb4a64. Error: ForbiddenException: 403: Client Error for url: http://192.0.2.10:9696/v2.0/ports/291dbb7b-5cc8-480d-b39d-eb849bcb4a64, ((rule:update_port and rule:update_port:binding:host_id) and rule:update_port:binding:profile) is disallowed by policy: openstack.exceptions.ForbiddenException: ForbiddenException: 403: Client Error for url: http://192.0.2.10:9696/v2.0/ports/291dbb7b-5cc8-480d-b39d-eb849bcb4a64, ((rule:update_port and rule:update_port:binding:host_id) and rule:update_port:binding:profile) is disallowed by policy 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron Traceback (most recent call last): 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/ironic/common/neutron.py", line 130, in unbind_neutron_port 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron update_neutron_port(context, port_id, attrs_unbind, client) 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/ironic/common/neutron.py", line 109, in update_neutron_port 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron return client.update_port(port_id, **attrs) 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/openstack/network/v2/_proxy.py", line 2992, in update_port 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron return self._update(_port.Port, port, if_revision=if_revision, **attrs) 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/openstack/proxy.py", line 61, in check 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron return method(self, expected, actual, *args, **kwargs) 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/openstack/network/v2/_proxy.py", line 202, in _update 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron return res.commit(self, base_path=base_path, if_revision=if_revision) 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/openstack/resource.py", line 1803, in commit 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron return self._commit( 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/openstack/resource.py", line 1848, in _commit 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron self._translate_response(response, has_body=has_body) 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/openstack/resource.py", line 1287, in _translate_response 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron exceptions.raise_from_response(response, error_message=error_message) 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron File "/var/lib/kolla/venv/lib64/python3.9/site-packages/openstack/exceptions.py", line 250, in raise_from_response 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron raise cls( 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron openstack.exceptions.ForbiddenException: ForbiddenException: 403: Client Error for url: http://192.0.2.10:9696/v2.0/ports/291dbb7b-5cc8-480d-b39d-eb849bcb4a64, ((rule:update_port and rule:update_port:binding:host_id) and rule:update_port:binding:profile) is disallowed by policy ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2052937 Title: Policy: binding operations are prohibited for service role Status in neutron: New Bug description: Create/update port binding:* policies are admin only, which prevents for example ironic service user with service role to manage baremetal ports: "http://192.0.2.10:9292";, "region": "RegionOne"}], "id": "e6e42ef4fc984e71b575150e59a92704", "type": "image", "name": "glance"}]}} get_auth_ref /var/lib/kolla/venv/lib64/python3.9/site-packages/keystoneauth1/identity/v3/base.py:189 2024-02-12 11:44:57.848 7 ERROR ironic.common.neutron [None req-6737aef3-c823-4f7c-95ec-1c9f38b14faa a4dbb0dc59024c19
[Yahoo-eng-team] [Bug 2052916] [NEW] HTTP get on s3tokens and ec2tokens endpoint gives 500 internal error
Public bug reported: When doing a HTTP GET against s3tokens and ec2tokens endpoint we should get a 405 method not allowed but because the get method is getting enforced we get a 500 internal server error instead. AssertionError: PROGRAMMING ERROR: enforcement (`keystone.common.rbac_enforcer.enforcer.RBACEnforcer.enforce_call()`) has not been called; API is unenforced. ** Affects: keystone Importance: Undecided Status: In Progress -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Identity (keystone). https://bugs.launchpad.net/bugs/2052916 Title: HTTP get on s3tokens and ec2tokens endpoint gives 500 internal error Status in OpenStack Identity (keystone): In Progress Bug description: When doing a HTTP GET against s3tokens and ec2tokens endpoint we should get a 405 method not allowed but because the get method is getting enforced we get a 500 internal server error instead. AssertionError: PROGRAMMING ERROR: enforcement (`keystone.common.rbac_enforcer.enforcer.RBACEnforcer.enforce_call()`) has not been called; API is unenforced. To manage notifications about this bug go to: https://bugs.launchpad.net/keystone/+bug/2052916/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 2052915] [NEW] "neutron-ovs-grenade-multinode" and "neutron-ovn-grenade-multinode" failing in 2023.1 and Zed
Public bug reported: The issue seems to be in the neutron-lib version installed: 2024-02-07 16:19:35.155231 | compute1 | ERROR: neutron 21.2.1.dev38 has requirement neutron-lib>=3.1.0, but you'll have neutron-lib 2.20.2 which is incompatible. That leads to an error when starting the Neutron API (an API definition is not found) [1]: Feb 07 16:13:54.385467 np0036680724 neutron-server[67288]: ERROR neutron ImportError: cannot import name 'port_mac_address_override' from 'neutron_lib.api.definitions' (/usr/local/lib/python3.8/dist-packages/neutron_lib/api/definitions/__init__.py) Setting priority to Critical because that affects to the CI. [1]https://9faad8159db8d6994977-b587eccfce0a645f527dfcbc49e54bb4.ssl.cf2.rackcdn.com/891397/4/check/neutron- ovs-grenade-multinode/ba47cef/controller/logs/screen-q-svc.txt ** Affects: neutron Importance: Critical Status: New ** Changed in: neutron Importance: Undecided => Critical -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2052915 Title: "neutron-ovs-grenade-multinode" and "neutron-ovn-grenade-multinode" failing in 2023.1 and Zed Status in neutron: New Bug description: The issue seems to be in the neutron-lib version installed: 2024-02-07 16:19:35.155231 | compute1 | ERROR: neutron 21.2.1.dev38 has requirement neutron-lib>=3.1.0, but you'll have neutron-lib 2.20.2 which is incompatible. That leads to an error when starting the Neutron API (an API definition is not found) [1]: Feb 07 16:13:54.385467 np0036680724 neutron-server[67288]: ERROR neutron ImportError: cannot import name 'port_mac_address_override' from 'neutron_lib.api.definitions' (/usr/local/lib/python3.8/dist-packages/neutron_lib/api/definitions/__init__.py) Setting priority to Critical because that affects to the CI. [1]https://9faad8159db8d6994977-b587eccfce0a645f527dfcbc49e54bb4.ssl.cf2.rackcdn.com/891397/4/check/neutron- ovs-grenade-multinode/ba47cef/controller/logs/screen-q-svc.txt To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2052915/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
