Your message dated Fri, 06 Jun 2025 11:37:25 +0000
with message-id <[email protected]>
and subject line Bug#1093303: fixed in neutron 2:26.0.0-4
has caused the Debian Bug report #1093303,
regarding neutron-api: does not work with multiple uwsgi processes and threads
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)
--
1093303: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1093303
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
Package: neutron-api
Version: 2:25.0.0-5~bpo12+1
Severity: normal
Dear Maintainer
The service neutron-api can not handle multiple process from uwsgi.
When the service nova-api starts it writes a lock in ovn_hash_ring table
in the neutron database. With multiple processes or threads from uwsgi
it does not update this record anymore. After a while when running
"openstack network agent list" it will yield an error [1]. When
commenting out these settings in /etc/neutron/neutron-api-uwsgi.ini it
seems to work.
--- neutron-api-uwsgi.ini.old 2025-01-17 17:08:15.938592898 +0100
+++ neutron-api-uwsgi.ini 2025-01-17 17:04:44.638252405 +0100
@@ -43,10 +43,10 @@ close-on-exec2 = true
enable-threads = true
# For max perf, set this to number of core*2
-processes = 8
+#processes = 8
# This was benchmarked as a good value
-threads = 32
+#threads = 32
The neutron server runs without uwsgi as well:
/usr/bin/neutron-server --config-file /etc/neutron/neutron.conf
--config-file /etc/neutron/plugins/ml2/ml2_conf.ini
Error Message [1]:
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource [None
req-b2f34437-1e6f-417f-86b9-e4e21f2b3d37
119654c86dd74332972dc6528e5af420 9e18eb1ee7cc423a88cd44e901ecc119 - -
default default] index failed: No details.:
ovsdbapp.exceptions.TimeoutException: Commands
[CheckLivenessCommand(_result=None)] exceeded timeou
t 180 seconds, cause: Result queue is empty
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource Traceback
(most recent call last):
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py",
line 54, in commit
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource result =
self.results.get(timeout=self.timeout)
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/eventlet/queue.py", line 320, in get
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource return
waiter.wait()
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/eventlet/queue.py", line 139, in wait
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource return
get_hub().switch()
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 310, in switch
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource return
self.greenlet.switch()
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource _queue.Empty
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource The above
exception was the direct cause of the following exception:
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource Traceback
(most recent call last):
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron/api/v2/resource.py", line 97, in
resource
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource result =
method(request=request, **args)
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron_lib/db/api.py", line 137, in
wrapped
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource with
excutils.save_and_reraise_exception():
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in
__exit__
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
self.force_reraise()
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in
force_reraise
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource raise
self.value
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron_lib/db/api.py", line 135, in
wrapped
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource return
f(*args, **kwargs)
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/oslo_db/api.py", line 144, in wrapper
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource with
excutils.save_and_reraise_exception() as ectxt:
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in
__exit__
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
self.force_reraise()
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in
force_reraise
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource raise
self.value
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/oslo_db/api.py", line 142, in wrapper
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource return
f(*args, **kwargs)
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron_lib/db/api.py", line 183, in
wrapped
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource with
excutils.save_and_reraise_exception():
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in
__exit__
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
self.force_reraise()
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in
force_reraise
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource raise
self.value
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron_lib/db/api.py", line 181, in
wrapped
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource return
f(*dup_args, **dup_kwargs)
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron/api/v2/base.py", line 372, in
index
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource return
self._items(request, True, parent_id)
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron/api/v2/base.py", line 307, in
_items
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource obj_list
= obj_getter(request.context, **kwargs)
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py",
line 1309, in fn
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource return
op(results, new_method(*args, _driver=self, **kwargs))
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py",
line 1421, in get_agents
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
_driver.ping_all_chassis()
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py",
line 1341, in ping_all_chassis
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource with
self.nb_ovn.create_transaction(check_error=True,
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/ovsdbapp/api.py", line 71, in __exit__
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
self.result = self.commit()
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
^^^^^^^^^^^^^
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource File
"/usr/lib/python3/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py",
line 56, in commit
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource raise
exceptions.TimeoutException(
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
ovsdbapp.exceptions.TimeoutException: Commands
[CheckLivenessCommand(_result=None)] exceeded timeout 180 seconds,
cause: Result queue is empty
2025-01-17 16:29:16.942 5389 ERROR neutron.api.v2.resource
-- System Information:
Debian Release: 12.9
APT prefers stable-updates
APT policy: (500, 'stable-updates'), (500, 'stable-security'), (500,
'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 6.1.0-30-amd64 (SMP w/4 CPU threads; PREEMPT)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) (ignored:
LC_ALL set to C.UTF-8), LANGUAGE=en_US:en
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled
Versions of packages neutron-api depends on:
ii adduser 3.134
ii debconf [debconf-2.0] 1.5.82
ii neutron-common 2:25.0.0-5~bpo12+1
ii python3-keystoneclient 1:5.5.0-4~bpo12+1
ii python3-openstackclient 6.6.0-5~bpo12+1
ii python3-pastescript 3.2.1-1
ii python3-q-text-as-data [q-text-as-data] 3.1.6-5~bpo12+1
ii uwsgi-plugin-python3 2.0.21-5.1
Thank you and cheers
Saki
--- End Message ---
--- Begin Message ---
Source: neutron
Source-Version: 2:26.0.0-4
Done: Thomas Goirand <[email protected]>
We believe that the bug you reported is fixed in the latest version of
neutron, which is due to be installed in the Debian FTP archive.
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to [email protected],
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Thomas Goirand <[email protected]> (supplier of updated neutron package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing [email protected])
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
Format: 1.8
Date: Wed, 30 Apr 2025 13:44:34 +0200
Source: neutron
Architecture: source
Version: 2:26.0.0-4
Distribution: unstable
Urgency: medium
Maintainer: Debian OpenStack <[email protected]>
Changed-By: Thomas Goirand <[email protected]>
Closes: 1093303
Changes:
neutron (2:26.0.0-4) unstable; urgency=medium
.
* Fix breaks that should be using binary packages, not source.
* Configure default uwsgi configuration file so that neutron-api doesn't use
threads anymore, which was broken with OVN config (Closes: #1093303).
Checksums-Sha1:
e9cc0bb6c003c44bedbe2671e8bb8f957e73d728 5176 neutron_26.0.0-4.dsc
317c89c925f70ca4b6a9f34b440510045ac43485 41540 neutron_26.0.0-4.debian.tar.xz
096c7af8ef03b4987efc9c028257f903611c4c83 22447 neutron_26.0.0-4_amd64.buildinfo
Checksums-Sha256:
da975183564cee9d7a2bf85ef1dace69ebaf08092206b8cf0aaa4f3ef662d193 5176
neutron_26.0.0-4.dsc
fc556649ff9ba82ee1eeac3b717395540b6b0cbea2bfb90a124034e5080e0bbf 41540
neutron_26.0.0-4.debian.tar.xz
fd6f457d307cff922177e8258b5af373ae8af77bc5d1a0f1ee4866479463caa0 22447
neutron_26.0.0-4_amd64.buildinfo
Files:
cb788e9e24f026db5b29c4e9adc8200b 5176 net optional neutron_26.0.0-4.dsc
a7f7a2d674cca3afd8e2b9cbf8210971 41540 net optional
neutron_26.0.0-4.debian.tar.xz
7c3d0f52113ed66f704e4e8666e31a64 22447 net optional
neutron_26.0.0-4_amd64.buildinfo
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEoLGp81CJVhMOekJc1BatFaxrQ/4FAmhCzScACgkQ1BatFaxr
Q/7zeQ/+NtXIXBMaVgKEIlVn3LqfcunYU+krG5pfO89KHSLBAQLfSYMFN5NXJ7hJ
57Jv0jfkbrbang5KvOvZr6GrQrJ7BzSomTQny/bAbs0IJVsYHtwaKUA65bqDAdb4
JARNU0qcNxsYtnEDiKC+Xj/GBjEMWOm9lgTJaz/6nzFPp2J7EmGdA507SNxi204b
x75O7uhbEgcEWZRyq0CP2rjALvzFI1y6Ouq/5lxHDpAUvse+HG7N4gKJJIwNQiaC
Hhb67211P5mvu11R4+SSUEjyI33ZlpEuc1H8/ViCAiha14J7wO1nqyPkBnP1yYu/
cthfkLxdhiEYN1v+uXGIc96sbMxwbXnXUCChmsT2RuJGqjt41LXjCOamOmBDEmHT
RQpPmCE+E1ula+8tyj8nvlbAMbyRor5RmR/MVfbGa19WbGi6OgDDywN+xHdCX30Z
NOrbs86bDqXGFX6VBa4vRfA4HNaRDZgsQ7BpXBPkKE8KgJF21fDmkkYr7dmIaZ6E
eG/WUdlefXqGTUR+nk4udipxrYLqS2iv1v1HxiU/kJ8raT10mmyV9MkuOarpNQcG
y/XqnCddiWWDy8v+gR92kRozXU0sK8LmdXLL29RPl/YZlcCrAi61Hig6C+2YF7T7
8vIypW+VT5I6vF6BP8M5MrIWTjNHRvk4GVTF9xkhupFCgR9ElzQ=
=sCkw
-----END PGP SIGNATURE-----
pgpyEzjBNWXLl.pgp
Description: PGP signature
--- End Message ---
