Public bug reported: Neutron-dynamic-routing scenario jobs in neutron-tempest-plugin repo are failing all the time since few days.
Example of failure https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_cee/691855/1/check /neutron-tempest-plugin-dynamic-routing/cee3785/testr_results.html.gz It seems that this happens due to error in service plugin, see neutron server log: Notify callbacks ['neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854649727'] for bgp_speaker, after_create {{(pid=19640) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager [None req-c747f1f4-6424-4812-b7e4-cfc5c083fd81 tempest-BgpSpeakerTestJSON-1886159994 tempest-BgpSpeakerTestJSON-1886159994] Error during notification for neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854649727 bgp_speaker, after_create: TypeError: bind() takes 4 positional arguments but 5 were given Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py", line 197, in _notify_loop Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, **kwargs) Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron-dynamic-routing/neutron_dynamic_routing/services/bgp/scheduler/bgp_dragent_scheduler.py", line 202, in schedule_bgp_speaker_callback Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager plugin.schedule_bgp_speaker(ctx, payload['bgp_speaker']) Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron-dynamic-routing/neutron_dynamic_routing/db/bgp_dragentscheduler_db.py", line 100, in schedule_bgp_speaker Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager created_bgp_speaker) Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/scheduler/base_scheduler.py", line 55, in schedule Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager context, chosen_agents, resource['id'], force_scheduling) Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager TypeError: bind() takes 4 positional arguments but 5 were given Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager It is caused by https://review.opendev.org/#/c/288271/ which we merged recently and revert of this patch is already proposed in https://review.opendev.org/#/c/691710/ ** Affects: neutron Importance: Critical Assignee: Slawek Kaplonski (slaweq) Status: Confirmed ** Tags: gate-failure l3-bgp -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1850626 Title: neutron-dynamic-routing: TypeError: bind() takes 4 positional arguments but 5 were given Status in neutron: Confirmed Bug description: Neutron-dynamic-routing scenario jobs in neutron-tempest-plugin repo are failing all the time since few days. Example of failure https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_cee/691855/1/check /neutron-tempest-plugin-dynamic-routing/cee3785/testr_results.html.gz It seems that this happens due to error in service plugin, see neutron server log: Notify callbacks ['neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854649727'] for bgp_speaker, after_create {{(pid=19640) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager [None req-c747f1f4-6424-4812-b7e4-cfc5c083fd81 tempest-BgpSpeakerTestJSON-1886159994 tempest-BgpSpeakerTestJSON-1886159994] Error during notification for neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854649727 bgp_speaker, after_create: TypeError: bind() takes 4 positional arguments but 5 were given Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py", line 197, in _notify_loop Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, **kwargs) Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron-dynamic-routing/neutron_dynamic_routing/services/bgp/scheduler/bgp_dragent_scheduler.py", line 202, in schedule_bgp_speaker_callback Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager plugin.schedule_bgp_speaker(ctx, payload['bgp_speaker']) Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron-dynamic-routing/neutron_dynamic_routing/db/bgp_dragentscheduler_db.py", line 100, in schedule_bgp_speaker Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager created_bgp_speaker) Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/scheduler/base_scheduler.py", line 55, in schedule Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager context, chosen_agents, resource['id'], force_scheduling) Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager TypeError: bind() takes 4 positional arguments but 5 were given Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager It is caused by https://review.opendev.org/#/c/288271/ which we merged recently and revert of this patch is already proposed in https://review.opendev.org/#/c/691710/ To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1850626/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : [email protected] Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
