[Yahoo-eng-team] [Bug 1913461] [NEW] Need jinja templating in config files

2021-01-27 Thread subkryl 
Public bug reported:

It may be interresting to parse config files in
/etc/cloud/cloud.cfg/*.cfg for jinja templating.

As an example :

## template: jinja
#cloud-config

runcmd:
  - [hostname, "{{ ds.meta_data.tags.Name }}"]
  # - [hostname, "$(cloud-init query ds.meta_data.tags.Name)"]

** Affects: cloud-init
 Importance: Undecided
 Status: New


** Tags: templating

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to cloud-init.
https://bugs.launchpad.net/bugs/1913461

Title:
  Need jinja templating in config files

Status in cloud-init:
  New

Bug description:
  It may be interresting to parse config files in
  /etc/cloud/cloud.cfg/*.cfg for jinja templating.

  As an example :

  ## template: jinja
  #cloud-config

  runcmd:
- [hostname, "{{ ds.meta_data.tags.Name }}"]
# - [hostname, "$(cloud-init query ds.meta_data.tags.Name)"]

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-init/+bug/1913461/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp

[Yahoo-eng-team] [Bug 1896603] Re: ovn-octavia-provider: Cannot create listener due to alowed_cidrs validation

2021-01-27 Thread Corey Bryant 
** Changed in: ovn-octavia-provider (Ubuntu Hirsute)
   Status: Triaged => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1896603

Title:
  ovn-octavia-provider: Cannot create listener due to alowed_cidrs
  validation

Status in Ubuntu Cloud Archive:
  Triaged
Status in Ubuntu Cloud Archive victoria series:
  Triaged
Status in neutron:
  Fix Released
Status in ovn-octavia-provider package in Ubuntu:
  Fix Released
Status in ovn-octavia-provider source package in Groovy:
  Triaged
Status in ovn-octavia-provider source package in Hirsute:
  Fix Released

Bug description:
  [Impact]

   * Users cannot add listeners to an Octavia loadbalancer if it was created 
using the ovn provider
   * This makes the ovn provider unusable in Victoria and will force people to 
use the more painful alternative of using the Amphora driver

  [Test Case]

  $ openstack loadbalancer create --provider ovn --vip-subnet-id 
f92fa6ca-0f29-4b61-aeb6-db052caceff5 --name test-lb
  $ openstack loadbalancer show test-lb -c provisioning_status (Repeat until it 
shows as ACTIVE)
  $ openstack loadbalancer listener create --name listener1 --protocol TCP 
--protocol-port 80 test-lb
  Provider 'ovn' does not support a requested option: OVN provider does not 
support allowed_cidrs option (HTTP 501) (Request-ID: 
req-52a10944-951d-4414-8441-fe743444ed7c)

  Alternatively run the focal-victoria-ha-ovn functional test in the
  octavia charm

  
  [Where problems could occur]

   * Problems would be isolated to the managment of octavia
  loadbalancers within an openstack cloud. Specifically the patch fixes
  the checking of the allowed_cidr option when a listener is created or
  updated.

  
  [Other Info]

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1896603/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp

[Yahoo-eng-team] [Bug 1896603] Re: ovn-octavia-provider: Cannot create listener due to alowed_cidrs validation

2021-01-27 Thread Corey Bryant 
** Also affects: ovn-octavia-provider (Ubuntu Hirsute)
   Importance: Undecided
   Status: New

** Also affects: ovn-octavia-provider (Ubuntu Groovy)
   Importance: Undecided
   Status: New

** Also affects: cloud-archive
   Importance: Undecided
   Status: New

** Also affects: cloud-archive/victoria
   Importance: Undecided
   Status: New

** Changed in: cloud-archive/victoria
   Status: New => Triaged

** Changed in: cloud-archive/victoria
   Importance: Undecided => Critical

** Changed in: ovn-octavia-provider (Ubuntu Groovy)
   Importance: Undecided => Critical

** Changed in: ovn-octavia-provider (Ubuntu Groovy)
   Status: New => Triaged

** Changed in: ovn-octavia-provider (Ubuntu Hirsute)
   Status: New => Triaged

** Changed in: ovn-octavia-provider (Ubuntu Hirsute)
   Importance: Undecided => Critical

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1896603

Title:
  ovn-octavia-provider: Cannot create listener due to alowed_cidrs
  validation

Status in Ubuntu Cloud Archive:
  Triaged
Status in Ubuntu Cloud Archive victoria series:
  Triaged
Status in neutron:
  Fix Released
Status in ovn-octavia-provider package in Ubuntu:
  Triaged
Status in ovn-octavia-provider source package in Groovy:
  Triaged
Status in ovn-octavia-provider source package in Hirsute:
  Triaged

Bug description:
  [Impact]

   * Users cannot add listeners to an Octavia loadbalancer if it was created 
using the ovn provider
   * This makes the ovn provider unusable in Victoria and will force people to 
use the more painful alternative of using the Amphora driver

  [Test Case]

  $ openstack loadbalancer create --provider ovn --vip-subnet-id 
f92fa6ca-0f29-4b61-aeb6-db052caceff5 --name test-lb
  $ openstack loadbalancer show test-lb -c provisioning_status (Repeat until it 
shows as ACTIVE)
  $ openstack loadbalancer listener create --name listener1 --protocol TCP 
--protocol-port 80 test-lb
  Provider 'ovn' does not support a requested option: OVN provider does not 
support allowed_cidrs option (HTTP 501) (Request-ID: 
req-52a10944-951d-4414-8441-fe743444ed7c)

  Alternatively run the focal-victoria-ha-ovn functional test in the
  octavia charm

  
  [Where problems could occur]

   * Problems would be isolated to the managment of octavia
  loadbalancers within an openstack cloud. Specifically the patch fixes
  the checking of the allowed_cidr option when a listener is created or
  updated.

  
  [Other Info]

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1896603/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp

[Yahoo-eng-team] [Bug 1910213] Re: Live migration doesn't work with OVN and DPDK

2021-01-27 Thread Jakub Libosvar 
** Changed in: neutron
   Status: New => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1910213

Title:
  Live migration doesn't work with OVN and DPDK

Status in neutron:
  Fix Released

Bug description:
  Migration timeouts waiting for event related to network-vif-plugged
  and VM is not migrated to new host.

  The reason is that vif type in OVN matches only on OVS type and not on
  vhostuser.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1910213/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp

[Yahoo-eng-team] [Bug 1913447] [NEW] Unable to Swift create when running horizon on development server

2021-01-27 Thread Vishal Manchanda 
Public bug reported:

When you are running horizon on the development server(tox -e runserver)
and tries to create a swift container then you are not able to enter the
name for your server in the create container form although it runs fine
if you are using apache devstack env.

** Affects: horizon
 Importance: Undecided
 Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Dashboard (Horizon).
https://bugs.launchpad.net/bugs/1913447

Title:
  Unable to Swift create when running horizon on development server

Status in OpenStack Dashboard (Horizon):
  New

Bug description:
  When you are running horizon on the development server(tox -e
  runserver) and tries to create a swift container then you are not able
  to enter the name for your server in the create container form
  although it runs fine if you are using apache devstack env.

To manage notifications about this bug go to:
https://bugs.launchpad.net/horizon/+bug/1913447/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp

[Yahoo-eng-team] [Bug 1913451] [NEW] nova-lvm

2021-01-27 Thread Lee Yarwood 
Public bug reported:

Description
===

nova-lvm is often failing due to failures creating snapshots of
instances during tempest runs:

https://zuul.opendev.org/t/openstack/builds?job_name=nova-
lvm=master

I *think* swift that is being used by g-api as the backing store is
running out of space due to the nova-lvm job creating two file backed
24G volume groups, one for n-cpu and another for c-vol:

https://zuul.opendev.org/t/openstack/build/4f259f6d6cd444c2acea08a6e409a7f9/log/controller/logs/screen-n-cpu.txt#37491

Jan 27 11:34:04.214271 ubuntu-focal-rax-ord-0022741499 nova-
compute[90693]: ERROR oslo_messaging.rpc.server
glanceclient.exc.HTTPBadGateway: HTTP 502 Bad Gateway: Bad Gateway: The
proxy server received an invalid: response from an upstream server.:
Apache/2.4.41 (Ubuntu) Server at 10.209.161.68 Port 80

https://zuul.opendev.org/t/openstack/build/4f259f6d6cd444c2acea08a6e409a7f9/log/controller/logs/screen-g-api.txt

Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi [None 
req-a3f9e82f-5a4c-40fa-a102-7a1a3a7998a6 
tempest-ServerActionsTestJSON-1412104246 
tempest-ServerActionsTestJSON-1412104246-project] Caught error: Failed to add 
object to Swift.
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi Traceback (most recent 
call last):
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi   File 
"/usr/local/lib/python3.8/dist-packages/glance_store/_drivers/swift/store.py", 
line 1014, in add
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi 
self._delete_stale_chunks(
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi   File 
"/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in 
__exit__
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi self.force_reraise()
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi   File 
"/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in 
force_reraise
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi 
six.reraise(self.type_, self.value, self.tb)
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi   File 
"/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi raise value
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi   File 
"/usr/local/lib/python3.8/dist-packages/glance_store/_drivers/swift/store.py", 
line 1003, in add
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi 
manager.get_connection().put_object(
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi   File 
"/usr/local/lib/python3.8/dist-packages/swiftclient/client.py", line 2015, in 
put_object
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi return 
self._retry(reset_func, put_object, container, obj, contents,
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi   File 
"/usr/local/lib/python3.8/dist-packages/swiftclient/client.py", line 1898, in 
_retry
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi reset_func(func, 
*args, **kwargs)
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi   File 
"/usr/local/lib/python3.8/dist-packages/swiftclient/client.py", line 1995, in 
_default_reset
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi raise 
ClientException('put_object(%r, %r, ...) failure and no '
Jan 27 11:34:03.231171 ubuntu-focal-rax-ord-0022741499 
devstack@g-api.service[93210]: ERROR glance.common.wsgi 
swiftclient.exceptions.ClientException: put_object('glance', 
'0d60bd7d-7b97-4cb1-9105-19b917379ee4-5', ...) failure and no ability to 
reset contents for reupload.

https://zuul.opendev.org/t/openstack/build/4f259f6d6cd444c2acea08a6e409a7f9/log/controller/logs/screen-s-proxy.txt?severity=0

Jan 27 11:34:01.340337 ubuntu-focal-rax-ord-0022741499 proxy-server[81160]: 
ERROR with Object server 127.0.0.1:6613/sdb1 re: Trying to write to 
/AUTH_49fdf92e98d9449b92eddfd7528e34b8/glance/0d60bd7d-7b97-4cb1-9105-19b917379ee4-5:
 #012Traceback (most recent call

[Yahoo-eng-team] [Bug 1896603] Re: ovn-octavia-provider: Cannot create listener due to alowed_cidrs validation

2021-01-27 Thread Liam Young 
** Also affects: ovn-octavia-provider (Ubuntu)
   Importance: Undecided
   Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1896603

Title:
  ovn-octavia-provider: Cannot create listener due to alowed_cidrs
  validation

Status in neutron:
  Fix Released
Status in ovn-octavia-provider package in Ubuntu:
  New

Bug description:
  Kuryr-Kubernetes tests running with ovn-octavia-provider started to
  fail with "Provider 'ovn' does not support a requested option: OVN
  provider does not support allowed_cidrs option" showing up in the
  o-api logs.

  We've tracked that to check [1] getting introduced. Apparently it's
  broken and makes the request explode even if the property isn't set at
  all. Please take a look at output from python-openstackclient [2]
  where body I used is just '{"listener": {"loadbalancer_id": "faca9a1b-
  30dc-45cb-80ce-2ab1c26b5521", "protocol": "TCP", "protocol_port": 80,
  "admin_state_up": true}}'.

  Also this is all over your gates as well, see o-api log [3]. Somehow
  ovn-octavia-provider tests skip 171 results there, so that's why it's
  green.

  [1] 
https://opendev.org/openstack/ovn-octavia-provider/src/branch/master/ovn_octavia_provider/driver.py#L142
  [2] http://paste.openstack.org/show/798197/
  [3] 
https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_4ba/751085/7/gate/ovn-octavia-provider-v2-dsvm-scenario/4bac575/controller/logs/screen-o-api.txt

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1896603/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp

[Yahoo-eng-team] [Bug 1913401] [NEW] Timeout during creation of interface in functional tests

2021-01-27 Thread Slawek Kaplonski 
Public bug reported:

It happens from time to time that some functional test is failing due to 
timeout during creation of the interface in a bridge.
Example of such failure: 
https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c2e/767922/9/gate/neutron-functional-with-uwsgi/c2e764b/testr_results.html

Stack trace:

ft1.1: 
neutron.tests.functional.agent.linux.test_linuxbridge_arp_protect.LinuxBridgeARPSpoofTestCase.test_arp_correct_protectiontesttools.testresult.real._StringException:
 traceback-1: {{{
Traceback (most recent call last):
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/fixtures/fixture.py",
 line 197, in setUp
self._setUp()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/common/net_helpers.py",
 line 908, in _setUp
self.bridge = self._create_bridge()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/common/net_helpers.py",
 line 932, in _create_bridge
return common_base.create_resource(
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/common/base.py", 
line 47, in create_resource
return creation_func(name, *args, **kwargs)
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/agent/linux/bridge_lib.py",
 line 78, in addbr
bridge.link.create()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/agent/linux/ip_lib.py", 
line 468, in create
privileged.create_interface(self.name, self._parent.namespace,
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/oslo_privsep/priv_context.py",
 line 247, in _wrap
return self.channel.remote_call(name, args, kwargs)
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/oslo_privsep/daemon.py",
 line 214, in remote_call
result = self.send_recv((Message.CALL.value, name, args, kwargs))
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/oslo_privsep/comm.py",
 line 172, in send_recv
reply = future.result()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/oslo_privsep/comm.py",
 line 109, in result
self.condvar.wait()
  File "/usr/lib/python3.8/threading.py", line 302, in wait
waiter.acquire()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/eventlet/semaphore.py",
 line 120, in acquire
hubs.get_hub().switch()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/eventlet/hubs/hub.py",
 line 313, in switch
return self.greenlet.switch()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/eventlet/hubs/hub.py",
 line 365, in run
self.wait(sleep_time)
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/eventlet/hubs/poll.py",
 line 80, in wait
presult = self.do_poll(seconds)
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/eventlet/hubs/epolls.py",
 line 31, in do_poll
return self.poll.poll(seconds)
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/fixtures/_fixtures/timeout.py",
 line 52, in signal_handler
raise TimeoutException()
fixtures._fixtures.timeout.TimeoutException

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/fixtures/fixture.py",
 line 208, in setUp
raise SetupError(details)
fixtures.fixture.SetupError: {}
}}}

Traceback (most recent call last):
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/fixtures/fixture.py",
 line 197, in setUp
self._setUp()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/common/net_helpers.py",
 line 908, in _setUp
self.bridge = self._create_bridge()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/common/net_helpers.py",
 line 932, in _create_bridge
return common_base.create_resource(
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/common/base.py", 
line 47, in create_resource
return creation_func(name, *args, **kwargs)
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/agent/linux/bridge_lib.py",
 line 78, in addbr
bridge.link.create()
  File 
"/home/zuul/src/opendev.org/openstack/neutron/neutron/agent/linux/ip_lib.py", 
line 468, in create
privileged.create_interface(self.name, self._parent.namespace,
  File 
"/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional/lib/python3.8/site-packages/oslo_privsep/priv_context.py",
 line 247, in _wrap
return