Re: [openstack-dev] [gate][neutron][infra] tempest jobs timing out due to general sluggishness of the node?

2017-02-10 Thread Clark Boylan
On Fri, Feb 10, 2017, at 08:21 AM, Morales, Victor wrote: > > On 2/9/17, 10:59 PM, "Ihar Hrachyshka" wrote: > > >Hi all, > > > >I noticed lately a number of job failures in neutron gate that all > >result in job timeouts. I describe > >gate-tempest-dsvm-neutron-dvr-ubuntu-xenial job below, thoug

Re: [openstack-dev] [gate][neutron][infra] tempest jobs timing out due to general sluggishness of the node?

2017-02-10 Thread Clark Boylan
On Fri, Feb 10, 2017, at 10:54 AM, Ihar Hrachyshka wrote: > Oh nice, I haven't seen that. It does give (virtualized) CPU model > types. I don't see a clear correlation between models and > failures/test times though. We of course miss some more details, like > flags being emulated, but I doubt it w

[openstack-dev] [All][QA][Infra] PTG sessions on Debugging test job failures

2017-02-15 Thread Clark Boylan
Hello, The Infra and QA teams will be having two sessions in the "projector" rooms at the PTG to go over debugging of test job failures. Current plan is to run a session on Tuesday for the Monday/Tuesday crowd and another on Thursday for the Wednesday/Thursday/Friday crowd. Both sessions are at 1:

Re: [openstack-dev] [third-party][ci] Transition your devstack-gate based CI to local.conf

2017-02-23 Thread Clark Boylan
On Wed, Feb 22, 2017, at 09:36 PM, Mikhail Medvedev wrote: > Hi third-party CI operators, > > This is for those who use devstack-gate with localrc. You might have > started seeing failures since [1] landed. This is due to a few > devstack settings now being ignored. When devstack sees that you hav

[openstack-dev] [all][ci][infra] Small network interface MTUs on test nodes

2018-06-26 Thread Clark Boylan
Hello everyone, We now have more than one cloud provider giving us test node resources where we can expect network interfaces to have MTUs less that 1500. This is a side effect of running Neutron with overlay networking in the cloud providing the test resources. Considering we've largely made t

Re: [openstack-dev] [requirements][infra] Maintaining constraints for several python versions

2018-07-12 Thread Clark Boylan
On Wed, Jul 11, 2018, at 9:34 PM, Tony Breeds wrote: > Hi Folks, > We have a pit of a problem in openstack/requirements and I'd liek to > chat about it. > > Currently when we generate constraints we create a venv for each > (system) python supplied on the command line, install all of > global-

Re: [openstack-dev] OpenStack lagging behind 2 major python versions: we need a Python 3.7 gate

2018-07-18 Thread Clark Boylan
On Thu, Jul 12, 2018, at 1:38 PM, Thomas Goirand wrote: > Hi everyone! > > It's yet another of these emails where I'm going to complain out of > frustration because of OpenStack having bugs when running with the > newest stuff... Sorry in advance ! :) > > tl;dr: It's urgent, we need Python 3.7 uw

Re: [openstack-dev] [infra][nova] Running NFV tests in CI

2018-07-24 Thread Clark Boylan
On Tue, Jul 24, 2018, at 9:23 AM, Artom Lifshitz wrote: > Hey all, > > tl;dr Humbly requesting a handful of nodes to run NFV tests in CI > > Intel has their NFV tests tempest plugin [1] and manages a third party > CI for Nova. Two of the cores on that project (Stephen Finucane and > Sean Mooney)

Re: [openstack-dev] [infra][nova] Running NFV tests in CI

2018-07-24 Thread Clark Boylan
On Tue, Jul 24, 2018, at 10:21 AM, Artom Lifshitz wrote: > On Tue, Jul 24, 2018 at 12:30 PM, Clark Boylan wrote: > > On Tue, Jul 24, 2018, at 9:23 AM, Artom Lifshitz wrote: > >> Hey all, > >> > >> tl;dr Humbly requesting a handful of nodes to run NFV tests

[openstack-dev] [all] Gerrit project renaming Friday August 3 at 16:00UTC

2018-08-01 Thread Clark Boylan
Hello everyone, The infra team will be renaming a couple of projects in Gerrit on Friday starting at 16:00UTC. This requires us to restart Gerrit on review.openstack.org. The total noticeable downtime should be no more than about 10 minutes. If you would like to follow along, the current proce

Re: [openstack-dev] [nova] CI job running functional against a mysql DB

2018-08-13 Thread Clark Boylan
On Mon, Aug 13, 2018, at 1:50 AM, Matthew Booth wrote: > I was reviewing https://review.openstack.org/#/c/504885/ . The change > looks good to me and I believe the test included exercises the root > cause of the problem. However, I'd like to be certain that the test > has been executed against MySQ

Re: [openstack-dev] [goals][python3] mixed versions?

2018-09-12 Thread Clark Boylan
On Wed, Sep 12, 2018, at 10:23 AM, Jim Rollenhagen wrote: > The process of operators upgrading Python versions across their fleet came > up this morning. It's fairly obvious that operators will want to do this in > a rolling fashion. > > Has anyone considered doing this in CI? For example, running

Re: [openstack-dev] [cinder][infra] Remove driverfixes/ocata branch

2018-09-17 Thread Clark Boylan
On Mon, Sep 17, 2018, at 8:00 AM, Sean McGinnis wrote: > Hello Cinder and Infra teams. Cinder needs some help from infra or some > pointers on how to proceed. > > tl;dr - The openstack/cinder repo had a driverfixes/ocata branch created for > fixes that no longer met the more restrictive phase II s

Re: [openstack-dev] [cinder][infra] Remove driverfixes/ocata branch

2018-09-17 Thread Clark Boylan
On Mon, Sep 17, 2018, at 8:53 AM, Jay S Bryant wrote: > > > On 9/17/2018 10:46 AM, Sean McGinnis wrote: > >>> Plan > >>> > >>> We would now like to have the driverfixes/ocata branch deleted so there > >>> is no > >>> confusion about where backports should go and we don't accidentally get >

Re: [openstack-dev] [python3] tempest and grenade conversion to python 3.6

2018-09-18 Thread Clark Boylan
On Tue, Sep 18, 2018, at 9:46 AM, Nate Johnston wrote: > Hello python 3.6 champions, > > I have looked around a little, and I don't see a method for me to > specifically select the version of python that the tempest and grenade > jobs for my project (neutron) are using. I assume one of four thing

[openstack-dev] [all] Zuul job backlog

2018-09-19 Thread Clark Boylan
Hello everyone, You may have noticed there is a large Zuul job backlog and changes are not getting CI reports as quickly as you might expect. There are several factors interacting with each other to make this the case. The short version is that one of our clouds is performing upgrades and has b

Re: [openstack-dev] [all] Zuul job backlog

2018-09-28 Thread Clark Boylan
On Wed, Sep 19, 2018, at 12:11 PM, Clark Boylan wrote: > Hello everyone, > > You may have noticed there is a large Zuul job backlog and changes are > not getting CI reports as quickly as you might expect. There are several > factors interacting with each other to make this the

Re: [openstack-dev] [all] Zuul job backlog

2018-10-04 Thread Clark Boylan
On Thu, Oct 4, 2018, at 12:16 AM, Abhishek Kekane wrote: > Hi, > Could you please point out some of the glance functional tests which are > failing and causing this resets? > I will like to put some efforts towards fixing those. http://status.openstack.org/elastic-recheck/data/integrated_gate.html

Re: [openstack-dev] [manila] [infra] remove driverfixes/ocata branch [was: Re: [cinder][infra] Remove driverfixes/ocata branch]

2018-10-05 Thread Clark Boylan
On Fri, Oct 5, 2018, at 12:44 PM, Tom Barron wrote: > Clark, would you be so kind, at your conveniencew, as to remove the > manila driverfixes/ocata branch? > > There are no open changes on the branch and `git log > origin/driverfixes/ocata ^origin/stable/ocata --no-merges --oneline` > reveals

Re: [openstack-dev] [oslo][taskflow] Thoughts on moving taskflow out of openstack/oslo

2018-10-10 Thread Clark Boylan
On Wed, Oct 10, 2018, at 11:35 AM, Greg Hill wrote: > > I'm not sure how using pull requests instead of Gerrit changesets would > > help "core reviewers being pulled on to other projects"? > > > > The 2 +2 requirement works for larger projects with a lot of contributors. > When you have only 3 reg

Re: [openstack-dev] [tripleo][ci] Having more that one queue for gate pipeline at tripleo

2018-10-11 Thread Clark Boylan
On Thu, Oct 11, 2018, at 7:17 AM, Ben Nemec wrote: > > > On 10/11/18 8:53 AM, Felix Enrique Llorente Pastora wrote: > > So for example, I don't see why changes at tripleo-quickstart can be > > reset if tripleo-ui fails, this is the kind of thing that maybe can be > > optimize. > > Because if t

Re: [openstack-dev] Proposal for a process to keep up with Python releases

2018-10-19 Thread Clark Boylan
On Fri, Oct 19, 2018, at 8:17 AM, Zane Bitter wrote: > There hasn't been a Python 2 release in 8 years, and during that time > we've gotten used to the idea that that's the way things go. However, > with the switch to Python 3 looming (we will drop support for Python 2 > in the U release[1]), hi

Re: [openstack-dev] Proposal for a process to keep up with Python releases

2018-10-22 Thread Clark Boylan
On Mon, Oct 22, 2018, at 7:33 AM, Thomas Goirand wrote: > On 10/19/18 5:17 PM, Zane Bitter wrote: snip > > Integration Tests > > - > > > > Integration tests do test, amongst other things, integration with > > non-openstack-supplied things in the distro, so it's important that we

[openstack-dev] Zuul Queue backlogs and resource usage

2018-10-30 Thread Clark Boylan
Hello everyone, A little while back I sent email explaining how the gate queues work and how fixing bugs helps us test and merge more code. All of this still is still true and we should keep pushing to improve our testing to avoid gate resets. Last week we migrated Zuul and Nodepool to a new Zo

Re: [openstack-dev] [tripleo] Zuul Queue backlogs and resource usage

2018-10-30 Thread Clark Boylan
On Tue, Oct 30, 2018, at 10:42 AM, Alex Schultz wrote: > On Tue, Oct 30, 2018 at 11:36 AM Ben Nemec wrote: > > > > Tagging with tripleo since my suggestion below is specific to that project. > > > > On 10/30/18 11:03 AM, Clark Boylan wrote: > > > Hello everyon

Re: [openstack-dev] [tripleo] Zuul Queue backlogs and resource usage

2018-10-30 Thread Clark Boylan
On Tue, Oct 30, 2018, at 1:01 PM, Ben Nemec wrote: > > > On 10/30/18 1:25 PM, Clark Boylan wrote: > > On Tue, Oct 30, 2018, at 10:42 AM, Alex Schultz wrote: > >> On Tue, Oct 30, 2018 at 11:36 AM Ben Nemec wrote: > >>> > >>> Tagging with tripl

Re: [openstack-dev] [oslo.db] [release] opportunistic tests breaking randomly

2016-09-14 Thread Clark Boylan
On Wed, Sep 14, 2016, at 10:01 AM, Sean Dague wrote: > On 09/14/2016 12:06 PM, Roman Podoliaka wrote: > > Hmm, looks like we now run more testr workers in parallel (8 instead of 4): > > > > http://logs.openstack.org/76/335676/7/check/gate-nova-python34-db/6841fce/console.html.gz > > http://logs.op

[openstack-dev] Devstack, Tempest, and TLS

2016-09-23 Thread Clark Boylan
Earlier this month there was a thread on replacing stud in devstack for the tls-proxy service [0]. Over the last week or so a bunch of work has happened around this so I figured I would send an update. Tempest passes against devstack with some edits to one of the object tests to properly handle 30

[openstack-dev] Gerrit login issues and zuul-cloner related job failures

2016-09-26 Thread Clark Boylan
Hello, Just a heads up that Launchpad/Ubuntu One's openid services is functioning again and logins for Gerrit and other services should now be functional. We also saw a bunch of failing jobs this morning due to a misconfiguration of zuul-cloner. This change has been reverted and jobs are happy ag

Re: [openstack-dev] Devstack, Tempest, and TLS

2016-09-27 Thread Clark Boylan
On Fri, Sep 23, 2016, at 05:04 PM, Clark Boylan wrote: > Earlier this month there was a thread on replacing stud in devstack for > the tls-proxy service [0]. Over the last week or so a bunch of work has > happened around this so I figured I would send an update. > > Tempest

Re: [openstack-dev] Devstack, Tempest, and TLS

2016-09-28 Thread Clark Boylan
On Tue, Sep 27, 2016, at 02:58 PM, Clark Boylan wrote: > Once multinode testing has tls-proxy enabled the next thing I think we > should be talking about is enabling this by default in devstack. As > mentioned before ironic doesn't work due to IPA images not trusting > glanc

[openstack-dev] TC Candidacy

2016-09-29 Thread Clark Boylan
I am standing as a candidate for a seat on the OpenStack Technical Committee. I have worked with OpenStack since the Diablo days and have done it full time since joining the OpenStack Infrastructure team during the Folsom cycle. During this time I have been an OpenStack developer, operator, and us

Re: [openstack-dev] [neutron] clean up your git checkout!

2016-09-30 Thread Clark Boylan
I want to say this happens if .tox is in your gitignore list. Just run tox with the -r flag which will rebuild the tox envs. Clark On Fri, Sep 30, 2016, at 11:22 AM, Amrith Kumar wrote: > I tried that but even with it in place, a .tox directory with a ton of > .pyc's was left around after the tes

Re: [openstack-dev] [neutron] clean up your git checkout!

2016-09-30 Thread Clark Boylan
does in fact clean out the .tox directory. > > -amrith > > > -Original Message- > > From: Clark Boylan [mailto:cboy...@sapwetik.org] > > Sent: Friday, September 30, 2016 2:50 PM > > To: openstack-dev@lists.openstack.org > > Subject: Re: [openstack-dev] [neutr

Re: [openstack-dev] [tc] open question to the candidates

2016-10-03 Thread Clark Boylan
On Mon, Oct 3, 2016, at 08:30 AM, gordon chung wrote: > the TC has historically been a reactive council that lets others ask for > change and acts as the final approver. do you believe the TC should be a > proactive committee that initiates change and if yes, to what scope? > more generally, wha

[openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Clark Boylan
Hello everyone, Currently multinode testing + neutron is broken in clouds that use portions of 10.0.0.0/8 for their networking due to route conflicts with devstack + neutron deployments. https://bugs.launchpad.net/bugs/1629133 is tracking the issue for us. I would like to see this get resolved pro

Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Clark Boylan
On Tue, Oct 11, 2016, at 04:32 PM, Armando M. wrote: > On 11 October 2016 at 14:09, Clark Boylan wrote: > > > Hello everyone, > > > > Currently multinode testing + neutron is broken in clouds that use > > portions of 10.0.0.0/8 for their networking due to rou

Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Clark Boylan
On Tue, Oct 11, 2016, at 04:51 PM, Armando M. wrote: > On 11 October 2016 at 16:43, Clark Boylan wrote: > > > On Tue, Oct 11, 2016, at 04:32 PM, Armando M. wrote: > > > On 11 October 2016 at 14:09, Clark Boylan wrote: > > > > > > > Hello everyone, &

Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Clark Boylan
On Tue, Oct 11, 2016, at 05:01 PM, Armando M. wrote: > On 11 October 2016 at 16:54, Clark Boylan wrote: > > > On Tue, Oct 11, 2016, at 04:51 PM, Armando M. wrote: > > > On 11 October 2016 at 16:43, Clark Boylan wrote: > > > > > > > On Tue, O

Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Clark Boylan
w.openstack.org/#/c/356026/4/lib/neutron_ > plugins/services/l3 > > On Tue, Oct 11, 2016 at 5:32 PM, Armando M. wrote: > > > > > > > On 11 October 2016 at 14:09, Clark Boylan wrote: > > > >> Hello everyone, > >> > >> Currently multinod

Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Clark Boylan
On Tue, Oct 11, 2016, at 05:58 PM, Carl Baldwin wrote: > On Tue, Oct 11, 2016 at 6:26 PM, Clark Boylan > wrote: > > > On Tue, Oct 11, 2016, at 05:14 PM, Carl Baldwin wrote: > > > I found this [1] added here [2]. Since the provider is using 10.0.0.0/8 > > > on &g

Re: [openstack-dev] [keystone][qa] PCI-DSS (security compliance tests)

2016-10-14 Thread Clark Boylan
On Fri, Oct 14, 2016, at 08:21 AM, Rodrigo Duarte wrote: > Hi all, > > Recently in keystone we got merged the PCI-DSS feature [1]. Basically, we > have new settings that enforce password security practices. For example, > if > we set the password history setting to 2, a user won't be able to updat

Re: [openstack-dev] [all] running non-devstack jobs in Python projects aka "it works outside devstack"

2016-10-14 Thread Clark Boylan
On Thu, Oct 13, 2016, at 05:47 PM, Emilien Macchi wrote: > Greetings OpenStack, > > == Background > > Since the beginning of OpenStack (or almost), devstack has been used > as a common tool to deploy OpenStack in CI environment. Most of > OpenStack projects (if not all) that are written in Python

Re: [openstack-dev] [devstack][CI] Etcd server setuped in devstack script can not be reached in CI unit tests

2016-10-18 Thread Clark Boylan
On Tue, Oct 18, 2016, at 07:08 PM, Wenzhi Yu (yuywz) wrote: > Hi all, > > I intended to use etcd as data store for Zun project. So I installed > docker and started a docker container with an etcd server running in it > using > devstack script. The etcd server listens on 127.0.0.1:2379 for client

Re: [openstack-dev] [Zun][Infra] Random internet disconnection in the gate

2016-11-07 Thread Clark Boylan
On Mon, Nov 7, 2016, at 01:13 PM, Hongbin Lu wrote: > Hi infra team, > > I am working on the Zun project and we experienced random failure within > the gate. The error is as below: > > 2016-10-16 00:30:49.359 | ++ > /opt/stack/new/zun/devstack/lib/zun:install_etcd_server:316 : curl -L > htt

[openstack-dev] [All] Finish test job transition to Ubuntu Xenial

2016-11-07 Thread Clark Boylan
Hello everyone, The infra team would really like to get the Ubuntu Xenial for testing transition completed early this cycle. We are planning to switch any jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on December 6, 2016. That gives us about a month from today to more gracefully

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

2016-11-07 Thread Clark Boylan
On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > How can you do this? First double check your job logs to see where your > tests are running. The first few lines of your job console logs should > say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial. >

Re: [openstack-dev] [openstack-infra] Please add a initial core member to meteos-core.

2016-11-08 Thread Clark Boylan
On Mon, Nov 7, 2016, at 11:25 PM, Hiroyuki Eguchi wrote: > Hello Infra Team. > > I've created new projects named meteos and python-meteosclient. > Cloud you please add me (Hiroyuki Eguchi ) > as a initial core member of meteos-core ? Done. Let us know if you have any issues, concerns, or question

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

2016-11-14 Thread Clark Boylan
On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > Hello everyone, > > The infra team would really like to get the Ubuntu Xenial for testing > transition completed early this cycle. We are planning to switch any > jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenia

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

2016-11-14 Thread Clark Boylan
On Mon, Nov 14, 2016, at 05:21 PM, Neil Jerram wrote: > On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan wrote: > > > If you have jobs still running on trusty the next step is to fire up a > > Xenial instance locally and run that test to see if it works. > > > > Ca

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

2016-11-21 Thread Clark Boylan
On Mon, Nov 14, 2016, at 03:30 PM, Clark Boylan wrote: > On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote: > > Hello everyone, > > > > The infra team would really like to get the Ubuntu Xenial for testing > > transition completed early this cycle. We are planning

Re: [openstack-dev] [kolla][release][requirements] providing constraints for transitive dependencies

2016-11-27 Thread Clark Boylan
On Sun, Nov 27, 2016, at 06:53 PM, Jeffrey Zhang wrote: > FWIW, python dependencies are fixed. > Kolla is using the following command in Dockerfile for source code > installation. > > pip install -u /requirements/upper-constrains.txt /nova I think you need a to use the -c option to set the co

<    1   2   3   4