Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Clark Boylan]

On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote:
> Hello everyone,
> 
> The infra team would really like to get the Ubuntu Xenial for testing
> transition completed early this cycle. We are planning to switch any
> jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on
> December 6, 2016. That gives us about a month from today to more
> gracefully migrate jobs while still getting it done early enough in the
> cycle to fix any issues and put it behind us. Would be great for project
> teams to test if their jobs run on Xenial and propose updates to
> openstack-infra/project-config as necessary to switch to Ubuntu Xenial.

After much editing of yaml the last few days this work is done. If you
notice that we missed something please let us know and we will get it
sorted out. Generally though you should notice that changes to master no
longer have tests run on Trusty.

Thanks again to all those that helped get their projects ready ahead of
time and to those that helped with the transition this week.

Clark

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Amrith Kumar]

Clark, for Trove, I'm in the process of finishing this and there is a change
[1] that is currently up for review (I have to incorporate changes to
reflect Andreas' comments).

If you find something amiss with the Trove jobs (trove, trove client,
trove-integration or dashboard), please let me know and I'll fix it up
pronto.

Thanks,

-amrith

[1] https://review.openstack.org/#/c/405018/

> -Original Message-
> From: Clark Boylan [mailto:cboy...@sapwetik.org]
> Sent: Monday, December 5, 2016 4:53 PM
> To: openstack-dev@lists.openstack.org
> Subject: Re: [openstack-dev] [All] Finish test job transition to Ubuntu
Xenial
> 
> On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote:
> > Hello everyone,
> >
> > The infra team would really like to get the Ubuntu Xenial for testing
> > transition completed early this cycle. We are planning to switch any
> > jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on
> > December 6, 2016. That gives us about a month from today to more
> > gracefully migrate jobs while still getting it done early enough in
> > the cycle to fix any issues and put it behind us. Would be great for
> > project teams to test if their jobs run on Xenial and propose updates
> > to openstack-infra/project-config as necessary to switch to Ubuntu
Xenial.
> 
> As a heads up the Infra team has begun pushing changes to start this work.
> The vast majority of them likely won't start merging until tomorrow,
however
> you may start to see changes going in particularly for experimental and
non
> voting jobs.
> 
> Thank you to all the teams that got ahead of this and worked to make the
> transition earlier.
> 
> One thing that pops out at me as we go through this work is that we have a
> lot of experimental and non voting jobs that need to be updated.
> Considering that experimental jobs in particular and often non voting jobs
> are supposed to be works in progress to get to voting, does the lack of
> interest in updating these from the projects themselves imply the jobs are
> dead and not needed? Maybe we should be doing cleanup of old forgotten
> experimental and non voting jobs that aren't being used?
> 
> Thank you,
> Clark
> 
> __
> 
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-
> requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


smime.p7s
Description: S/MIME cryptographic signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Clark Boylan]

On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote:
> Hello everyone,
> 
> The infra team would really like to get the Ubuntu Xenial for testing
> transition completed early this cycle. We are planning to switch any
> jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on
> December 6, 2016. That gives us about a month from today to more
> gracefully migrate jobs while still getting it done early enough in the
> cycle to fix any issues and put it behind us. Would be great for project
> teams to test if their jobs run on Xenial and propose updates to
> openstack-infra/project-config as necessary to switch to Ubuntu Xenial.

As a heads up the Infra team has begun pushing changes to start this
work. The vast majority of them likely won't start merging until
tomorrow, however you may start to see changes going in particularly for
experimental and non voting jobs.

Thank you to all the teams that got ahead of this and worked to make the
transition earlier.

One thing that pops out at me as we go through this work is that we have
a lot of experimental and non voting jobs that need to be updated.
Considering that experimental jobs in particular and often non voting
jobs are supposed to be works in progress to get to voting, does the
lack of interest in updating these from the projects themselves imply
the jobs are dead and not needed? Maybe we should be doing cleanup of
old forgotten experimental and non voting jobs that aren't being used?

Thank you,
Clark

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Neil Jerram]

On Tue, Nov 22, 2016 at 2:00 PM Neil Jerram  wrote:

> After fixing those...  I see that the reproduce.sh script appears to do
> DevStack setup correctly, but not to run any Tempest tests.  Is
> reproduce.sh supposed to run the Tempest tests as well?
>
>
Sorry, please ignore that.  I still have a Xenial-related issue in my
DevStack setup.

Neil
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Neil Jerram]

On Tue, Nov 22, 2016 at 11:41 AM Neil Jerram  wrote:

> On Tue, Nov 22, 2016 at 10:58 AM Neil Jerram  wrote:
>
> On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan  wrote:
>
> [...]
>
> If you have jobs still running on trusty the next step is to fire up a
> Xenial instance locally and run that test to see if it works. Usually
> this will mean running the appropriate tox target or if using
> devstack-gate you can grab the reproduce.sh script for that job and run
> that script locally.
>
>
> Is there doc somewhere about what needs adding to a fresh Xenial server
> image, to allow reproduce.sh script to run successfully?
>
> So far, I've hit:
> - virtualenv
> - gcc
>
> - python-all-dev
>
> Then I think I'm into genuine issues with my DevStack plugin...
>

After fixing those...  I see that the reproduce.sh script appears to do
DevStack setup correctly, but not to run any Tempest tests.  Is
reproduce.sh supposed to run the Tempest tests as well?

Thanks,
  Neil
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Neil Jerram]

On Tue, Nov 22, 2016 at 10:58 AM Neil Jerram  wrote:

> On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan  wrote:
>
> [...]
>
> If you have jobs still running on trusty the next step is to fire up a
> Xenial instance locally and run that test to see if it works. Usually
> this will mean running the appropriate tox target or if using
> devstack-gate you can grab the reproduce.sh script for that job and run
> that script locally.
>
>
> Is there doc somewhere about what needs adding to a fresh Xenial server
> image, to allow reproduce.sh script to run successfully?
>
> So far, I've hit:
> - virtualenv
> - gcc
>
- python-all-dev

Then I think I'm into genuine issues with my DevStack plugin...


> Neil
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Denis Makogon]

Hello Neil

See comments inline

Kind regards,
Denis Makogon

2016-11-22 12:58 GMT+02:00 Neil Jerram :

> On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan  wrote:
>
>> [...]
>
> If you have jobs still running on trusty the next step is to fire up a
>> Xenial instance locally and run that test to see if it works. Usually
>> this will mean running the appropriate tox target or if using
>> devstack-gate you can grab the reproduce.sh script for that job and run
>> that script locally.
>>
>>
> Is there doc somewhere about what needs adding to a fresh Xenial server
> image, to allow reproduce.sh script to run successfully?
>
> So far, I've hit:
> - virtualenv
>

In Python 3.x you can create virtualenv with command: python3 -m virtualenv
.venv


> - gcc
>
> Neil
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Neil Jerram]

On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan  wrote:

> [...]

If you have jobs still running on trusty the next step is to fire up a
> Xenial instance locally and run that test to see if it works. Usually
> this will mean running the appropriate tox target or if using
> devstack-gate you can grab the reproduce.sh script for that job and run
> that script locally.
>
>
Is there doc somewhere about what needs adding to a fresh Xenial server
image, to allow reproduce.sh script to run successfully?

So far, I've hit:
- virtualenv
- gcc

Neil
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Clark Boylan]

On Mon, Nov 14, 2016, at 03:30 PM, Clark Boylan wrote:
> On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote:
> > Hello everyone,
> > 
> > The infra team would really like to get the Ubuntu Xenial for testing
> > transition completed early this cycle. We are planning to switch any
> > jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on
> > December 6, 2016. That gives us about a month from today to more
> > gracefully migrate jobs while still getting it done early enough in the
> > cycle to fix any issues and put it behind us. Would be great for project
> > teams to test if their jobs run on Xenial and propose updates to
> > openstack-infra/project-config as necessary to switch to Ubuntu Xenial.
> 
> Just a friendly reminder that this is still happening. We will be
> updating any jobs running on Trusty that should be running on Xenial on
> December 6th. I have seen a few projects jump on this and start making
> the necessary changes. Thank you for doing that!
> 
> As always feel free to ask questions or ping us (the infra team) for
> help if you need it. 

Sorry for being a pest but Andreas wanted us to overcommunicate this so
here is your weekly reminder :)
Don't forget this is happening December 6th. That said I have been
really happy with the turnout on fixing these sorts of issues. Thank you
to everyone who has shown up to update their project job configs.

One thing that has occurred to me that would've been nice to have in
previous emails is if we use a common topic for these changes it may
help reviews get through quicker. Maybe we should try using "xenial" as
a common topic then reviewers can search for topic:xenial in gerrit.

Thank you,
Clark

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Jakub Libosvar]

On 18/11/2016 12:17, Jakub Libosvar wrote:

On 07/11/2016 23:04, Clark Boylan wrote:

On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote:

How can you do this? First double check your job logs to see where your
tests are running. The first few lines of your job console logs should
say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial.
Any changes to master should not run on Trusty and instead should run on
Xenial.


Point of clarification here, stable/newton and master jobs should both
be transitioned to Xenial.


I noticed gate-grenade-dsvm-ubuntu-xenial job is run on stable Newton
branch for devstack. It basically means Mitaka devstack is used to
deploy on Xenial but Xenial is not among supported distros in Mitaka [1].

What is recommended way of upgrade for Ubuntu users running Mitaka on
Trusy? Is it: upgrade Ubuntu to Xenial first, then upgrade Mitaka to
Newton?

I see three ways how to solve this problem:
1) Implement support to devstack Mitaka.
2) Use FORCE value for grenade Newton (I sent experimental patch [2]).
3) Run Trusty only for upgrades Mitaka->Newton.

Any thoughts or comments?
I see it was resolved by 
https://bugs.launchpad.net/openstack-gate/+bug/1642543

Sorry for the noise.



Thanks,
Jakub

[1]
https://github.com/openstack-dev/devstack/blob/stable/mitaka/stack.sh#L188
[2] https://review.openstack.org/#/c/399526/



Clark


__

OpenStack Development Mailing List (not for usage questions)
Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Jakub Libosvar]

On 07/11/2016 23:04, Clark Boylan wrote:

On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote:

How can you do this? First double check your job logs to see where your
tests are running. The first few lines of your job console logs should
say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial.
Any changes to master should not run on Trusty and instead should run on
Xenial.


Point of clarification here, stable/newton and master jobs should both
be transitioned to Xenial.


I noticed gate-grenade-dsvm-ubuntu-xenial job is run on stable Newton 
branch for devstack. It basically means Mitaka devstack is used to 
deploy on Xenial but Xenial is not among supported distros in Mitaka [1].


What is recommended way of upgrade for Ubuntu users running Mitaka on 
Trusy? Is it: upgrade Ubuntu to Xenial first, then upgrade Mitaka to Newton?


I see three ways how to solve this problem:
1) Implement support to devstack Mitaka.
2) Use FORCE value for grenade Newton (I sent experimental patch [2]).
3) Run Trusty only for upgrades Mitaka->Newton.

Any thoughts or comments?

Thanks,
Jakub

[1] 
https://github.com/openstack-dev/devstack/blob/stable/mitaka/stack.sh#L188

[2] https://review.openstack.org/#/c/399526/



Clark


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Clark Boylan]

On Mon, Nov 14, 2016, at 05:21 PM, Neil Jerram wrote:
> On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan  wrote:
> 
> > If you have jobs still running on trusty the next step is to fire up a
> > Xenial instance locally and run that test to see if it works.
> >
> 
> Can you advise how big (RAM, CPU, disk) the Xenial instance should be, so
> as to be similar to what is used in the gate?

Working on documenting that at
https://review.openstack.org/#/c/394566/1/doc/source/testing.rst still a
bit of a work in progress overall but should include those specifics.

Clark

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Neil Jerram]

On Mon, Nov 7, 2016 at 9:50 PM Clark Boylan  wrote:

> If you have jobs still running on trusty the next step is to fire up a
> Xenial instance locally and run that test to see if it works.
>

Can you advise how big (RAM, CPU, disk) the Xenial instance should be, so
as to be similar to what is used in the gate?

Thanks,
 Neil
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Clark Boylan]

On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote:
> Hello everyone,
> 
> The infra team would really like to get the Ubuntu Xenial for testing
> transition completed early this cycle. We are planning to switch any
> jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on
> December 6, 2016. That gives us about a month from today to more
> gracefully migrate jobs while still getting it done early enough in the
> cycle to fix any issues and put it behind us. Would be great for project
> teams to test if their jobs run on Xenial and propose updates to
> openstack-infra/project-config as necessary to switch to Ubuntu Xenial.

Just a friendly reminder that this is still happening. We will be
updating any jobs running on Trusty that should be running on Xenial on
December 6th. I have seen a few projects jump on this and start making
the necessary changes. Thank you for doing that!

As always feel free to ask questions or ping us (the infra team) for
help if you need it. 

Clark

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Clark Boylan]

On Mon, Nov 7, 2016, at 01:48 PM, Clark Boylan wrote:
> How can you do this? First double check your job logs to see where your
> tests are running. The first few lines of your job console logs should
> say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial.
> Any changes to master should not run on Trusty and instead should run on
> Xenial.

Point of clarification here, stable/newton and master jobs should both
be transitioned to Xenial.

Clark


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [All] Finish test job transition to Ubuntu Xenial

[Clark Boylan]

Hello everyone,

The infra team would really like to get the Ubuntu Xenial for testing
transition completed early this cycle. We are planning to switch any
jobs that remain on Ubuntu Trusty but should be on Ubuntu Xenial on
December 6, 2016. That gives us about a month from today to more
gracefully migrate jobs while still getting it done early enough in the
cycle to fix any issues and put it behind us. Would be great for project
teams to test if their jobs run on Xenial and propose updates to
openstack-infra/project-config as necessary to switch to Ubuntu Xenial.

How can you do this? First double check your job logs to see where your
tests are running. The first few lines of your job console logs should
say "[Zuul] Building remotely on ubuntu-xenial" if running on Xenial.
Any changes to master should not run on Trusty and instead should run on
Xenial.

If you have jobs still running on trusty the next step is to fire up a
Xenial instance locally and run that test to see if it works. Usually
this will mean running the appropriate tox target or if using
devstack-gate you can grab the reproduce.sh script for that job and run
that script locally.

If everything works, then push a change to
openstack-infra/project-config. We have been using a job name suffix of
-ubuntu-xenial to indicate jobs should run on xenial. An example change
that does this can be found at [0].

If you run into failures hopefully you can iterate on them locally using
your Xenial test setup, get them fixed, then update the job location.

This work is important because it helps ensure that OpenStack functions
on more "modern" linuxes. We get shiny new things like newer versions of
libvirt and ovs. We also get to stop worrying about upstart.

As always I and the rest of the infra team are happy to help should you
have questions or concerns or just need eyeballs to help debug problems.

[0] https://review.openstack.org/#/c/348078

Thank you
Clark

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev