Re: [openstack-dev] [nova][infra] Ability to run newer QEMU in Gate jobs

2016-01-20 Thread Kashyap Chamarthy
On Wed, Jan 20, 2016 at 10:25:00AM +, Tony Breeds wrote:
> On Tue, Jan 19, 2016 at 06:11:35PM +, Daniel P. Berrange wrote:
> 
> > We'll almost certainly need to be able to test QEMU 2.6 in the N
> > release cycle, since that'll (hopefully) include support for TLS
> > encrypted migration & nbd traffic.  So I don't think waiting for
> > LTS releases is a viable strategy in general - we'll need UCA to
> > be available for at least some set of jobs we run. Alternatively
> > stick with LTS release for Ubuntu, and run other jobs with Fedora
> > and the virt-preview repository to give us coverage of the cutting
> > edge QEMU/libvirt stack.
> 
> I'm working on a devstack-plugin that will allow us to do these
> things.  Right now it's Ubuntu specific but nothing that'll stop F23
> once that's working in nodepool.

Good to know.

A related piece of work (no update over a year), that needs to be turned
into a plugin:

https://review.openstack.org/#/c/108714/10 -- Support for
libvirt/QEMU tar releases

-- 
/kashyap

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova][infra] Ability to run newer QEMU in Gate jobs

2016-01-20 Thread Tony Breeds
On Tue, Jan 19, 2016 at 06:11:35PM +, Daniel P. Berrange wrote:

> We'll almost certainly need to be able to test QEMU 2.6 in the N
> release cycle, since that'll (hopefully) include support for TLS
> encrypted migration & nbd traffic.  So I don't think waiting for
> LTS releases is a viable strategy in general - we'll need UCA to
> be available for at least some set of jobs we run. Alternatively
> stick with LTS release for Ubuntu, and run other jobs with Fedora
> and the virt-preview repository to give us coverage of the cutting
> edge QEMU/libvirt stack.

I'm working on a devstack-plugin that will allow us to do these things.  Right
now it's Ubuntu specific but nothing that'll stop F23 once that's working in
nodepool.

Yours Tony.


signature.asc
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova][infra] Ability to run newer QEMU in Gate jobs

2016-01-19 Thread Daniel P. Berrange
On Tue, Jan 19, 2016 at 05:47:58PM +, Jeremy Stanley wrote:
> On 2016-01-19 18:32:38 +0100 (+0100), Kashyap Chamarthy wrote:
> [...]
> > Matt Riedemann tells me on IRC that multi-node live migration job is
> > currently Ubuntu only, and to get a newer QEMU, it has to be added to
> > Ubuntu Cloud Archive.
> [...]
> 
> As discussed recently on another thread[1], we're not currently
> using UCA in jobs either. We can discuss it, but generally by the
> time people start actively wanting newer whatever we're only a few
> months away from the next LTS anyway. In this case I have hopes that
> in a few months we'll be able to start running jobs on Ubuntu 16.04
> LTS, which looks like it's going to ship with QEMU 2.5.

We'll almost certainly need to be able to test QEMU 2.6 in the N
release cycle, since that'll (hopefully) include support for TLS
encrypted migration & nbd traffic.  So I don't think waiting for
LTS releases is a viable strategy in general - we'll need UCA to
be available for at least some set of jobs we run. Alternatively
stick with LTS release for Ubuntu, and run other jobs with Fedora
and the virt-preview repository to give us coverage of the cutting
edge QEMU/libvirt stack.

> Alternatively, look into getting a live migration job running on
> CentOS 7 or Fedora 23 if it can't wait until after Mitaka.

CentOS 7 might be a nice target, since I think it'll likely have
more reliable migration support at the QEMU level than any distros
shipping close-to-upstream QEMU versions.

Regards,
Daniel
-- 
|: http://berrange.com  -o-http://www.flickr.com/photos/dberrange/ :|
|: http://libvirt.org  -o- http://virt-manager.org :|
|: http://autobuild.org   -o- http://search.cpan.org/~danberr/ :|
|: http://entangle-photo.org   -o-   http://live.gnome.org/gtk-vnc :|

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova][infra] Ability to run newer QEMU in Gate jobs

2016-01-19 Thread Jeremy Stanley
On 2016-01-19 18:32:38 +0100 (+0100), Kashyap Chamarthy wrote:
[...]
> Matt Riedemann tells me on IRC that multi-node live migration job is
> currently Ubuntu only, and to get a newer QEMU, it has to be added to
> Ubuntu Cloud Archive.
[...]

As discussed recently on another thread[1], we're not currently
using UCA in jobs either. We can discuss it, but generally by the
time people start actively wanting newer whatever we're only a few
months away from the next LTS anyway. In this case I have hopes that
in a few months we'll be able to start running jobs on Ubuntu 16.04
LTS, which looks like it's going to ship with QEMU 2.5.

Alternatively, look into getting a live migration job running on
CentOS 7 or Fedora 23 if it can't wait until after Mitaka.

[1] http://lists.openstack.org/pipermail/openstack-dev/2016-January/084148.html
-- 
Jeremy Stanley

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova][infra] Ability to run newer QEMU in Gate jobs

2016-01-19 Thread Clark Boylan
On Tue, Jan 19, 2016, at 09:32 AM, Kashyap Chamarthy wrote:
> Heya,
> 
> Currently the live migration test job[1] is using relatively old version
> of QEMU (2.0 -- 2 years old, 17-APR-2014).  And, libvirt 1.2.2
> (released on 02-MAR-2014).  For libvirt, I realize there's an
> in-progress thread[2] to get to a state to run a bleeding edge libvirt.
> 
> How can we go about bumping up QEMU to its newest stable release (2.5,
> DEC-2015)?
> 
> Matt Riedemann tells me on IRC that multi-node live migration job is
> currently Ubuntu only, and to get a newer QEMU, it has to be added to
> Ubuntu Cloud Archive.  It'd be useful to get that done.  Who can help
> with it?
I would start by pushing a change to devstack or devstack-gate that
turns on cloud archive by default. Then libvirt and friends will all get
installed with the newer version and give you an idea of whether or not
the cloud archive is functional for us. 
> 
> It'll allow us to confirm our suspicion that a couple of Nova live
> migration bugs[3][4] are likely fixed with that version.  Also it (the
> newer QEMU) has some additional debug logging capabilities which can
> help us with root cause analysis of some live migration issues.
Assuming nothing breaks you can then use the same change to iterate on
this to see if the bugs are corrected and get access to the richer logs.
> 
> 
> [1]
> https://jenkins05.openstack.org/job/gate-tempest-dsvm-multinode-live-migration/
> [2]
> http://lists.openstack.org/pipermail/openstack-dev/2015-November/079679.html
> [3] https://bugs.launchpad.net/nova/+bug/1524898 -- Volume based live
> migrtion aborted unexpectedly
> [4] https://bugs.launchpad.net/nova/+bug/1535232/ -- live-migration ci
> failure on nfs shared storage 
> 
Since both devstack and devstack-gate are self testing you can typically
do a first draft attempt at changes like this just by pushing a change,
letting the tests run, then checking the results. We may not want to go
with the simple change long term (as it likely won't cache packages
properly among other things), but it is very good at giving quick
results on whether or not it is viable at all.

Clark

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [nova][infra] Ability to run newer QEMU in Gate jobs

2016-01-19 Thread Kashyap Chamarthy
Heya,

Currently the live migration test job[1] is using relatively old version
of QEMU (2.0 -- 2 years old, 17-APR-2014).  And, libvirt 1.2.2
(released on 02-MAR-2014).  For libvirt, I realize there's an
in-progress thread[2] to get to a state to run a bleeding edge libvirt.

How can we go about bumping up QEMU to its newest stable release (2.5,
DEC-2015)?

Matt Riedemann tells me on IRC that multi-node live migration job is
currently Ubuntu only, and to get a newer QEMU, it has to be added to
Ubuntu Cloud Archive.  It'd be useful to get that done.  Who can help
with it?  

It'll allow us to confirm our suspicion that a couple of Nova live
migration bugs[3][4] are likely fixed with that version.  Also it (the
newer QEMU) has some additional debug logging capabilities which can
help us with root cause analysis of some live migration issues.


[1] 
https://jenkins05.openstack.org/job/gate-tempest-dsvm-multinode-live-migration/
[2] http://lists.openstack.org/pipermail/openstack-dev/2015-November/079679.html
[3] https://bugs.launchpad.net/nova/+bug/1524898 -- Volume based live
migrtion aborted unexpectedly
[4] https://bugs.launchpad.net/nova/+bug/1535232/ -- live-migration ci
failure on nfs shared storage 

-- 
/kashyap

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev