Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-21 Thread Alex Bennée
Wainer dos Santos Moschetta writes: > Hi all, >> Conclusion >> == >> >> I think generally the state of QEMU's CI has improved over the last few >> years but we still have a number of challenges caused by its distributed >> nature and test stability. We are still re-active to failures

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-21 Thread Alex Bennée
Cleber Rosa writes: > On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: >> >> Hi, >> >> As we approach stabilisation for 4.0 I thought it would be worth doing a >> review of the current state of CI and stimulate some discussion of where >> it is working for us and what could be

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-18 Thread Cleber Rosa
On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: > > Hi, > > As we approach stabilisation for 4.0 I thought it would be worth doing a > review of the current state of CI and stimulate some discussion of where > it is working for us and what could be improved. > > Testing in Build

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-18 Thread Wainer dos Santos Moschetta
Hi all, On 03/14/2019 12:57 PM, Alex Bennée wrote: Hi, As we approach stabilisation for 4.0 I thought it would be worth doing a review of the current state of CI and stimulate some discussion of where it is working for us and what could be improved. Testing in Build System

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-17 Thread Fam Zheng
> On Mar 15, 2019, at 23:12, Stefan Hajnoczi wrote: > > On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: >> As we approach stabilisation for 4.0 I thought it would be worth doing a >> review of the current state of CI and stimulate some discussion of where >> it is working for us

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Ed Vielmetti writes: > There are a couple of options hosted at Packet - Shippable, Codefresh, and > Drone. I perhaps know more about Drone than the others. Each of them have a > supported/sponsored version which can be used to produce arm64 binaries > natively. > > I'll admit to dropping into

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Ed Vielmetti
There are a couple of options hosted at Packet - Shippable, Codefresh, and Drone. I perhaps know more about Drone than the others. Each of them have a supported/sponsored version which can be used to produce arm64 binaries natively. I'll admit to dropping into this conversation in mid-stream

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Ed Vielmetti writes: > We have been trying to merge the Gitlab runner patches for arm64 > for over a year now; see > > https://gitlab.com/gitlab-org/gitlab-runner/merge_requests/725 Yes I found that one. I'm trying to work out exactly how there build system works. It seems to build all

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Paolo Bonzini
On 15/03/19 17:28, Peter Maydell wrote: > On Fri, 15 Mar 2019 at 15:12, Stefan Hajnoczi wrote: >> How should all sub-maintainers be checking their pull requests? >> >> We should have information and a strict policy on minimum testing of >> pull requests. Right now I imagine it varies a lot

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Peter Maydell
On Fri, 15 Mar 2019 at 15:12, Stefan Hajnoczi wrote: > How should all sub-maintainers be checking their pull requests? > > We should have information and a strict policy on minimum testing of > pull requests. Right now I imagine it varies a lot between > sub-maintainers. > > For my block pull

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Stefan Hajnoczi writes: > On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: >> As we approach stabilisation for 4.0 I thought it would be worth doing a >> review of the current state of CI and stimulate some discussion of where >> it is working for us and what could be improved. > >

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Ed Vielmetti
We have been trying to merge the Gitlab runner patches for arm64 for over a year now; see https://gitlab.com/gitlab-org/gitlab-runner/merge_requests/725 I have not yet sorted out who at Gitlab has the ability to get this change implemented - their management structure is not something that I

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Stefan Hajnoczi
On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: > As we approach stabilisation for 4.0 I thought it would be worth doing a > review of the current state of CI and stimulate some discussion of where > it is working for us and what could be improved. Thanks for this summary and for all

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Paolo Bonzini
On 15/03/19 03:53, Fam Zheng wrote: >> [+] I currently test: >> - windows crossbuilds >> - S390, AArch32, AArch64, PPC64 Linux >> (SPARC currently disabled because of the migration-test flakiness) >> - OSX >> - FreeBSD, OpenBSD, NetBSD via the tests/vm setup >> - various x86-64 configs:

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Fam Zheng
> On Mar 15, 2019, at 17:58, Alex Bennée wrote: > > > Fam Zheng writes: > >>> On Mar 15, 2019, at 16:57, Alex Bennée wrote: >>> >>> I had installed the gitlab-runner from the Debian repo but it was out >>> of date and didn't seem to work correctly. >> >> If there can be a sidecar x86

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Peter Maydell writes: > On Fri, 15 Mar 2019 at 09:05, Alex Bennée wrote: >> >> >> Peter Maydell writes: >> > [+] I currently test: >> > - windows crossbuilds >> >> We did have this with shippable but had to disable it when the upstream >> repo went down. We could re-enable if we can rebuild

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Peter Maydell
On Fri, 15 Mar 2019 at 09:05, Alex Bennée wrote: > > > Peter Maydell writes: > > [+] I currently test: > > - windows crossbuilds > > We did have this with shippable but had to disable it when the upstream > repo went down. We could re-enable if we can rebuild it and cache our > docker images

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Daniel P. Berrangé writes: > On Fri, Mar 15, 2019 at 09:34:27AM +, Alex Bennée wrote: >> >> Daniel P. Berrangé writes: >> >> > On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: >> >> Docker Images >> >> = >> >> >> >> The addition of docker has unlocked the ability

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Daniel P . Berrangé
On Fri, Mar 15, 2019 at 09:34:27AM +, Alex Bennée wrote: > > Daniel P. Berrangé writes: > > > On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: > >> Docker Images > >> = > >> > >> The addition of docker has unlocked the ability to build a lot more > >> tests as well

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Fam Zheng writes: >> On Mar 15, 2019, at 16:57, Alex Bennée wrote: >> >> I had installed the gitlab-runner from the Debian repo but it was out >> of date and didn't seem to work correctly. > > If there can be a sidecar x86 box next to the test bot, it can be the > controller node which runs

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Daniel P . Berrangé
On Thu, Mar 14, 2019 at 06:22:44PM +, Peter Maydell wrote: > On Thu, 14 Mar 2019 at 15:57, Alex Bennée wrote: > > Testing in the Cloud > > > > > > After BuildBot went out-of-service we have been relying heavily on Travis > > as our primary CI platform. This has been

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Fam Zheng
> On Mar 15, 2019, at 16:57, Alex Bennée wrote: > > I had installed the gitlab-runner from the Debian repo but it was out > of date and didn't seem to work correctly. If there can be a sidecar x86 box next to the test bot, it can be the controller node which runs gitlab-runner, the test

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Daniel P. Berrangé writes: > On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: >> Docker Images >> = >> >> The addition of docker has unlocked the ability to build a lot more >> tests as well as compile testing on a much wider range of distros. I >> think there are two

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Peter Maydell writes: > On Thu, 14 Mar 2019 at 15:57, Alex Bennée wrote: >> Testing in the Cloud >> >> >> After BuildBot went out-of-service we have been relying heavily on Travis >> as our primary CI platform. This has been creaking somewhat under the >> strain and while

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-15 Thread Alex Bennée
Fam Zheng writes: >> On Mar 15, 2019, at 02:22, Peter Maydell wrote: >> >> On Thu, 14 Mar 2019 at 15:57, Alex Bennée wrote: >>> Testing in the Cloud >>> >>> >>> After BuildBot went out-of-service we have been relying heavily on Travis >>> as our primary CI platform. This

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-14 Thread Fam Zheng
> On Mar 15, 2019, at 02:22, Peter Maydell wrote: > > On Thu, 14 Mar 2019 at 15:57, Alex Bennée wrote: >> Testing in the Cloud >> >> >> After BuildBot went out-of-service we have been relying heavily on Travis >> as our primary CI platform. This has been creaking

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-14 Thread Peter Maydell
On Thu, 14 Mar 2019 at 15:57, Alex Bennée wrote: > Testing in the Cloud > > > After BuildBot went out-of-service we have been relying heavily on Travis > as our primary CI platform. This has been creaking somewhat under the > strain and while we have a large test matrix its

Re: [Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-14 Thread Daniel P . Berrangé
On Thu, Mar 14, 2019 at 03:57:06PM +, Alex Bennée wrote: > Docker Images > = > > The addition of docker has unlocked the ability to build a lot more > tests as well as compile testing on a much wider range of distros. I > think there are two outstanding areas that need improvement

[Qemu-devel] State of QEMU CI as we enter 4.0

2019-03-14 Thread Alex Bennée
Hi, As we approach stabilisation for 4.0 I thought it would be worth doing a review of the current state of CI and stimulate some discussion of where it is working for us and what could be improved. Testing in Build System === Things seem to be progressing well in this