Re: rawhide status - 2019-06-19

2019-06-19 Thread Adam Williamson
On Wed, 2019-06-19 at 13:35 -0500, Bruno Wolff III wrote:
> On Wed, Jun 19, 2019 at 10:44:41 -0700,
>   Kevin Fenzi  wrote:
> > The last rawhide compose that completed was 2019-06-09 (10 days ago now).
> 
> A lot of the incomplete composes are actually usable for updates and I have 
> been getting systems updated and things have worked reasonably for the most 
> part.
> 
> If we had enough resources, it would be nice if the part of the compose 
> needed 
> for installs was treated differently from the part that people could use 
> to get updates.

The general idea is that if it's broken enough that the images don't
compose, we're not confident it's working enough to send out as updates
to existing systems either.

This would of course work better if we could get a tighter and faster
loop from 'change that breaks things' to 'realizing that things are
broken' to 'fixing the change', though.
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net
http://www.happyassassin.net
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: rawhide status - 2019-06-19

2019-06-19 Thread Bruno Wolff III

On Wed, Jun 19, 2019 at 10:44:41 -0700,
 Kevin Fenzi  wrote:


The last rawhide compose that completed was 2019-06-09 (10 days ago now).


A lot of the incomplete composes are actually usable for updates and I have 
been getting systems updated and things have worked reasonably for the most 
part.


If we had enough resources, it would be nice if the part of the compose needed 
for installs was treated differently from the part that people could use 
to get updates. (For example kernel-5.2.0-0.rc5.git1.1.fc31 fixes a remote 
DOS bug and people won't get it by default until there is a successful 
compose. Though it also seems to have problems on some hardware.) The naive 
way to do this is to have two seperate repos with hard linked rpms. 


Hopefully as time goes on, there will be fewer multi-day compose failures.
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


rawhide status - 2019-06-19

2019-06-19 Thread Kevin Fenzi
Greetings everyone.

I thought I would send out a rawhide status email to catch everyone up
to whats going on there. I should have sent it sooner, but I was on
vacation, then in a set of meetings, etc.

The last rawhide compose that completed was 2019-06-09 (10 days ago now).

There's been a number of reasons for this. In order to accommodate some
fedora 31 changes ( dynamic build requires ) and epel8 work we needed a
koji with some backported patches as well as newer mock and createrepo_c.

So, first step was to get armv7 builders off Fedora 27 where they have
been stuck due to a kernel bug. Luckily Peter Robinson and Paul Whalen
have been working on isolating that bug and found a kernel/userspace
combo that we can use until we fix it. So, all the armv7 builders are up
on fedora 29 with a older kernel now.

Next I found that python2 koji-builder was no longer installable due to
python2 deps going away. I could have just tried to fix that, but I
figured it would be a good time to just move everything to python3 and
get it oever with. This turned out to be more involved than I had hoped:

* koji itself still shipped a python2 script (which we don't use and I
ended up just dropping in the fedora builds).
* Moving koji-builder over to python3 meant we had to also move over oz
and imagefactory (happily something which happened in rawhide) and all
the stack of things they use.
* I rebuilt (with patches) all the following for our f29 builders:
oz
imagefactory
koji
koji-containerbuild (which cverna ported to python3 nice and quickly)
python-urlgrabber
pycdio (is python2 only in fedora, but we needed python3, need to file a
bug on this one)
imagefactory-plugins
mock

After a number of update and find breakage and fix, I got things back
working monday all on python3.

Then of course since it's been so long since a compose, we are now
hitting those things that broke in the mean time. First some kde deps,
and now a ppc64le/aarch64 cloud image issue (
https://bugzilla.redhat.com/show_bug.cgi?id=1722181 )

Hopefully that one can be solved soon and we can get back on the
composes bandwagon.

Gating wouldn't have helped the python3 issues as that was builder side.
It would likely have helped with the kde deps and cloud issues however.

kevin



signature.asc
Description: OpenPGP digital signature
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org