Re: Fedora Rawhide-20181206.n.0 compose check report
On Thu, 2018-12-06 at 15:25 +, Fedora compose checker wrote: > No missing expected images. > > Compose FAILS proposed Rawhide gating check! > 5 of 47 required tests failed > openQA tests matching unsatisfied gating requirements shown with **GATING** > below So - this is a new feature of check-compose I wrote yesterday :) As part of the 'NoMoreAlpha' change from a few releases back: https://fedoraproject.org/wiki/Changes/NoMoreAlpha we planned to start gating Rawhide composes - only syncing them out to become the current public state of the 'Rawhide' tree if they pass some subset of the automated compose tests. However, this has not yet been implemented. An initial gating policy was actually committed to the Fedora Greenwave config some months back by Ralph Bean, and since then it's been possible to ask Greenwave whether a given compose passes or fails the policy - but nothing was hooked up beyond that; no-one's been doing anything with that information. Ultimately the idea is that the Greenwave decision should be hooked into the compose sync process, but I thought before we go that far, it'd be useful to know just how often composes actually *do* meet the requirements. So I enhanced check-compose to request the decision from Greenwave and include it in the output, like this. This should help us get an idea just how often we'd be refusing to sync composes if we turned gating on. The failures that fail the gating check today are down to https://bugzilla.redhat.com/show_bug.cgi?id=1654537 and the Everything netinst tests for both x86_64 and UEFI failing because of the network not being up in the guest for some reason. The FreeIPA bug I'm hopeful we can get fixed soon, I'm not sure what's going on with the netinst failure, I'll have to look into that. (It's a bit tricky because, when the network in the guest doesn't work, we don't get any logs from the test...) Eagle-eyed readers may not a slight bug in the new feature: Greenwave reports *5* failed requirements, but the details below show only *4* tests with **GATING**. This is because the other failed test - the FreeIPA server test - doesn't show up in the check-compose output for some reason. If you re-run check-compose now, it *does* show up, so this is likely some kind of ordering issue to do with exactly what state that job is in when check-compose runs (my working theory is that it's in 'uploading' state - that could cause it to fall between some code cracks). I'll see if I can fix that. Thanks folks! -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org
Fedora Rawhide-20181206.n.0 compose check report
No missing expected images. Compose FAILS proposed Rawhide gating check! 5 of 47 required tests failed openQA tests matching unsatisfied gating requirements shown with **GATING** below Failed openQA tests: 28/131 (x86_64), 3/23 (i386), 1/2 (arm) New failures (same test not failed in Rawhide-20181205.n.0): ID: 316407 Test: x86_64 Server-dvd-iso server_role_deploy_domain_controller **GATING** URL: https://openqa.fedoraproject.org/tests/316407 ID: 316408 Test: x86_64 Server-dvd-iso server_realmd_join_kickstart **GATING** URL: https://openqa.fedoraproject.org/tests/316408 ID: 316411 Test: x86_64 Server-dvd-iso realmd_join_cockpit URL: https://openqa.fedoraproject.org/tests/316411 ID: 316412 Test: x86_64 Server-dvd-iso realmd_join_sssd **GATING** URL: https://openqa.fedoraproject.org/tests/316412 ID: 316413 Test: x86_64 Server-dvd-iso server_freeipa_replication_master URL: https://openqa.fedoraproject.org/tests/316413 ID: 316414 Test: x86_64 Server-dvd-iso server_freeipa_replication_replica URL: https://openqa.fedoraproject.org/tests/316414 ID: 316415 Test: x86_64 Server-dvd-iso server_freeipa_replication_client URL: https://openqa.fedoraproject.org/tests/316415 ID: 316424 Test: x86_64 Everything-boot-iso install_default@uefi **GATING** URL: https://openqa.fedoraproject.org/tests/316424 ID: 316425 Test: x86_64 Everything-boot-iso install_default **GATING** URL: https://openqa.fedoraproject.org/tests/316425 ID: 316492 Test: x86_64 universal install_blivet_ext3@uefi URL: https://openqa.fedoraproject.org/tests/316492 Old failures (same test failed in Rawhide-20181205.n.0): ID: 316419 Test: x86_64 Server-dvd-iso modularity_tests URL: https://openqa.fedoraproject.org/tests/316419 ID: 316430 Test: x86_64 Workstation-live-iso base_services_start URL: https://openqa.fedoraproject.org/tests/316430 ID: 316438 Test: x86_64 Workstation-live-iso desktop_notifications_postinstall URL: https://openqa.fedoraproject.org/tests/316438 ID: 316440 Test: x86_64 Workstation-boot-iso memory_check@uefi URL: https://openqa.fedoraproject.org/tests/316440 ID: 316441 Test: x86_64 Workstation-boot-iso memory_check URL: https://openqa.fedoraproject.org/tests/316441 ID: 316443 Test: i386 Workstation-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/316443 ID: 316444 Test: i386 Workstation-boot-iso memory_check URL: https://openqa.fedoraproject.org/tests/316444 ID: 316459 Test: arm Minimal-raw_xz-raw.xz install_arm_image_deployment_upload URL: https://openqa.fedoraproject.org/tests/316459 ID: 316510 Test: x86_64 universal upgrade_kde_64bit URL: https://openqa.fedoraproject.org/tests/316510 ID: 316511 Test: x86_64 universal upgrade_desktop_encrypted_64bit URL: https://openqa.fedoraproject.org/tests/316511 ID: 316515 Test: x86_64 universal upgrade_minimal_64bit URL: https://openqa.fedoraproject.org/tests/316515 ID: 316516 Test: x86_64 universal upgrade_desktop_64bit URL: https://openqa.fedoraproject.org/tests/316516 ID: 316517 Test: x86_64 universal upgrade_server_64bit URL: https://openqa.fedoraproject.org/tests/316517 ID: 316518 Test: x86_64 universal upgrade_server_domain_controller URL: https://openqa.fedoraproject.org/tests/316518 ID: 316519 Test: x86_64 universal upgrade_realmd_client URL: https://openqa.fedoraproject.org/tests/316519 ID: 316525 Test: x86_64 universal install_shrink_ext4 URL: https://openqa.fedoraproject.org/tests/316525 ID: 316526 Test: x86_64 universal install_shrink_ntfs URL: https://openqa.fedoraproject.org/tests/316526 ID: 316527 Test: x86_64 universal install_european_language URL: https://openqa.fedoraproject.org/tests/316527 ID: 316528 Test: x86_64 universal install_cyrillic_language URL: https://openqa.fedoraproject.org/tests/316528 ID: 316529 Test: x86_64 universal install_arabic_language URL: https://openqa.fedoraproject.org/tests/316529 ID: 316530 Test: x86_64 universal install_asian_language URL: https://openqa.fedoraproject.org/tests/316530 ID: 316539 Test: i386 universal upgrade_desktop_32bit URL: https://openqa.fedoraproject.org/tests/316539 Soft failed openQA tests: 3/131 (x86_64), 2/23 (i386) (Tests completed, but using a workaround for a known bug) New soft failures (same test not soft failed in Rawhide-20181205.n.0): ID: 316427 Test: x86_64 Workstation-live-iso install_default_upload URL: https://openqa.fedoraproject.org/tests/316427 ID: 316428 Test: x86_64 Workstation-live-iso install_default@uefi URL: https://openqa.fedoraproject.org/tests/316428 ID: 316447 Test: x86_64 KDE-live-iso install_no_user URL: https://openqa.fedoraproject.org/tests/316447 Old soft failures (same test soft failed in Rawhide-20181205.n.0): ID: 316422 Test: i386 Server-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/316422 ID: 316423 Test: i386 Server-dvd-iso install_default URL:
