Re: Fedora 26-20170307.n.0 compose check report

2017-03-07 Thread Adam Williamson
On Tue, 2017-03-07 at 19:02 +, Fedora compose checker wrote:
> Missing expected images:
> 
> Atomic qcow2 x86_64
> Server dvd i386
> Server boot i386
> Atomic raw-xz x86_64
> 
> Failed openQA tests: 16/107 (x86_64), 1/2 (i386), 1/2 (arm)
> 
> New failures (same test did not fail in 26-20170306.n.0):
> 
> ID: 60760 Test: x86_64 Server-dvd-iso install_default_upload
> URL: https://openqa.fedoraproject.org/tests/60760

So...I think this one may actually be caused by some hardware issues
we're having with one of the openQA worker host boxes. openQA detected
a system stall during a needle check that failed; it's written to abort
the test any time this happens. But the needle check that failed was
actually *expected* to fail, so if openQA had just carried on the test
would've completed fine.

The stall likely happened because the worker host in question seems to
be periodically overheating and throttling its CPUs, which obviously
causes all the tests to run much slower. We're looking into why this is
happening.

In any case, not a Fedora bug.

> ID: 60767 Test: x86_64 Server-dvd-iso install_repository_nfs_graphical
> URL: https://openqa.fedoraproject.org/tests/60767

This one seems to have hit the 'hang during package install' bug that
sometimes happens lately.

> ID: 60809 Test: arm Minimal-raw_xz-raw.xz 
> install_arm_image_deployment_upload
> URL: https://openqa.fedoraproject.org/tests/60809

This actually fails every day, just sometimes it shows up as 'failed',
sometimes as 'incomplete'. Right now we think it's failing on
https://bugzilla.redhat.com/show_bug.cgi?id=1422634 ; the boot winds up
in emergency mode.

> ID: 60821 Test: x86_64 universal install_no_swap@uefi
> URL: https://openqa.fedoraproject.org/tests/60821

Looks like anaconda suddenly crashed in this test. We didn't get a
coredump, though, possibly because I need to update the openQA post-
fail code to handle coredumpctl-handled crashes. Looking in syslog, we
see:

13:42:22,808 INFO kernel:anaconda[1572]: segfault at 0 ip   (null) sp 
7d7281f8 error 14 in system-python[55e55d753000+1000]
13:42:22,872 INFO systemd:Started Process Core Dump (PID 1931/UID 0).
13:42:27,803 CRIT systemd-coredump:Process 1572 (anaconda) of user 0 dumped 
core.#012#012Stack trace of thread 1572:#012#0  0x n/a (n/a)

> Installed system changes in test x86_64 universal install_package_set_kde: 
> Mount / contents changed to 149.7529804% of previous size
> System load changed from 1.57 to 1.84
> Previous test data: https://openqa.fedoraproject.org/tests/60113#downloads
> Current test data: https://openqa.fedoraproject.org/tests/60811#downloads

The sudden increase in size here seems like an interesting result that
could bear looking into. I'll try and find a minute to do it if I can,
but anyone else could too, by installing the KDE package set from the
20170306.n.0 compose tree and the 20170307.n.0 compose tree, comparing
the results to verify the same thing happens, then trying to see what
eats the space...
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net
http://www.happyassassin.net
___
test mailing list -- test@lists.fedoraproject.org
To unsubscribe send an email to test-le...@lists.fedoraproject.org


Fedora 26-20170307.n.0 compose check report

2017-03-07 Thread Fedora compose checker
Missing expected images:

Atomic qcow2 x86_64
Server dvd i386
Server boot i386
Atomic raw-xz x86_64

Failed openQA tests: 16/107 (x86_64), 1/2 (i386), 1/2 (arm)

New failures (same test did not fail in 26-20170306.n.0):

ID: 60760   Test: x86_64 Server-dvd-iso install_default_upload
URL: https://openqa.fedoraproject.org/tests/60760
ID: 60767   Test: x86_64 Server-dvd-iso install_repository_nfs_graphical
URL: https://openqa.fedoraproject.org/tests/60767
ID: 60809   Test: arm Minimal-raw_xz-raw.xz 
install_arm_image_deployment_upload
URL: https://openqa.fedoraproject.org/tests/60809
ID: 60821   Test: x86_64 universal install_no_swap@uefi
URL: https://openqa.fedoraproject.org/tests/60821

Old failures (same test failed in 26-20170306.n.0):

ID: 60781   Test: x86_64 Workstation-live-iso install_default_upload
URL: https://openqa.fedoraproject.org/tests/60781
ID: 60782   Test: x86_64 Workstation-live-iso install_default@uefi
URL: https://openqa.fedoraproject.org/tests/60782
ID: 60796   Test: i386 Workstation-live-iso install_default
URL: https://openqa.fedoraproject.org/tests/60796
ID: 60812   Test: x86_64 universal install_simple_encrypted@uefi
URL: https://openqa.fedoraproject.org/tests/60812
ID: 60827   Test: x86_64 universal upgrade_desktop_encrypted_64bit
URL: https://openqa.fedoraproject.org/tests/60827
ID: 60828   Test: x86_64 universal upgrade_2_minimal_64bit
URL: https://openqa.fedoraproject.org/tests/60828
ID: 60830   Test: x86_64 universal upgrade_2_server_64bit
URL: https://openqa.fedoraproject.org/tests/60830
ID: 60831   Test: x86_64 universal upgrade_2_kde_64bit
URL: https://openqa.fedoraproject.org/tests/60831
ID: 60832   Test: x86_64 universal upgrade_2_desktop_encrypted_64bit
URL: https://openqa.fedoraproject.org/tests/60832
ID: 60836   Test: x86_64 universal install_european_language
URL: https://openqa.fedoraproject.org/tests/60836
ID: 60837   Test: x86_64 universal install_cyrillic_language
URL: https://openqa.fedoraproject.org/tests/60837
ID: 60838   Test: x86_64 universal install_asian_language
URL: https://openqa.fedoraproject.org/tests/60838
ID: 60857   Test: x86_64 universal install_simple_encrypted
URL: https://openqa.fedoraproject.org/tests/60857
ID: 60869   Test: x86_64 universal upgrade_2_desktop_64bit
URL: https://openqa.fedoraproject.org/tests/60869

Soft failed openQA tests: 47/107 (x86_64)
(Tests completed, but using a workaround for a known bug)

New soft failures (same test did not soft fail in 26-20170306.n.0):

ID: 60779   Test: x86_64 Everything-boot-iso install_default
URL: https://openqa.fedoraproject.org/tests/60779
ID: 60823   Test: x86_64 universal upgrade_minimal_64bit
URL: https://openqa.fedoraproject.org/tests/60823
ID: 60825   Test: x86_64 universal upgrade_server_64bit
URL: https://openqa.fedoraproject.org/tests/60825

Old soft failures (same test soft failed in 26-20170306.n.0):

ID: 60758   Test: x86_64 Server-boot-iso install_default
URL: https://openqa.fedoraproject.org/tests/60758
ID: 60759   Test: x86_64 Server-boot-iso install_default@uefi
URL: https://openqa.fedoraproject.org/tests/60759
ID: 60761   Test: x86_64 Server-dvd-iso install_default@uefi
URL: https://openqa.fedoraproject.org/tests/60761
ID: 60766   Test: x86_64 Server-dvd-iso install_repository_nfs_variation
URL: https://openqa.fedoraproject.org/tests/60766
ID: 60776   Test: x86_64 Server-dvd-iso install_updates_nfs
URL: https://openqa.fedoraproject.org/tests/60776
ID: 60780   Test: x86_64 Everything-boot-iso install_default@uefi
URL: https://openqa.fedoraproject.org/tests/60780
ID: 60813   Test: x86_64 universal install_simple_free_space@uefi
URL: https://openqa.fedoraproject.org/tests/60813
ID: 60814   Test: x86_64 universal install_multi_empty@uefi
URL: https://openqa.fedoraproject.org/tests/60814
ID: 60815   Test: x86_64 universal install_software_raid@uefi
URL: https://openqa.fedoraproject.org/tests/60815
ID: 60816   Test: x86_64 universal install_delete_partial@uefi
URL: https://openqa.fedoraproject.org/tests/60816
ID: 60817   Test: x86_64 universal install_btrfs@uefi
URL: https://openqa.fedoraproject.org/tests/60817
ID: 60818   Test: x86_64 universal install_ext3@uefi
URL: https://openqa.fedoraproject.org/tests/60818
ID: 60819   Test: x86_64 universal install_xfs@uefi
URL: https://openqa.fedoraproject.org/tests/60819
ID: 60820   Test: x86_64 universal install_lvmthin@uefi
URL: https://openqa.fedoraproject.org/tests/60820
ID: 60822   Test: x86_64 universal install_kickstart_hdd
URL: https://openqa.fedoraproject.org/tests/60822
ID: 60833   Test: x86_64 universal install_updates_img_local
URL: https://openqa.fedoraproject.org/tests/60833
ID: 60834   Test: x86_64 universal install_shrink_ext4
URL: https://openqa.fedoraproject.org/tests/60834
ID: 60835   Test: x86_64 universal install_shrink_ntfs
URL: