Re: [Xen-devel] [xen-unstable test] 100518: regressions - FAIL

[Dario Faggioli]

On Wed, 2016-08-17 at 13:04 +, osstest service owner wrote:
> flight 100518 xen-unstable real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/100518/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
>  test-amd64-amd64-xl-qemut-winxpsp3 17 guest-start/win.repeat fail
> REGR. vs. 100488
> 
So, FTR, Jan pointed out to me and George that this has failed like
this:

Aug 17 04:51:03.173959 (XEN) [ Xen-4.8-unstable  x86_64  debug=y  Not 
tainted ]
Aug 17 04:51:23.770049 (XEN) CPU:0
Aug 17 04:51:23.770111 (XEN) RIP:e008:[] 
sched_credit.c#_csched_cpu_pick+0x1be/0x62a
Aug 17 04:51:23.778034 (XEN) RFLAGS: 00010287   CONTEXT: hypervisor 
(d0v0)
Aug 17 04:51:23.786025 (XEN) rax: 0200200200200200   rbx: 0003   
rcx: 82d08032e280
Aug 17 04:51:23.794013 (XEN) rdx: 0031dd4d8200   rsi: 82d0802ecd20   
rdi: 83009550fca8
Aug 17 04:51:23.801996 (XEN) rbp: 83009550fd18   rsp: 83009550fc28   
r8:  0004
Aug 17 04:51:23.810025 (XEN) r9:     r10:    
r11: 
Aug 17 04:51:23.817966 (XEN) r12: 0003   r13: 8300952f9000   
r14: 83024e88cf50
Aug 17 04:51:23.825975 (XEN) r15: 82d080344ec0   cr0: 80050033   
cr4: 001526e0
Aug 17 04:51:23.833993 (XEN) cr3: 000240f83000   cr2: 7f0d36e51b0d
Aug 17 04:51:23.834030 (XEN) ds:    es:    fs:    gs:    ss: 
e010   cs: e008
Aug 17 04:51:23.841976 (XEN) Xen code around  
(sched_credit.c#_csched_cpu_pick+0x1be/0x62a):
Aug 17 04:51:23.849972 (XEN)  18 48 8b 00 48 8b 40 28 <48> 8b 40 10 66 81 38 ff 
7f 75 0f 44 3b 25 7d 12
Aug 17 04:51:23.857973 (XEN) Xen stack trace from rsp=83009550fc28:
Aug 17 04:51:23.865960 (XEN)83025d853700 0002001f 
82d080344ec8 82d080344ec0
Aug 17 04:51:23.873956 (XEN)82d0802e96c0 830257af5570 
00010001 
Aug 17 04:51:23.881954 (XEN)0297 83009550fc88 
82d080130a3e 
Aug 17 04:51:23.889950 (XEN)0206 83009550fca8 
82d080130a3e 83025d844000
Aug 17 04:51:23.897962 (XEN)0006  
 
Aug 17 04:51:23.906002 (XEN)000f  
 
Aug 17 04:51:23.913973 (XEN)83009550fd38 8300952f9000 
830247c96000 
Aug 17 04:51:23.914015 (XEN)83024e88cf50  
83009550fd28 82d0801251f8
Aug 17 04:51:23.921976 (XEN)83009550fd78 82d080125227 
83009550fd58 82d08013c7a9
Aug 17 04:51:23.929974 (XEN)0003 8300952f9000 
830247c96000 
Aug 17 04:51:23.937961 (XEN)0003  
83009550fd98 82d08012d3ba
Aug 17 04:51:23.945951 (XEN)8300952f9000 830247c96000 
83009550fdd8 82d080105d70
Aug 17 04:51:23.953969 (XEN)830257af5570  
830247c96000 7f0d38354004
Aug 17 04:51:23.961962 (XEN)830257af5570 0002 
83009550fef8 82d0801039df
Aug 17 04:51:23.969963 (XEN)83009550fe18 82d0 
 0003
Aug 17 04:51:23.977950 (XEN) 000242214025 
8301 83009550fea8
Aug 17 04:51:23.985962 (XEN)83009550fea4 82e004818900 
000c000f 7f0d38140013
Aug 17 04:51:23.993958 (XEN)0002  
7ffe23e9a7c0 7f0d36e456c8
Aug 17 04:51:24.001946 (XEN) 7ffe23e9a7f0 
00407f60 7f0d3814b2e5
Aug 17 04:51:24.009952 (XEN)00a399f0 0013 
0002 0013
Aug 17 04:51:24.017959 (XEN) Xen call trace:
Aug 17 04:51:24.017992 (XEN)[] 
sched_credit.c#_csched_cpu_pick+0x1be/0x62a
Aug 17 04:51:24.025957 (XEN)[] 
sched_credit.c#csched_cpu_pick+0x1b/0x1d
Aug 17 04:51:24.033963 (XEN)[] 
sched_credit.c#csched_vcpu_insert+0x2d/0x157
Aug 17 04:51:24.041949 (XEN)[] sched_init_vcpu+0x1b8/0x1fe
Aug 17 04:51:24.041984 (XEN)[] alloc_vcpu+0x1c8/0x2c7
Aug 17 04:51:24.049995 (XEN)[] do_domctl+0x7ea/0x1b24
Aug 17 04:51:24.057972 (XEN)[] lstar_enter+0xdd/0x137
Aug 17 04:51:24.058011 (XEN) 
Aug 17 04:51:24.065961 (XEN) 
Aug 17 04:51:24.065989 (XEN) 
Aug 17 04:51:24.066018 (XEN) Panic on CPU 0:
Aug 17 04:51:24.073936 (XEN) GENERAL PROTECTION FAULT
Aug 17 04:51:24.073967 (XEN) [error_code=]
Aug 17 04:51:24.073994 (XEN) 

This looks to me the same thing reported by Andrew a couple of days
ago, and then covered in the following emails/threads:

https://lists.xen.org/archives/html/xen-devel/2016-08/msg01677.html
https://lists.xen.org/archives/html/xen-devel/2016-08/msg01679.html

[Xen-devel] [xen-unstable test] 100518: regressions - FAIL

[osstest service owner]

flight 100518 xen-unstable real [real]
http://logs.test-lab.xenproject.org/osstest/logs/100518/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-amd64-xl-qemut-winxpsp3 17 guest-start/win.repeat fail REGR. vs. 
100488

Regressions which are regarded as allowable (not blocking):
 build-amd64-rumpuserxen   6 xen-buildfail  like 100488
 build-i386-rumpuserxen6 xen-buildfail  like 100488
 test-amd64-i386-xl-qemut-win7-amd64 16 guest-stop fail like 100488
 test-amd64-amd64-xl-qemut-win7-amd64 16 guest-stopfail like 100488
 test-amd64-amd64-xl-rtds  9 debian-install   fail  like 100488
 test-amd64-amd64-xl-qemuu-win7-amd64 16 guest-stopfail like 100488
 test-amd64-i386-xl-qemuu-win7-amd64 16 guest-stop fail like 100488

Tests which did not succeed, but are not blocking:
 test-amd64-i386-rumpuserxen-i386  1 build-check(1)   blocked  n/a
 test-amd64-amd64-rumpuserxen-amd64  1 build-check(1)   blocked n/a
 test-amd64-amd64-xl-pvh-amd  11 guest-start  fail   never pass
 test-amd64-amd64-xl-pvh-intel 11 guest-start  fail  never pass
 test-amd64-amd64-qemuu-nested-amd 16 debian-hvm-install/l1/l2  fail never pass
 test-amd64-amd64-libvirt-xsm 12 migrate-support-checkfail   never pass
 test-amd64-amd64-libvirt 12 migrate-support-checkfail   never pass
 test-amd64-amd64-libvirt-vhd 11 migrate-support-checkfail   never pass
 test-amd64-i386-libvirt-xsm  12 migrate-support-checkfail   never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-checkfail never pass
 test-armhf-armhf-xl-cubietruck 13 saverestore-support-checkfail never pass
 test-armhf-armhf-xl  12 migrate-support-checkfail   never pass
 test-armhf-armhf-xl  13 saverestore-support-checkfail   never pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check 
fail never pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check 
fail never pass
 test-armhf-armhf-xl-xsm  13 saverestore-support-checkfail   never pass
 test-armhf-armhf-xl-xsm  12 migrate-support-checkfail   never pass
 test-amd64-i386-libvirt  12 migrate-support-checkfail   never pass
 test-armhf-armhf-libvirt 14 guest-saverestorefail   never pass
 test-armhf-armhf-libvirt 12 migrate-support-checkfail   never pass
 test-armhf-armhf-libvirt-xsm 12 migrate-support-checkfail   never pass
 test-armhf-armhf-libvirt-xsm 14 guest-saverestorefail   never pass
 test-armhf-armhf-libvirt-raw 13 guest-saverestorefail   never pass
 test-armhf-armhf-libvirt-raw 11 migrate-support-checkfail   never pass
 test-armhf-armhf-libvirt-qcow2 11 migrate-support-checkfail never pass
 test-armhf-armhf-libvirt-qcow2 13 guest-saverestorefail never pass
 test-armhf-armhf-xl-arndale  12 migrate-support-checkfail   never pass
 test-armhf-armhf-xl-arndale  13 saverestore-support-checkfail   never pass
 test-armhf-armhf-xl-multivcpu 13 saverestore-support-checkfail  never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-checkfail  never pass
 test-armhf-armhf-xl-vhd  11 migrate-support-checkfail   never pass
 test-armhf-armhf-xl-vhd  12 saverestore-support-checkfail   never pass
 test-armhf-armhf-xl-rtds 13 saverestore-support-checkfail   never pass
 test-armhf-armhf-xl-rtds 12 migrate-support-checkfail   never pass
 test-armhf-armhf-xl-credit2  13 saverestore-support-checkfail   never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-checkfail   never pass

version targeted for testing:
 xen  c4e7a67e3a109a3d507d2617b77017e40d59f04a
baseline version:
 xen  a55ad65d3a30d5b3a026a7481ce05f28065920f0

Last test of basis   100488  2016-08-15 01:58:52 Z2 days
Failing since100492  2016-08-15 10:43:55 Z2 days3 attempts
Testing same since   100518  2016-08-16 19:11:11 Z0 days1 attempts


People who touched revisions under test:
  Jan Beulich 

jobs:
 build-amd64-xsm  pass
 build-armhf-xsm  pass
 build-i386-xsm   pass
 build-amd64  pass
 build-armhf  pass
 build-i386   pass
 build-amd64-libvirt  pass
 build-armhf-libvirt  pass
 build-i386-libvirt