Bug#934789: autopkgtest: test passes when it should fail; looks click and/or apparmor-related

2019-08-17 Thread Antonio Terceiro
Control: clone -1 -2
Control: reassign -2 lxc 1:3.1.0+really3.0.4-1
Control: retitle -2 lxc: breaks autopkgtest
Control: affects -2 autopkgtest

On Wed, Aug 14, 2019 at 07:29:53PM -0300, Antonio Terceiro wrote:
> Package: autopkgtest
> Version: 5.10
> Severity: important
[...]
> notable/weird lines:
> 
> autopkgtest [19:08:37]: Updating AppArmor rules to allow autopilot 
> introspection for all clicks (will take a minute)...
> sh: 1: cannot create /var/cache/apparmor/click-ap.rules: Directory nonexistent
> 
> and
> 
> sh: 1: cannot create /var/cache/apparmor/click-ap.rules: Directory nonexistent
> 
> Running the same test locally with null virtualization (up to date unstable)
> does the right thing:

I tried in a buster VM, and things work as expected with both `null` and
`lxc`. Then I tried downgrading lxc to the version in unstable on my
main machine, and things work again.

So this is a problem with the lxc in unstable (and sadly on testing as
well).

I still need to debug to figure out the exact problem.


signature.asc
Description: PGP signature


Bug#934789: autopkgtest: test passes when it should fail; looks click and/or apparmor-related

2019-08-14 Thread Antonio Terceiro
Package: autopkgtest
Version: 5.10
Severity: important

8<8<8<-
$ cat debian/tests/control
Test-Command: false
Depends: dpkg

$ autopkgtest -B . -- lxc --sudo autopkgtest-stable-amd64
autopkgtest [19:08:21]: version 5.10
autopkgtest [19:08:21]: host lemur; command line: /usr/bin/autopkgtest -B . -- 
lxc --sudo autopkgtest-stable-amd64
autopkgtest [19:08:34]: testbed dpkg architecture: amd64
autopkgtest [19:08:35]: testbed running kernel: Linux 5.2.0-2-amd64 #1 SMP 
Debian 5.2.7-1 (2019-08-07)
autopkgtest [19:08:35]:  unbuilt-tree .
autopkgtest [19:08:35]: testing package fake-package version 0.1.0~FIXME-1
autopkgtest [19:08:35]: build not needed
autopkgtest [19:08:35]: test command1: preparing testbed
Reading package lists... Done
Building dependency tree
Reading state information... Done
Starting pkgProblemResolver with broken count: 0
Starting 2 pkgProblemResolver with broken count: 0
Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
1 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Setting up autopkgtest-satdep (0) ...
(Reading database ... 12281 files and directories currently installed.)
Removing autopkgtest-satdep (0) ...
autopkgtest [19:08:37]: Updating AppArmor rules to allow autopilot 
introspection for all clicks (will take a minute)...
sh: 1: cannot create /var/cache/apparmor/click-ap.rules: Directory nonexistent
autopkgtest [19:08:37]: test command1: false
autopkgtest [19:08:37]: test command1: [---
autopkgtest [19:08:38]: test command1: ---]
autopkgtest [19:08:38]: test command1:  - - - - - - - - - - results - - - - - - 
- - - -
command1 PASS
autopkgtest [19:08:38]: Restoring click package AppArmor rules
sh: 1: aa-clickhook: not found
autopkgtest [19:08:38]:  summary
command1 PASS
8<8<8<-

notable/weird lines:

autopkgtest [19:08:37]: Updating AppArmor rules to allow autopilot 
introspection for all clicks (will take a minute)...
sh: 1: cannot create /var/cache/apparmor/click-ap.rules: Directory nonexistent

and

sh: 1: cannot create /var/cache/apparmor/click-ap.rules: Directory nonexistent


Running the same test locally with null virtualization (up to date unstable)
does the right thing:

8<8<8<-
$ autopkgtest -B . -- null
autopkgtest [19:29:20]: version 5.10
autopkgtest [19:29:20]: host lemur; command line: /usr/bin/autopkgtest -B . -- 
null
autopkgtest [19:29:20]: testbed dpkg architecture: amd64
autopkgtest [19:29:20]: testbed running kernel: Linux 5.2.0-2-amd64 #1 SMP 
Debian 5.2.7-1 (2019-08-07)
autopkgtest [19:29:20]:  unbuilt-tree .
autopkgtest [19:29:20]: testing package fake-package version 0.1.0~FIXME-1
autopkgtest [19:29:20]: build not needed
autopkgtest [19:29:20]: test command1: preparing testbed
Starting pkgProblemResolver with broken count: 0
Starting 2 pkgProblemResolver with broken count: 0
Done
autopkgtest [19:29:21]: test command1: false
autopkgtest [19:29:21]: test command1: [---
autopkgtest [19:29:21]: test command1: ---]
autopkgtest [19:29:21]: test command1:  - - - - - - - - - - results - - - - - - 
- - - -
command1 FAIL non-zero exit status 1
autopkgtest [19:29:21]:  summary
command1 FAIL non-zero exit status 1
8<8<8<-

-- System Information:
Debian Release: bullseye/sid
  APT prefers unstable-debug
  APT policy: (500, 'unstable-debug'), (500, 'testing-debug'), (500, 
'unstable'), (500, 'testing'), (1, 'experimental-debug'), (1, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 5.2.0-2-amd64 (SMP w/4 CPU cores)
Kernel taint flags: TAINT_CRAP
Locale: LANG=pt_BR.UTF-8, LC_CTYPE=pt_BR.UTF-8 (charmap=UTF-8), 
LANGUAGE=pt_BR:pt:en (charmap=UTF-8)
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages autopkgtest depends on:
ii  apt-utils   1.8.3
ii  libdpkg-perl1.19.7
ii  procps  2:3.3.15-2
ii  python3 3.7.3-1
ii  python3-debian  0.1.35

Versions of packages autopkgtest recommends:
ii  autodep8  0.18

Versions of packages autopkgtest suggests:
ii  lxc   1:3.1.0+really3.0.4-1
pn  lxd   
ii  ovmf  0~20190606.20d2e5a1-2
ii  qemu-efi-aarch64  0~20190606.20d2e5a1-2
ii  qemu-efi-arm  0~20190606.20d2e5a1-2
ii  qemu-system   1:3.1+dfsg-8
ii  qemu-utils1:3.1+dfsg-8
ii  schroot   1.6.10-6+b1
ii  vmdb2 0.13.2+git20190215-1

-- no debconf information


signature.asc
Description: PGP signature