Public bug reported:

The snapd autopkgtest has been failing consistently on i386 since the
upload of snapd 2.0.3+16.10.  A few test failures have come and gone or
appear to have been flaky/racy, but there are two tests that have been
failing consistently:

START: integration-tests/tests/network_bind_interface_test.go:43: 
networkBindInterfaceSuite.TestPlugDisconnectionDisablesClientConnection
START: <autogenerated>:43: networkBindInterfaceSuite.SetUpTest
****** Running 
networkBindInterfaceSuite.TestPlugDisconnectionDisablesClientConnection
snap list
Name         Version               Rev  Developer
ubuntu-core  16.04+20160420.05-02  113  canonical
sudo snap install 
integration-tests/data/snaps/network-bind-consumer/network-bind-consumer_1.0_all.snap

[|] Mount snap "network-bind-consumer"
[/] Mount snap "network-bind-consumer"
[-] Setup snap "network-bind-consumer" security profiles
[\] Make snap "network-bind-consumer" available to the system
[|] Make snap "network-bind-consumer" available to the system
[/] Make snap "network-bind-consumer" available to the system

Name                   Version  Rev     Developer
network-bind-consumer  1.0      100001  
snap list
Name                   Version               Rev     Developer
network-bind-consumer  1.0                   100001  
ubuntu-core            16.04+20160420.05-02  113     canonical
sudo snap install 
integration-tests/data/snaps/network-consumer/network-consumer_1.0_all.snap

[|] Prepare snap "/tmp/snapd-sideload-pkg-874964219"
[/] Mount snap "network-consumer"
[-] Mount snap "network-consumer"
[\] Setup snap "network-consumer" security profiles
[|] Setup snap "network-consumer" security profiles

Name              Version  Rev     Developer
network-consumer  1.0      100001  
snap list
Name                   Version               Rev     Developer
network-bind-consumer  1.0                   100001  
network-consumer       1.0                   100001  
ubuntu-core            16.04+20160420.05-02  113     canonical
PASS: <autogenerated>:43: networkBindInterfaceSuite.SetUpTest   1.463s

network-consumer http://127.0.0.1:8081
Bad system call
integration-tests/tests/network_bind_interface_test.go:44:
    output := cli.ExecCommand(c, "network-consumer", providerURL)
integration-tests/testutils/cli/cli.go:42:
    c.Assert(err, check.IsNil, check.Commentf("Error for %v: %v", cmds, output))
... value *exec.ExitError = 
&exec.ExitError{ProcessState:(*os.ProcessState)(0x18bb72a0), 
Stderr:[]uint8(nil)} ("exit status 159")
... Error for [network-consumer http://127.0.0.1:8081]: Bad system call


START: <autogenerated>:44: networkBindInterfaceSuite.TearDownTest
sudo snap remove network-bind-consumer

[|] Make snap "network-bind-consumer" unavailable to the system
[/] Make snap "network-bind-consumer" unavailable to the system
[-] Make snap "network-bind-consumer" unavailable to the system
[\] Make snap "network-bind-consumer" unavailable to the system
[|] Make snap "network-bind-consumer" unavailable to the system
[/] Remove security profile for snap "network-bind-consumer"
[-] Remove snap "network-bind-consumer" from the system
[\] Remove snap "network-bind-consumer" from the system
[|] Remove snap "network-bind-consumer" from the system
[/] Remove snap "network-bind-consumer" from the system
[-] Remove snap "network-bind-consumer" from the system

Done
snap list
Name              Version               Rev     Developer
network-consumer  1.0                   100001  
ubuntu-core       16.04+20160420.05-02  113     canonical
sudo snap remove network-consumer

[|] Remove snap "network-consumer" from the system
[/] Remove snap "network-consumer" from the system
[-] Remove snap "network-consumer" from the system
[\] Remove snap "network-consumer" from the system
[|] Remove snap "network-consumer" from the system

Done
snap list
Name         Version               Rev  Developer
ubuntu-core  16.04+20160420.05-02  113  canonical
PASS: <autogenerated>:44: networkBindInterfaceSuite.TearDownTest        1.946s

FAIL: integration-tests/tests/network_bind_interface_test.go:43:
networkBindInterfaceSuite.TestPlugDisconnectionDisablesClientConnection

[...]

START: integration-tests/tests/network_interface_test.go:41: 
networkInterfaceSuite.TestPlugDisconnectionDisablesFunctionality
START: <autogenerated>:49: networkInterfaceSuite.SetUpTest
****** Running networkInterfaceSuite.TestPlugDisconnectionDisablesFunctionality
snap list
Name         Version               Rev  Developer
ubuntu-core  16.04+20160420.05-02  113  canonical
sudo snap install 
integration-tests/data/snaps/network-bind-consumer/network-bind-consumer_1.0_all.snap

[|] Mount snap "network-bind-consumer"
[/] Mount snap "network-bind-consumer"
[-] Setup snap "network-bind-consumer" security profiles
[\] Setup snap "network-bind-consumer" security profiles
[|] Make snap "network-bind-consumer" available to the system
[/] Make snap "network-bind-consumer" available to the system

Name                   Version  Rev     Developer
network-bind-consumer  1.0      100001  
snap list
Name                   Version               Rev     Developer
network-bind-consumer  1.0                   100001  
ubuntu-core            16.04+20160420.05-02  113     canonical
sudo snap install 
integration-tests/data/snaps/network-consumer/network-consumer_1.0_all.snap

[|] Mount snap "network-consumer"
[/] Mount snap "network-consumer"
[-] Setup snap "network-consumer" security profiles
[\] Setup snap "network-consumer" security profiles
[|] Setup snap "network-consumer" security profiles

Name              Version  Rev     Developer
network-consumer  1.0      100001  
snap list
Name                   Version               Rev     Developer
network-bind-consumer  1.0                   100001  
network-consumer       1.0                   100001  
ubuntu-core            16.04+20160420.05-02  113     canonical
PASS: <autogenerated>:49: networkInterfaceSuite.SetUpTest       1.721s

network-consumer http://127.0.0.1:8081
Bad system call
integration-tests/tests/network_interface_test.go:44:
    output := cli.ExecCommand(c, "network-consumer", providerURL)
integration-tests/testutils/cli/cli.go:42:
    c.Assert(err, check.IsNil, check.Commentf("Error for %v: %v", cmds, output))
... value *exec.ExitError = 
&exec.ExitError{ProcessState:(*os.ProcessState)(0x18df48f0), 
Stderr:[]uint8(nil)} ("exit status 159")
... Error for [network-consumer http://127.0.0.1:8081]: Bad system call


START: <autogenerated>:50: networkInterfaceSuite.TearDownTest
sudo snap remove network-bind-consumer

[|] Make snap "network-bind-consumer" unavailable to the system
[/] Make snap "network-bind-consumer" unavailable to the system
[-] Make snap "network-bind-consumer" unavailable to the system
[\] Make snap "network-bind-consumer" unavailable to the system
[|] Make snap "network-bind-consumer" unavailable to the system
[/] Make snap "network-bind-consumer" unavailable to the system
[-] Remove security profile for snap "network-bind-consumer"
[\] Remove snap "network-bind-consumer" from the system
[|] Remove snap "network-bind-consumer" from the system
[/] Remove snap "network-bind-consumer" from the system
[-] Remove snap "network-bind-consumer" from the system
[\] Remove snap "network-bind-consumer" from the system

Done
snap list
Name              Version               Rev     Developer
network-consumer  1.0                   100001  
ubuntu-core       16.04+20160420.05-02  113     canonical
sudo snap remove network-consumer

[|] Remove snap "network-consumer" from the system
[/] Remove snap "network-consumer" from the system
[-] Remove snap "network-consumer" from the system
[\] Remove snap "network-consumer" from the system
[|] Remove snap "network-consumer" from the system

Done
snap list
Name         Version               Rev  Developer
ubuntu-core  16.04+20160420.05-02  113  canonical
PASS: <autogenerated>:50: networkInterfaceSuite.TearDownTest    2.060s

FAIL: integration-tests/tests/network_interface_test.go:41:
networkInterfaceSuite.TestPlugDisconnectionDisablesFunctionality

Sample log for a failed test run is:

https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac
/autopkgtest-yakkety/yakkety/i386/s/snapd/20160524_081656@/log.gz

Full list of test runs for yakkety is
http://autopkgtest.ubuntu.com/packages/s/snapd/yakkety/i386/

proposed-migration sees this is a regression (the tests in version 2.0.2
passed), so snapd uploads will not automatically migrate from yakkety-
proposed to yakkety.

The same test failures are also seen for snapd in xenial-proposed:
http://autopkgtest.ubuntu.com/packages/s/snapd/xenial/i386/

Since the package versions with these failing tests have been released
as SRUs, it appears the test failures aren't considered important by the
snappy team - so please disable these tests for i386 or mark them XFAIL
in some way, so that they don't interfere with the package's promotion
in either xenial or yakkety.

(Fixing the tests is also acceptable, of course, if that's
straightforward to do.)

** Affects: snapd (Ubuntu)
     Importance: Critical
         Status: New

** Changed in: snapd (Ubuntu)
   Importance: Undecided => Critical

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1588100

Title:
  snapd autopkgtest consistently fails on i386

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1588100/+subscriptions

-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to