[Bug 1797218] Re: boot hangs in curtin vmtest
'c' above can also be: 'sudo snap install' There, the install wont complain or fail, but running 'hello' will. $ sudo snap install hello 2018-10-11T17:54:21Z INFO Waiting for restart... hello 2.10 from 'canonical' installed $ echo $? 0 $ hello cannot create lock directory /run/snapd/lock: Permission denied -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
In another re-create scenario, you can see this fail on bionic. a.) launch bionic image somewhere b.) sudo sh -xc 'echo overlayroot=tmpfs > /etc/overlayroot.local.conf && reboot' c.) $ sudo snap install lxd 2018-10-11T17:44:22Z INFO Waiting for restart... error: cannot perform the following tasks: - Run install hook of "lxd" snap if present (run hook "install": cannot create lock directory /run/snapd/lock: Permission denied) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
After above recreate, you can login on console as 'root' with 'passw0rd'. You'll then see the system is still 'starting' (per systemctl status) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
Heres an even easier re-create $ url=http://cloud-images.ubuntu.com/cosmic/current/cosmic-server-cloudimg-amd64.img $ img=${url##*/} $ wget "${url}" -O "$img" $ sudo mount-image-callback "$img" -- \ mchroot sh -xc 'echo overlayroot=tmpfs > $1 && echo root:$2 | chpasswd' \ setup-image /etc/overlayroot.local.conf passw0rd ## launch qemu with whatever parms you want. ## I might suggest using (or learning) '-nographic' or '-snapshot' ## Simplist thing is: $ qemu-system-x86_64 -enable-kvm -hda cosmic-server-cloudimg-amd64.img -m 2048 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
(installation via maas) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
I am attempting to verify if installation of 18.10 is similarly broken. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
I noticed that the seeding of snaps in the cloud image also caused regression of the open-iscsi test [1] as seen from [2]. If anyone wants to debug this the open-iscsi test case provides doc on how to run it at [3] and I have a gist on it at [4]. Alternatively you can use uvt-kvm or multipass or any openstack or cloud instance to reproduce fairly easily. Here's how: ## Start a multipass guest. $ name=cosmic1 $ multipass launch daily:cosmic "--name=$name" ## write overlayroot.local.conf to enable overlayroot=tmpfs $ multipass exec $name sudo mv /etc/overlayroot.local.conf /etc/overlayroot.local.conf.dist $ multipass exec $name sudo sh -c 'echo overlayroot=tmpfs > /etc/overlayroot.local.conf' ## reboot $ multipass exec $name sudo reboot .. $ multipass shell $name ## To switch back to non-overlayroot, do $ multipass exec $name -- sudo overlayroot-chroot rm -f /etc/overlayroot.local.conf $ multipass exec $name sudo reboot -- [1] https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-cosmic/cosmic/amd64/o/open-iscsi/20181010_213729_f6165@/log.gz [2] http://autopkgtest.ubuntu.com/packages/o/open-iscsi/cosmic/amd64 [3] https://git.launchpad.net/~usd-import-team/ubuntu/+source/open-iscsi/tree/debian/tests/README-boot-test.md [4] https://gist.github.com/smoser/ffb519d00bafd2105abbc180c3410e76 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
Looking at this bug: https://bugs.launchpad.net/snappy/+bug/1665808 As we're in the same maas ephemeral environment; though we get a slightly different error. However the workaround included: sudo apt-get install -yu apparmor-utils sudo aa-complain /usr/lib/snapd/snap-confine does allow lxd snap to install. However, after that completes; the system quickly goes dead (100% cpu usage in the guest VCPUs preventing any input (ssh or serial console). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
The error I see is: Run install hook of "lxd" snap if present 2018-10-10T20:06:30Z ERROR run hook "install": cannot create lock directory /run/snapd/lock: Permission denied $ ls -al /run | grep snapd srw-rw-rw- 1 root root0 Oct 10 20:06 snapd-snap.socket srw-rw-rw- 1 root root0 Oct 10 20:06 snapd.socket -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
$ snap changes ID Status Spawn Ready Summary 1Error today at 19:46 UTC today at 19:47 UTC Initialize system state 2Donetoday at 19:46 UTC today at 19:46 UTC Initialize device 3Error today at 19:52 UTC today at 19:52 UTC Initialize system state # for i in 1 2 3; do echo $i ; snap change $i; done 2>&1 | pastebinit http://paste.ubuntu.com/p/FrFCyT3GH9/ -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
$ for service in $(cd /lib/systemd/system && ls snap*); do echo $service =; systemctl status --no-pager --full $service; done 2>&1 | pastebinit http://paste.ubuntu.com/p/57W9QnXwfQ/ ** Changed in: snapd (Ubuntu) Status: New => Confirmed ** Changed in: snapd (Ubuntu) Importance: Undecided => High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
$ systemctl status snapd --no-pager --full ● snapd.service - Snappy daemon Loaded: loaded (/lib/systemd/system/snapd.service; enabled; vendor preset: enabled) Active: active (running) since Wed 2018-10-10 19:47:19 UTC; 44s ago Main PID: 1960 (snapd) Tasks: 11 (limit: 1105) Memory: 27.4M CGroup: /system.slice/snapd.service └─1960 /usr/lib/snapd/snapd Oct 10 19:47:18 ubuntu systemd[1]: snapd.service: Scheduled restart job, restart counter is at 2. Oct 10 19:47:18 ubuntu systemd[1]: Stopped Snappy daemon. Oct 10 19:47:18 ubuntu systemd[1]: Starting Snappy daemon... Oct 10 19:47:19 ubuntu snapd[1960]: AppArmor status: apparmor is enabled and all features are available Oct 10 19:47:19 ubuntu snapd[1960]: backend.go:125: snapd enabled root filesystem on overlay support, additional upperdir permissions granted Oct 10 19:47:19 ubuntu snapd[1960]: helpers.go:249: removed stale connections: lxd:lxd-support core:lxd-support, lxd:network core:network, lxd:network-bind core:network-bind, lxd:system-observe core:system-observe Oct 10 19:47:19 ubuntu snapd[1960]: daemon.go:344: started snapd/2.35.4+18.10 (series 16; classic) ubuntu/18.10 (amd64) linux/4.18.0-8-generic. Oct 10 19:47:19 ubuntu systemd[1]: Started Snappy daemon. Oct 10 19:47:21 ubuntu snapd[1960]: handlers.go:389: Reported install problem for "core" as 4d395dae-ccc5-11e8-90ca-fa163e102db1 OOPSID -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1797218] Re: boot hangs in curtin vmtest
Jenkins jobs that run this are archived at https://jenkins.ubuntu.com/server/job/curtin-vmtest-devel-amd64/ -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1797218 Title: boot hangs in curtin vmtest To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1797218/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs