[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
*** This bug is a duplicate of bug 1822247 *** https://bugs.launchpad.net/bugs/1822247 ** This bug has been marked a duplicate of bug 1822247 ubuntu_nbd_smoke_test failed on P9 with Bionic kernel -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1814237 Title: ubuntu_nbd_smoke_test failed with I/O error on X-4.15 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1814237/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
** Tags added: 4.15 xenial -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1814237 Title: ubuntu_nbd_smoke_test failed with I/O error on X-4.15 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1814237/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
** Tags added: ubuntu-nbd-smoke-test -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1814237 Title: ubuntu_nbd_smoke_test failed with I/O error on X-4.15 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1814237/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
Probably a dup with bug 1822247. Let's see if we can still see this in the next cycle. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1814237 Title: ubuntu_nbd_smoke_test failed with I/O error on X-4.15 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1814237/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
Affects , 4.15.0-1036.38~16.04.1 linux-aws-hwe -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1814237 Title: ubuntu_nbd_smoke_test failed with I/O error on X-4.15 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1814237/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
This bug appeared to surface on aws Bionic linux-aws kernel-version": "4.15.0-1035.37", AMD64 We also see this occurring on arm64 instances a1.medium so it does not appear to be arch specific. AMD64 Instances: c5.large , m4.large, m5a.large, r3.large , r5.large, t2.small and t3.medium. This is not 100% reproducible, if affects different instance types during each SRU cycle and appears to be random. However the failure, although not identical bit for bit, is a buffer I/O error I restarted a select few of the failed tests some passed completely and some failed again. I attempted to reproduce on m5a.large. 1.) Deploy m5a.large using cloud prov script with Bionic, ensure kernel is 4.15.0-1035.37 (in proposed at the time of writing this comment) 2.) Clone autotest and autotest-client-tests: git clone https://github.com/autotest/autotest.git git clone git://kernel.ubuntu.com/ubuntu/autotest-client-tests 3.) sudo apt-get update && sudo apt-get install python-pkg-resources 4.) untu@ip-172-31-10-8:~/autotest/client$ sudo ./autotest-local -d ~/autotest-client-tests/ ~/autotest-client- tests/ubuntu_nbd_smoke_test/control 19:42:55 INFO | Writing results to /home/ubuntu/autotest/client/results/default 19:42:55 INFO | START timestamp=1553283775localtime=Mar 22 19:42:55 19:42:55 INFO | START ubuntu_nbd_smoke_test.nbd-smoke-test ubuntu_nbd_smoke_test.nbd-smoke-testtimestamp=1553283775timeout=600 localtime=Mar 22 19:42:55 19:42:58 ERROR| [stderr] bs=1024, sz=134217728 bytes 19:42:58 ERROR| [stderr] timeout=30 19:42:58 ERROR| [stderr] e2fsck 1.44.1 (24-Mar-2018) 19:43:01 ERROR| Exception escaping from test: Traceback (most recent call last): File "/home/ubuntu/autotest/client/shared/test.py", line 411, in _exec _call_test_function(self.execute, *p_args, **p_dargs) File "/home/ubuntu/autotest/client/shared/test.py", line 823, in _call_test_function return func(*args, **dargs) File "/home/ubuntu/autotest/client/shared/test.py", line 291, in execute postprocess_profiled_run, args, dargs) File "/home/ubuntu/autotest/client/shared/test.py", line 212, in _call_run_once self.run_once(*args, **dargs) File "/home/ubuntu/autotest-client-tests/ubuntu_nbd_smoke_test/ubuntu_nbd_smoke_test.py", line 51, in run_once self.results = utils.system_output(cmd, retain_output=True) File "/home/ubuntu/autotest/client/shared/utils.py", line 1267, in system_output verbose=verbose, args=args).stdout File "/home/ubuntu/autotest/client/shared/utils.py", line 918, in run "Command returned non-zero exit status") CmdError: Command failed, rc=1, Command returned non-zero exit status * Command: /home/ubuntu/autotest-client- tests/ubuntu_nbd_smoke_test/ubuntu_nbd_smoke_test.sh Exit status: 1 Duration: 6.14667606354 stdout: creating backing nbd image /tmp/nbd_image.img Image path:/tmp/nbd_image.img Mount point: /mnt/nbd-test-7736 Date: Fri Mar 22 19:42:56 UTC 2019 Host: ip-172-31-10-8 Kernel:4.15.0-1034-aws #36-Ubuntu SMP Tue Mar 5 23:17:16 UTC 2019 Machine: ip-172-31-10-8 x86_64 x86_64 CPUs online: 2 CPUs total:2 Page size: 4096 Pages avail: 1641331 Pages total: 1977692 Free space: Filesystem Size Used Avail Use% Mounted on udev3.8G 0 3.8G 0% /dev tmpfs 773M 800K 772M 1% /run /dev/nvme0n1p1 7.7G 1.8G 6.0G 23% / tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/loop0 92M 92M 0 100% /snap/core/6531 /dev/loop1 18M 18M 0 100% /snap/amazon-ssm-agent/1068 tmpfs 773M 0 773M 0% /run/user/1000 NBD device /dev/nbd0 created found nbd export NBD exports found: test starting client with NBD device /dev/nbd0 Negotiation: ..size = 128MB creating ext4 on /dev/nbd0 mkfs on /dev/nbd0 succeeded after 0 attempt(s) checking ext4 on /dev/nbd0 fsck from util-linux 2.31.1 /dev/nbd0: clean, 11/32768 files, 9787/131072 blocks mount: /dev/nbd0 on /mnt/nbd-test-7736 type ext4 (rw,relatime,data=ordered) mounted on /dev/nbd0 free: Filesystem 1K-blocks Used Available Use% Mounted on /dev/nbd0 122835 1550112111 2% /mnt/nbd-test-7736 creating large file /mnt/nbd-test-7736/largefile -rw-r--r-- 1 root root 100M Mar 22 19:42 /mnt/nbd-test-7736/largefile free: Filesystem 1K-blocks Used Available Use% Mounted on /dev/nbd0 122835 103951 9710 92% /mnt/nbd-test-7736 removing file /mnt/nbd-test-7736/largefile unmounting /mnt/nbd-test-7736 stopping client disconnect, sock, done Found kernel warning, IO error and/or call trace echo [ 703.195406] creating backing nbd image /tmp/nbd_image.img [ 704.101923]
[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
Some more useful info: * This issue started to be caught by the testcase after the following test script change: https://kernel.ubuntu.com/git/ubuntu/autotest-client-tests.git/commit/ubuntu_nbd_smoke_test/ubuntu_nbd_smoke_test.sh?id=92ffd0ff14715392730943a898a95920b243ebef * I have traced back these I/O errors on released from a couple of months ago. Checked xenial/linux-hwe and bionic/linux-azure. * This doesn't seem to affect the master kernel, bionic/linux. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1814237 Title: ubuntu_nbd_smoke_test failed with I/O error on X-4.15 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1814237/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
Can we re-run this to see if it's 100% reproduceable? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1814237 Title: ubuntu_nbd_smoke_test failed with I/O error on X-4.15 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1814237/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1814237] Re: ubuntu_nbd_smoke_test failed with I/O error on X-4.15
I can see this test has passed with 4.15.0-44.47~16.04.1, so this might be a regression. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1814237 Title: ubuntu_nbd_smoke_test failed with I/O error on X-4.15 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1814237/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs