[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
Launchpad has imported 13 comments from the remote bug at https://bugzilla.redhat.com/show_bug.cgi?id=514901. If you reply to an imported comment from within Launchpad, your comment will be sent to the remote bug automatically. Read more about Launchpad's inter-bugtracker facilities at https://help.launchpad.net/InterBugTracking. On 2009-07-31T11:39:00+00:00 Jeff wrote: Created attachment 355795 dumpxml of the rawhide guest from virsh Opening as a rawhide kernel bug, but it could also be a problem with the host kernel or qemu instance. I have a rawhide kvm guest running on a Fedora 10 host. The guest's ring buffer is continually being spammed several times per second with this message: end_request: I/O error, dev vda, sector 0 ...everything seems to be working OK otherwise. The guest is currently running: 2.6.31-0.94.rc4.fc12.x86_64 ...but the problem has existed for quite some time with earlier kernels too. The host is running: 2.6.27.25-170.2.72.fc10.x86_64 ...and has: qemu-0.9.1-12.fc10.x86_64 kvm-74-10.fc10.x86_64 The guest is using the virtio block driver for the disk. Let me know if any other info would be useful. Reply at: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/420423/comments/0 On 2009-08-05T11:45:48+00:00 Mark wrote: Since we have a report of this on an F-11 host too, it sounds like a guest kernel bug: http://www.redhat.com/archives/fedora-virt/2009-August/msg0.html But AFAICS, we should only get this if: 1) There's is a read/write error on the disk image in the host. Of note here is that the disk image is an LVM volume /dev/rootvg64/rawhide 2) The guest issues a SCSI command Perhaps it's the serial number support: http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=commitdiff;h=1d589bb1 or the SG_IO passthru support: http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=commitdiff;h=1cde26f9 Both were added in 2.6.31-rc1 Reply at: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/420423/comments/1 On 2009-08-05T15:24:57+00:00 Jerry wrote: Mark asked me to try kernel-2.6.30-1.fc12.x86_64. With that kernel, I do not see the error message. Reply at: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/420423/comments/2 On 2009-08-05T22:16:55+00:00 Mark wrote: okay, the error is coming from here: bool blk_do_ordered(struct request_queue *q, struct request **rqp) { struct request *rq = *rqp; const int is_barrier = blk_fs_request(rq) && blk_barrier_rq(rq); if (!q->ordseq) { if (!is_barrier) return true; if (q->next_ordered != QUEUE_ORDERED_NONE) return start_ordered(q, rqp); else { /* * Queue ordering not supported. Terminate * with prejudice. */ blk_dequeue_request(rq); __blk_end_request_all(rq, -EOPNOTSUPP); partial stack trace: [] blk_update_request+0xca/0x363 [] ? debug_object_deactivate+0x47/0xf2 [] blk_update_bidi_request+0x2f/0x7f [] __blk_end_request_all+0x44/0x74 [] blk_do_ordered+0x1e0/0x2ae [] blk_peek_request+0x174/0x1c8 [] do_virtblk_request+0x192/0x1d3 [virtio_blk] [] __blk_run_queue+0x54/0x9a Reply at: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/420423/comments/3 On 2009-08-06T10:47:50+00:00 Mark wrote: Okay, reverting this: http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=commitdiff;h=52b1fd5a27 commit 52b1fd5a27c625c78373e024bf570af3c9d44a79 Author: Mikulas Patocka Date: Mon Jun 22 10:12:21 2009 +0100 dm: send empty barriers to targets in dm_flush Pass empty barrier flushes to the targets in dm_flush(). Signed-off-by: Mikulas Patocka Signed-off-by: Alasdair G Kergon fixes it for me Also, this little hack fixes it too: @@ -1163,7 +1163,7 @@ static int __make_request(struct request_queue *q, struct const int unplug = bio_unplug(bio); int rw_flags; - if (bio_barrier(bio) && bio_has_data(bio) && + if (bio_barrier(bio) && /* bio_has_data(bio) && */ (q->next_ordered == QUEUE_ORDERED_NONE)) { bio_endio(bio, -EOPNOTSUPP); return 0; virtio_blk doesn't support barriers, and it seems these empty barriers submitted by device-mapper are getting through to the device and causing these errors Reply at: https:
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
** Tags added: iso-testing -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
This bug was fixed in the package linux - 2.6.31-14.46 --- linux (2.6.31-14.46) karmic; urgency=low [ Andy Whitcroft ] * reinstate armel.mk with no flavours - LP: #449637 * [Upstream] elevator: fix fastfail checks to allow merge of readahead requests - LP: #444915 * [Upstream] block: silently error unsupported empty barriers too - LP: #420423 [ John Johansen ] * SAUCE: AppArmor: Fix mediation of "deleted" paths - LP: #415632 [ Tim Gardner ] * [Config] CONFIG_X86_MCE https://lists.ubuntu.com/archives/kernel-team/2009-October/007584.html * Revert "appletalk: Fix skb leak when ipddp interface is not loaded, CVE-2009-2903" - Use patch from 2.6.31.4 which is slightly different. [ Upstream Kernel Changes ] * x86: fix csum_ipv6_magic asm memory clobber * tty: Avoid dropping ldisc_mutex over hangup tty re-initialization * x86: Don't leak 64-bit kernel register values to 32-bit processes * tracing: correct module boundaries for ftrace_release * ftrace: check for failure for all conversions * futex: fix requeue_pi key imbalance * futex: Move exit_pi_state() call to release_mm() * futex: Nullify robust lists after cleanup * futex: Fix locking imbalance * NOHZ: update idle state also when NOHZ is inactive * ima: ecryptfs fix imbalance message * libata: fix incorrect link online check during probe * sound: via82xx: move DXS volume controls to PCM interface * ASoC: WM8350 capture PGA mutes are inverted * KVM: Prevent overflow in KVM_GET_SUPPORTED_CPUID * KVM: VMX: flush TLB with INVEPT on cpu migration * KVM: fix LAPIC timer period overflow * KVM: SVM: Fix tsc offset adjustment when running nested * KVM: SVM: Handle tsc in svm_get_msr/svm_set_msr correctly * net: Fix wrong sizeof * mm: add_to_swap_cache() must not sleep * sis5513: fix PIO setup for ATAPI devices * PIT fixes to unbreak suspend/resume (bug #14222) * IMA: open new file for read * ACPI: Clarify resource conflict message * ACPI: fix Compaq Evo N800c (Pentium 4m) boot hang regression * net: restore tx timestamping for accelerated vlans * net: unix: fix sending fds in multiple buffers * tun: Return -EINVAL if neither IFF_TUN nor IFF_TAP is set. * tcp: fix CONFIG_TCP_MD5SIG + CONFIG_PREEMPT timer BUG() * net: Fix sock_wfree() race * smsc95xx: fix transmission where ZLP is expected * sky2: Set SKY2_HW_RAM_BUFFER in sky2_init * appletalk: Fix skb leak when ipddp interface is not loaded * ax25: Fix possible oops in ax25_make_new * ax25: Fix SIOCAX25GETINFO ioctl * sit: fix off-by-one in ipip6_tunnel_get_prl * Linux 2.6.31.4 * drm/i915: Fix FDI M/N setting according with correct color depth - LP: #416792 -- Andy WhitcroftTue, 13 Oct 2009 12:06:59 +0100 ** Changed in: linux (Ubuntu) Status: Fix Committed => Fix Released ** CVE added: http://www.cve.mitre.org/cgi- bin/cvename.cgi?name=2009-2903 -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
Andy thanks for the quick response on this one. Far better than some of the "enterprise" distros are at fixing bug. -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
** Changed in: linux (Ubuntu) Status: In Progress => Fix Committed -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
Proposing for inclusion in the karmic release kernel. -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
** Branch linked: lp:ubuntu/qemu-kvm -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
This bug was fixed in the package qemu-kvm - 0.11.0-0ubuntu2 --- qemu-kvm (0.11.0-0ubuntu2) karmic; urgency=low * debian/patches/09_qemu-fix-qcow2-backing-file-with-virtio.patch: cherry-pick patch from Fedora, fix virtio/qcow2 issues, LP: #420423 * debian/patches/10_qemu-allow-pulseaudio-to-be-the-default.patch: needed to complete the fix for LP: #304649 * debian/control: improve description of qemu-kvm-extras, LP: #448655 -- Dustin KirklandSun, 11 Oct 2009 13:16:11 -0500 ** Changed in: qemu-kvm (Ubuntu) Status: In Progress => Fix Released -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
Andy- Brilliant! Works like a champ! Can we please get this into Karmic ASAP! :-Dustin -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 420423] Re: Running karmic as virtual machine with virtio hard disk outputs I/O errors
There's a related bug in qemu-kvm, which I'm about to upload a fix for, affecting virtio and qcow2 disks. Andy's kernel fix is needed too. I'm testing that now. :-Dustin ** Summary changed: - Running karmic as virtual machine with virtio hard disk outputs I/O erros + Running karmic as virtual machine with virtio hard disk outputs I/O errors -- Running karmic as virtual machine with virtio hard disk outputs I/O errors https://bugs.launchpad.net/bugs/420423 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs