[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
Updated bug description and added Bionic bug task. Marked bug 1785081 as a duplicate of this bug. ** Also affects: linux (Ubuntu Bionic) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Bionic) Status: New => Triaged ** Changed in: linux (Ubuntu Bionic) Importance: Undecided => Critical ** Tags added: kernel-da-key ** Summary changed: - Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. + Ubuntu 18.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 18.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
But that new lp bug is sparse on details too can all comments be pushed through on https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1785081 ? What exactly is happening with the bionic kernel, and what is the expectation here? The comments in this bug report from cking still stand imho. Unless there is something else new? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
Dimitri, we've synced the other bug 1785081 that is probably the same issue as this one. F. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
For now reopening the states of this issue in launchpad as NEW and UNDECIDED priority. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
This bug was closed in january 2018. Are you sure this is the same issue / right ticket? I see that you have recently marked some other bug as a duplicate of this one. maybe you can sync that one? If not please state what is happening on 18.04 since in january it was believed that this issue was fixed. ** Changed in: linux (Ubuntu) Status: Invalid => New ** Changed in: linux (Ubuntu) Importance: Critical => Undecided ** Changed in: linux (Ubuntu) Assignee: Colin Ian King (colin-king) => (unassigned) ** Changed in: linux (Ubuntu Zesty) Assignee: Colin Ian King (colin-king) => (unassigned) ** Changed in: ubuntu-power-systems Status: Invalid => New ** Changed in: ubuntu-power-systems Importance: Critical => Undecided -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
** Tags removed: severity-critical ** Tags added: severity-high -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
--- Comment From dougm...@us.ibm.com 2018-05-14 13:40 EDT--- Note, we are still seeing issues with CFQ on 18.04 (Bionic). ** Tags removed: targetmilestone-inin1704 ** Tags added: targetmilestone-inin1804 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
These patches are available in Artful and will be available in the linux-hwe kernel, please upgrade to the latest linux-hwe and reopen this bug if you are able to reproduce it. Marking it invalid for now. ** Changed in: linux (Ubuntu) Status: In Progress => Invalid ** Changed in: ubuntu-power-systems Status: Incomplete => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
Ubuntu 17.04 has reached end of life. No further bugfixes will be applied to this version. ** Changed in: linux (Ubuntu Zesty) Status: In Progress => Won't Fix -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
Marking as "incomplete" until fix lands upstream. ** Changed in: ubuntu-power-systems Status: In Progress => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
** Tags removed: triage-r ** Tags added: triage-g -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
** Tags added: triage-r -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
Thanks for also testing with the latest upstream kernel and reporting it to the upstream developers. I've added the link to the bug so we pull in bug updates automatically from the bugzilla. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
Doug, "Can we get some answers as to why CFQ is the default scheduler? It seems like the expedient fix is to change the default to "deadline"." Sure. We went back to CFQ as it was showing to be a good general purpose I/O scheduler for a lot of wide ranging and general purpose I/O demands. Unfortunately you seem to have uncovered some cases where clearly it does not behave well for your use case where deadline would be more appropriate. Like all schedulers, it's hard to chose one that is going to meet every use case and every scenario perfectly, especially for a wide range of devices, device configurations, system memory size and file system choices. We do try to systematically check the performance and latencies of various synthetic test scenarios across a range of file systems on each kernel to try and spot issues: http://kernel.ubuntu.com/~cking/fs- tests/jun-2017/ CFQ has several tunables that may help your issue, I'd refer you to: https://www.kernel.org/doc/Documentation/block/cfq-iosched.txt it may be worth reviewing this document and then seeing if the CFQ can be tuned to improve the issues you are seeing. ** Also affects: linux via https://bugzilla.kernel.org/show_bug.cgi?id=196737 Importance: Unknown Status: Unknown -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
--- Comment From dougm...@us.ibm.com 2017-08-23 09:19 EDT--- Opened kernel.org bugzilla https://bugzilla.kernel.org/show_bug.cgi?id=196737 ** Bug watch added: Linux Kernel Bug Tracker #196737 https://bugzilla.kernel.org/show_bug.cgi?id=196737 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
I've rolled three patches into a test kernel to test. I believe the best fix is probably "cfq: Disable writeback throttling by default" https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=142bbdfccc8b3e9f7342f2ce8422e76a3b45beae The commits are: 4d608baac5f4e72b033a122b2d6d9499532c3afc "block: Initialize cfqq->ioprio_class in cfq_get_queue()" 142bbdfccc8b3e9f7342f2ce8422e76a3b45beae "cfq: Disable writeback throttling by default" 5be6b75610cefd1e21b98a218211922c2feb6e08 "cfq-iosched: fix the delay of cfq_group's vdisktime under iops mode" You can download the packages from: http://kernel.ubuntu.com/~cking/lp1709889/ Let me know if this helps with the issue. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
** Changed in: linux (Ubuntu) Assignee: Joseph Salisbury (jsalisbury) => Colin Ian King (colin-king) ** Changed in: linux (Ubuntu Zesty) Assignee: Joseph Salisbury (jsalisbury) => Colin Ian King (colin-king) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
I built a 17.04(Zesty) test kernel with a pick of commit 5be6b75610ce. This kernel can be downloaded from: http://kernel.ubuntu.com/~jsalisbury/lp1709889/ Can you test this kernel and see if it resolves this bug? I also see that commit 5be6b75610ce has been cc'd to upstream stable, but it has not landed in upstream 4.10.y yet. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
** Changed in: ubuntu-power-systems Status: New => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
** Changed in: linux (Ubuntu) Status: New => In Progress ** Changed in: linux (Ubuntu) Importance: Undecided => Critical ** Changed in: linux (Ubuntu) Assignee: Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage) => Joseph Salisbury (jsalisbury) ** Also affects: linux (Ubuntu Zesty) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Zesty) Status: New => In Progress ** Changed in: linux (Ubuntu Zesty) Importance: Undecided => Critical ** Changed in: linux (Ubuntu Zesty) Assignee: (unassigned) => Joseph Salisbury (jsalisbury) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1709889] Re: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time.
** Also affects: ubuntu-power-systems Importance: Undecided Status: New ** Changed in: ubuntu-power-systems Importance: Undecided => Critical ** Changed in: ubuntu-power-systems Assignee: (unassigned) => Canonical Kernel Team (canonical-kernel-team) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1709889 Title: Ubuntu 17.04: Bug in cfq scheduler, I/Os do not get submitted to adapter for a very long time. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1709889/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
