[PATCH BUGFIX V5] block: add missing group association in bio-cloning functions

2016-07-26 Thread Paolo Valente
association in bio-cloning functions. Fixes: da2f0f74cf7d ("Btrfs: add support for blkio controllers") Cc: sta...@vger.kernel.org # v4.3+ Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Reviewed-by: Nikolay Borisov <ker...@kyup.com> Reviewed-by: Jeff Moyer <jmo...@re

[PATCH RFC V8 08/22] block, cfq: get rid of latency tunables

2016-07-27 Thread Paolo Valente
warnings. The commit introducing low-latency heuristics in BFQ then restores only the boolean low_latency tunable. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/cfq-iosched.c | 31 +++ 1 file changed, 19 insertions(+), 12 deletions(-) diff --git a

[PATCH RFC V8 15/22] block, bfq: reduce I/O latency for soft real-time applications

2016-07-27 Thread Paolo Valente
ony requirements, then the end of the weight-raising period for the queue is moved forward, and so on. Note that an application whose associated queue never happens to be empty when it expires will never have the opportunity to be deemed as soft real-time. Signed-off-by: Paolo Valente <paol

[PATCH RFC V8 01/22] block, cfq: remove queue merging for close cooperators

2016-07-27 Thread Paolo Valente
ts then adds EQM. In that commit, we also explain in even more detail why the heuristic removed in this commit fails with an irregularly interleaved I/O. Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --

[PATCH RFC V8 03/22] block, cfq: remove deep seek queues logic

2016-07-27 Thread Paolo Valente
> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/cfq-iosched.c | 21 - 1 file changed, 4 insertions(+), 17 deletions(-) diff --git a/block/cfq-iosched.c b/block/cfq-iosched.c index 1b9fa10..870d1ba 100644 --- a/block/cfq-iosched.c +++ b/block/cf

[PATCH RFC V8 11/22] block, bfq: improve throughput boosting

2016-07-27 Thread Paolo Valente
unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- bl

[PATCH RFC V8 17/22] block, bfq: reduce latency during request-pool saturation

2016-07-27 Thread Paolo Valente
one. Along the same line, if there are weight-raised queues, then this patch halves the service rate of async (write) requests for non-weight-raised queues. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/c

[PATCH V2 08/22] block, cfq: get rid of latency tunables

2016-08-08 Thread Paolo Valente
warnings. The commit introducing low-latency heuristics in BFQ then restores only the boolean low_latency tunable. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/cfq-iosched.c | 36 1 file changed, 20 insertions(+), 16 deletions(-) diff

[PATCH V2 13/22] block, bfq: add more fairness with writes and slow processes

2016-08-08 Thread Paolo Valente
Annual International Systems and Storage Conference (SYSTOR '12), June 2012. Slightly extended version: http://algogroup.unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente <paolo.vale...

[PATCH V2 20/22] block, bfq: boost the throughput on NCQ-capable flash-based devices

2016-08-08 Thread Paolo Valente
of the throughput. In this case, to guarantee the desired throughput distribution, the device must be prevented from prefetching requests. This is exactly what this patch does in asymmetric scenarios. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avan

[PATCH V2 05/22] block, cfq: get rid of hierarchical support

2016-08-08 Thread Paolo Valente
zini.aria...@gmail.com> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/Kconfig.iosched |7 - block/cfq-iosched.c | 2144 - 2 files changed, 161 insertions(+), 1990 deletions(-) diff --git a/block/Kconfig.iosched b/blo

[PATCH V2 11/22] block, bfq: improve throughput boosting

2016-08-08 Thread Paolo Valente
unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- bl

[PATCH V2 14/22] block, bfq: improve responsiveness

2016-08-08 Thread Paolo Valente
. http://algogroup.unimore.it/people/paolo/disk_sched/mst-2015.pdf Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/Kconfig.iosched | 3 +- block/cfq-iosched.c | 762 --

[PATCH V2 02/22] block, cfq: remove close-based preemption

2016-08-08 Thread Paolo Valente
ed I/O. Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/cfq-iosched.c | 13 - 1 file changed, 13 deletions(-) diff --git a/block/cfq-iosched.c b/block/cfq-iosched.c index 10761b5..1ab8898 1006

[PATCH V2 01/22] block, cfq: remove queue merging for close cooperators

2016-08-08 Thread Paolo Valente
ts then adds EQM. In that commit, we also explain in even more detail why the heuristic removed in this commit fails with an irregularly interleaved I/O. Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --

[PATCH V2 10/22] block, bfq: add full hierarchical scheduling and cgroups support

2016-08-08 Thread Paolo Valente
ed-off-by: Fabio Checconi <fchecc...@gmail.com> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/Kconfig.iosched |7 + block/cfq-iosched.c | 1825

[PATCH V2 12/22] block, bfq: modify the peak-rate estimator

2016-08-08 Thread Paolo Valente
ter should converge more or less quickly to the right value. With the current values of the constants used in the filter, the latter seems to effectively smooth fluctuations and allow the estimator to converge to the actual peak rate with all the devices we tested. Signed-off-by: Paolo Vale

[PATCH V2 22/22] block, bfq: handle bursts of queue activations

2016-08-08 Thread Paolo Valente
idling and weight-raising for the queues belonging to these bursts. Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/cfq-iosched.c | 401 ++-- 1 file changed, 389

[PATCH V2 03/22] block, cfq: remove deep seek queues logic

2016-08-08 Thread Paolo Valente
> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/cfq-iosched.c | 20 +++- 1 file changed, 3 insertions(+), 17 deletions(-) diff --git a/block/cfq-iosched.c b/block/cfq-iosched.c index 1ab8898..04d2298 100644 --- a/block/cfq-iosched.c +++ b/block/cfq-iosch

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-02 Thread Paolo Valente
> Il giorno 02 feb 2017, alle ore 16:30, Jens Axboe <ax...@fb.com> ha scritto: > > On 02/02/2017 02:19 AM, Paolo Valente wrote: >> The scheme is clear. One comment, in case it could make sense and >> avoid more complexity: since put_rq_priv is invoked in two dif

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-02 Thread Paolo Valente
> Il giorno 02 feb 2017, alle ore 06:19, Jens Axboe <ax...@fb.com> ha scritto: > > On 02/01/2017 04:11 AM, Paolo Valente wrote: >>> +static bool dd_bio_merge(struct blk_mq_hw_ctx *hctx, struct bio *bio) >>> +{ >>> + struct request_queue *q = hctx-&g

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-01 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- > block/Kconfig.iosched |

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-01 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- > block/Kconfig.iosched |

[WIP PATCHSET 0/4] WIP branch for bfq-mq

2017-02-07 Thread Paolo Valente
-mq.h, which, at the beginning, are just copies of bfq-iosched.c and bfq.h. Thanks, Paolo [1] https://github.com/Algodev-github/bfq-mq Paolo Valente (4): blk-mq: pass bio to blk_mq_sched_get_rq_priv Move thinktime from bic to bfqq Embed bfq-ioc.c and add locking on request queue Modify

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-07 Thread Paolo Valente
> Il giorno 02 feb 2017, alle ore 22:32, Jens Axboe <ax...@fb.com> ha scritto: > > On 02/02/2017 02:15 PM, Paolo Valente wrote: >> >>> Il giorno 02 feb 2017, alle ore 16:30, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> On 02/02/2017 0

[PATCH] bfq-mq: cause deadlock by executing exit_icq body immediately

2017-02-07 Thread Paolo Valente
98 [ 44.254690] R10: 7ffc9cc437c8 R11: 0246 R12: 0000 [ 44.255674] R13: 7fd70b523c40 R14: R15: Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/bfq-mq-iosched.c | 34 +++--- block/bfq

[WIP PATCHSET 4/4] Modify interface and operation to comply with blk-mq-sched

2017-02-07 Thread Paolo Valente
the scheduler lock, and, if not deferred, 2) it does so from inside the exit_icq hook, which is invoked with the queue lock held, and 3) there is at least one code path, namely that starting from bfq_bio_merge, which takes these locks in the opposite order. Signed-off-by: Paolo Valente <paolo.v

[WIP PATCHSET 3/4] Embed bfq-ioc.c and add locking on request queue

2017-02-07 Thread Paolo Valente
-ioc.c into bfq-mq-iosched.c, and adds the grabbing of the lock. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/bfq-mq-iosched.c | 39 --- 1 file changed, 36 insertions(+), 3 deletions(-) diff --git a/block/bfq-mq-iosched.c b/block/

[WIP PATCHSET 1/4] blk-mq: pass bio to blk_mq_sched_get_rq_priv

2017-02-07 Thread Paolo Valente
bio is used in bfq-mq's get_rq_priv, to get the request group. We could pass directly the group here, but I thought that passing the bio was more general, giving the possibility to get other pieces of information if needed. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/

[WIP PATCHSET 2/4] Move thinktime from bic to bfqq

2017-02-07 Thread Paolo Valente
Prep change to make it possible to protect this field with a scheduler lock. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/bfq-mq-iosched.c | 28 ++-- block/bfq-mq.h | 30 -- 2 files changed, 30 insertions(

Re: [PATCH] bfq-mq: cause deadlock by executing exit_icq body immediately

2017-02-08 Thread Paolo Valente
> Il giorno 08 feb 2017, alle ore 11:33, Omar Sandoval <osan...@osandov.com> ha > scritto: > > On Wed, Feb 08, 2017 at 11:03:01AM +0100, Paolo Valente wrote: >> >>> Il giorno 07 feb 2017, alle ore 22:45, Omar Sandoval <osan...@osandov.com> >>>

Re: [PATCH] bfq-mq: cause deadlock by executing exit_icq body immediately

2017-02-08 Thread Paolo Valente
> Il giorno 07 feb 2017, alle ore 22:45, Omar Sandoval <osan...@osandov.com> ha > scritto: > > On Tue, Feb 07, 2017 at 06:33:46PM +0100, Paolo Valente wrote: >> Hi, >> this patch is meant to show that, if the body of the hook exit_icq is >&g

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-25 Thread Paolo Valente
> Il giorno 23 gen 2017, alle ore 18:42, Jens Axboe <ax...@fb.com> ha scritto: > > On 01/23/2017 10:04 AM, Paolo Valente wrote: >> >>> Il giorno 18 gen 2017, alle ore 17:21, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> On 01

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-26 Thread Paolo Valente
> Il giorno 25 gen 2017, alle ore 17:13, Jens Axboe <ax...@fb.com> ha scritto: > > On 01/25/2017 01:46 AM, Paolo Valente wrote: >> >>> Il giorno 23 gen 2017, alle ore 18:42, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> On 01/23/2017 10:04

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 20 gen 2017, alle ore 14:14, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > >> >> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >> >> This is basically identical to deadline-iosched, exc

Re: [PATCH] blk-mq-sched: don't hold queue_lock when calling exit_icq

2017-02-22 Thread Paolo Valente
> Il giorno 17 feb 2017, alle ore 11:30, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > > >> Il giorno 16 feb 2017, alle ore 11:31, Paolo Valente >> <paolo.vale...@linaro.org> ha scritto: >> >>> >>> Il giorno 15 fe

Re: [WIP PATCHSET 0/4] WIP branch for bfq-mq

2017-02-22 Thread Paolo Valente
> Il giorno 13 feb 2017, alle ore 23:38, Bart Van Assche > <bart.vanass...@sandisk.com> ha scritto: > > On Mon, 2017-02-13 at 22:07 +, Bart Van Assche wrote: >> On Mon, 2017-02-13 at 22:07 +0100, Paolo Valente wrote: >>> but what do you think ab

[WIP BRANCH] cgroups support in bfq-mq WIP branch

2017-02-25 Thread Paolo Valente
Hi, I've just completed cgroups support, and I'd like to highlight the main blk-mq issue that I have found along the way. I have pushed the commit that completes the support for cgroups to the usual WIP branch [1]. Before moving to this issue, I have preliminary question about the scheduler

Re: [WIP PATCHSET 0/4] WIP branch for bfq-mq

2017-02-13 Thread Paolo Valente
> Il giorno 10 feb 2017, alle ore 20:49, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > >> >> Il giorno 10 feb 2017, alle ore 19:13, Bart Van Assche >> <bart.vanass...@sandisk.com> ha scritto: >> >> On 02/10/2017 08:49 AM,

Re: [WIP PATCHSET 0/4] WIP branch for bfq-mq

2017-02-13 Thread Paolo Valente
> Il giorno 07 feb 2017, alle ore 18:24, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > > Hi, > > I have finally pushed here [1] the current WIP branch of bfq for > blk-mq, which I have tentatively named bfq-mq. > > This branch *IS NOT* meant for

[PATCH BUGFIX] block: make elevator_get robust against cross blk/blk-mq choice

2017-02-13 Thread Paolo Valente
elevator_get fail for these wrong cross choices. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> --- block/elevator.c | 26 ++ 1 file changed, 18 insertions(+), 8 deletions(-) diff --git a/block/elevator.c b/block/elevator.c index 27ff1ed..a25bdd9 100644 --- a

[PATCH BUGFIX] attempt to fix wrong scheduler selection

2017-02-13 Thread Paolo Valente
, to report this issue, and, second, to propose a possible fix in case you do consider this as a bug. Thanks, Paolo Paolo Valente (1): block: make elevator_get robust against cross blk/blk-mq choice block/elevator.c | 26 ++ 1 file changed, 18 insertions(+), 8 deletions

Re: [PATCH BUGFIX] block: make elevator_get robust against cross blk/blk-mq choice

2017-02-14 Thread Paolo Valente
> Il giorno 14 feb 2017, alle ore 00:10, Jens Axboe <ax...@kernel.dk> ha > scritto: > > On 02/13/2017 03:28 PM, Jens Axboe wrote: >> On 02/13/2017 03:09 PM, Omar Sandoval wrote: >>> On Mon, Feb 13, 2017 at 10:01:07PM +0100, Paolo Valente wrote: >>>>

Re: [WIP PATCHSET 0/4] WIP branch for bfq-mq

2017-02-10 Thread Paolo Valente
> Il giorno 10 feb 2017, alle ore 17:45, Bart Van Assche > <bart.vanass...@sandisk.com> ha scritto: > > On Tue, 2017-02-07 at 18:24 +0100, Paolo Valente wrote: >> 2) Enable people to test this first version bfq-mq. > > Hello Paolo, > > I installed this vers

Re: [WIP PATCHSET 0/4] WIP branch for bfq-mq

2017-02-10 Thread Paolo Valente
> Il giorno 10 feb 2017, alle ore 19:13, Bart Van Assche > <bart.vanass...@sandisk.com> ha scritto: > > On 02/10/2017 08:49 AM, Paolo Valente wrote: >>> $ grep '^C.*_MQ_' .config >>> CONFIG_BLK_MQ_PCI=y >>> CONFIG_MQ_IOSCHED_BFQ=y >>> CON

Re: [WIP PATCHSET 0/4] WIP branch for bfq-mq

2017-02-10 Thread Paolo Valente
> Il giorno 10 feb 2017, alle ore 19:34, Bart Van Assche > <bart.vanass...@sandisk.com> ha scritto: > > On Tue, 2017-02-07 at 18:24 +0100, Paolo Valente wrote: >> (lock assertions, BUG_ONs, ...). > > Hello Paolo, > > If you are using BUG_ON(), does that

Re: [WIP PATCHSET 0/4] WIP branch for bfq-mq

2017-02-10 Thread Paolo Valente
> Il giorno 10 feb 2017, alle ore 17:08, Bart Van Assche > <bart.vanass...@sandisk.com> ha scritto: > > On Tue, 2017-02-07 at 18:24 +0100, Paolo Valente wrote: >> [1] https://github.com/Algodev-github/bfq-mq > > Hello Paolo, > > That branch includ

Re: [PATCH BUGFIX] block: make elevator_get robust against cross blk/blk-mq choice

2017-02-14 Thread Paolo Valente
> Il giorno 14 feb 2017, alle ore 16:16, Jens Axboe <ax...@kernel.dk> ha > scritto: > > On 02/14/2017 01:14 AM, Paolo Valente wrote: >> >>> Il giorno 14 feb 2017, alle ore 00:10, Jens Axboe <ax...@kernel.dk> ha >>> scritto: >>> >>

Re: [PATCH] bfq-mq: cause deadlock by executing exit_icq body immediately

2017-02-10 Thread Paolo Valente
> Il giorno 08 feb 2017, alle ore 18:17, Omar Sandoval <osan...@osandov.com> ha > scritto: > > On Wed, Feb 08, 2017 at 11:39:24AM +0100, Paolo Valente wrote: >> >>> Il giorno 08 feb 2017, alle ore 11:33, Omar Sandoval <osan...@osandov.com> >>>

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-02-16 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe ... > + > +static void

Re: [PATCH] blk-mq-sched: don't hold queue_lock when calling exit_icq

2017-02-16 Thread Paolo Valente
> Il giorno 15 feb 2017, alle ore 19:04, Jens Axboe <ax...@fb.com> ha scritto: > > On 02/15/2017 10:58 AM, Jens Axboe wrote: >> On 02/15/2017 10:24 AM, Paolo Valente wrote: >>> >>>> Il giorno 10 feb 2017, alle ore 19:32, Omar Sandoval <osan...@o

Re: [PATCH] blk-mq-sched: don't hold queue_lock when calling exit_icq

2017-02-15 Thread Paolo Valente
139.761064] RDX: 0005 RSI: 01560008 RDI: 0001 [ 139.811601] RBP: 0004 R08: 7f862bc48780 R09: 7f862c27f700 [ 139.867906] R10: 0004 R11: 0246 R12: 0004 [ 139.881848] R13: 01587b28 R14: R15:

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-23 Thread Paolo Valente
> Il giorno 18 gen 2017, alle ore 17:21, Jens Axboe <ax...@fb.com> ha scritto: > > On 01/18/2017 08:14 AM, Paolo Valente wrote: >> according to the function blk_mq_sched_put_request, the >> mq.completed_request hook seems to always be invoked (if set)

Re: [PATCH] blk-mq-sched: don't hold queue_lock when calling exit_icq

2017-02-17 Thread Paolo Valente
> Il giorno 16 feb 2017, alle ore 11:31, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > >> >> Il giorno 15 feb 2017, alle ore 19:04, Jens Axboe <ax...@fb.com> ha scritto: >> >> On 02/15/2017 10:58 AM, Jens Axboe wrote: >>> On 02

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2017-01-17 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/22/2016 04:13 AM, Paolo Valente wrote: >> >>> Il giorno 22 dic 2016, alle ore 10:59, Paolo Valente >>> <paolo.vale...@linaro.org> ha scritto: >>>

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-17 Thread Paolo Valente
[NEW RESEND ATTEMPT] > Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/22/2016 08:28 AM, Paolo Valente wrote: >> >>> Il giorno 19 dic 2016, alle ore 22:05, Jens Axboe <ax...@fb.com> ha scritto: >>> &g

Re: [PATCHSET v4] blk-mq-scheduling framework

2017-01-18 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 11:49, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > > [NEW RESEND ATTEMPT] > >> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: >> >> On 12/22/2016 08:28 AM, Paolo Valente

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > Jens, no spin_lock_irq* in the code. So, also request dispatches are

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2017-01-20 Thread Paolo Valente
> Il giorno 17 gen 2017, alle ore 03:47, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/22/2016 09:49 AM, Paolo Valente wrote: >> >>> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> This is basica

Re: [PATCH] blk-mq-sched: don't hold queue_lock when calling exit_icq

2017-03-02 Thread Paolo Valente
> Il giorno 15 feb 2017, alle ore 19:04, Jens Axboe <ax...@fb.com> ha scritto: > > On 02/15/2017 10:58 AM, Jens Axboe wrote: >> On 02/15/2017 10:24 AM, Paolo Valente wrote: >>> >>>> Il giorno 10 feb 2017, alle ore 19:32, Omar Sandoval <osan...@o

Re: [PATCH V2 00/22] Replace the CFQ I/O Scheduler with BFQ

2016-09-05 Thread Paolo Valente
Il giorno 05/set/2016, alle ore 17:56, Bartlomiej Zolnierkiewicz ha scritto: > > Hi, > > On Thursday, September 01, 2016 10:39:46 AM Linus Walleij wrote: >> On Thu, Sep 1, 2016 at 12:09 AM, Mark Brown wrote: >> >>> - Do some benchmarks on the

Re: [RFD] I/O scheduling in blk-mq

2016-08-31 Thread Paolo Valente
Il giorno 08/ago/2016, alle ore 22:09, Omar Sandoval ha scritto: > On Mon, Aug 08, 2016 at 04:09:56PM +0200, Paolo wrote: >> Hi Jens, Tejun, Christoph, all, >> AFAIK blk-mq does not yet feature I/O schedulers. In particular, there >> is no scheduler providing strong

Re: [PATCH 0/8] Throttled background buffered writeback v7

2016-09-09 Thread Paolo Valente
++ > include/linux/writeback.h | 10 > include/trace/events/wbt.h | 153 > lib/Kconfig |3 > lib/Makefile|1 > lib/wbt.c | 679 >

Re: [RFD] I/O scheduling in blk-mq

2016-09-30 Thread Paolo Valente
Hi Omar, have you had a chance to look at these last questions of mine? Thanks, Paolo > Il giorno 31 ago 2016, alle ore 17:20, Paolo Valente > <paolo.vale...@linaro.org> ha scritto: > > > Il giorno 08/ago/2016, alle ore 22:09, Omar Sandoval <osan...@osandov.com>

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-05 Thread Paolo Valente
> Il giorno 04 ott 2016, alle ore 22:27, Tejun Heo <t...@kernel.org> ha scritto: > > Hello, Paolo. > > On Tue, Oct 04, 2016 at 09:29:48PM +0200, Paolo Valente wrote: >>> Hmm... I think we already discussed this but here's a really simple >>> case. There

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-05 Thread Paolo Valente
> Il giorno 05 ott 2016, alle ore 15:12, Vivek Goyal <vgo...@redhat.com> ha > scritto: > > On Wed, Oct 05, 2016 at 02:37:00PM +0200, Paolo Valente wrote: > > [..] >> Anyway, to avoid going on with trying speculations and arguments, let >> me retry wi

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 09:58, Paolo Valente > <paolo.vale...@unimore.it> ha scritto: > >> >> Il giorno 05 ott 2016, alle ore 22:46, Shaohua Li <s...@fb.com> ha scritto: >> >> On Wed, Oct 05, 2016 at 09:47:19PM +0200, Paolo Valente wrote:

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
issue, which is not very clear to me. Over the last five years I have not found a single workload for which CFQ is better than BFQ, and none has been suggested. Anyway, leaving aside this fact, IMO the real problem here is that we are in a catch-22: "we want BFQ to replace CFQ, but, since CFQ

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-04 Thread Paolo Valente
> Il giorno 04 ott 2016, alle ore 21:14, Tejun Heo <t...@kernel.org> ha scritto: > > Hello, Paolo. > > On Tue, Oct 04, 2016 at 09:02:47PM +0200, Paolo Valente wrote: >> That's exactly what BFQ has succeeded in doing in all the tests >> devised so far. C

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 21:57, Shaohua Li <s...@fb.com> ha scritto: > > On Thu, Oct 06, 2016 at 09:58:44AM +0200, Paolo Valente wrote: >> >>> Il giorno 05 ott 2016, alle ore 22:46, Shaohua Li <s...@fb.com> ha scritto: >>> >>> O

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-06 Thread Paolo Valente
> Il giorno 06 ott 2016, alle ore 20:32, Vivek Goyal <vgo...@redhat.com> ha > scritto: > > On Thu, Oct 06, 2016 at 08:01:42PM +0200, Paolo Valente wrote: >> >>> Il giorno 06 ott 2016, alle ore 19:49, Vivek Goyal <vgo...@redhat.com> ha >>> scri

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-04 Thread Paolo Valente
gt; be enough. > > I don't think it's catering to specific use cases. It is a generic > mechanism which demands knowledge and experimentation to configure. > It's more a way for the kernel to cop out and defer figuring out > device characteristics to userland. If you have a better idea, I'm

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-05 Thread Paolo Valente
> Il giorno 05 ott 2016, alle ore 21:47, Paolo Valente > <paolo.vale...@unimore.it> ha scritto: > >> >> Il giorno 05 ott 2016, alle ore 20:30, Shaohua Li <s...@fb.com> ha scritto: >> >> On Wed, Oct 05, 2016 at 10:49:46AM -0400, Tejun Heo wrote: &g

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-29 Thread Paolo Valente
> Il giorno 29 ott 2016, alle ore 16:12, Jens Axboe <ax...@kernel.dk> ha > scritto: > > On 10/28/2016 11:38 PM, Paolo Valente wrote: >> >>> Il giorno 26 ott 2016, alle ore 18:12, Jens Axboe <ax...@kernel.dk> ha >>> scritto: >>> >&g

blk-mq: preparation of the ground for BFQ inclusion

2016-11-14 Thread Paolo Valente
Hi Jens, have you had time to look into the first extensions/changes required? Any time plan? Thanks, Paolo -- To unsubscribe from this list: send the line "unsubscribe linux-block" in the body of a message to majord...@vger.kernel.org More majordomo info at

[PATCH 03/14] block, bfq: improve throughput boosting

2016-10-26 Thread Paolo Valente
unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- bl

[PATCH 06/14] block, bfq: improve responsiveness

2016-10-26 Thread Paolo Valente
. http://algogroup.unimore.it/people/paolo/disk_sched/mst-2015.pdf Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/Kconfig.iosched | 3 +- block/bfq-iosched.c | 785 --

[PATCH 09/14] block, bfq: reduce latency during request-pool saturation

2016-10-26 Thread Paolo Valente
one. Along the same line, if there are weight-raised queues, then this patch halves the service rate of async (write) requests for non-weight-raised queues. Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/b

[PATCH 02/14] block, bfq: add full hierarchical scheduling and cgroups support

2016-10-26 Thread Paolo Valente
ed-off-by: Fabio Checconi <fchecc...@gmail.com> Signed-off-by: Paolo Valente <paolo.vale...@linaro.org> Signed-off-by: Arianna Avanzini <avanzini.aria...@gmail.com> --- block/Kconfig.iosched |7 + block/bfq-iosched.c| 1789 +++- inclu

[PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-26 Thread Paolo Valente
ttps://lkml.org/lkml/2016/2/1/818 Arianna Avanzini (4): block, bfq: add full hierarchical scheduling and cgroups support block, bfq: add Early Queue Merge (EQM) block, bfq: reduce idling only in symmetric scenarios block, bfq: handle bursts of queue activations Paolo Valente (10): bloc

[PATCH 05/14] block, bfq: add more fairness with writes and slow processes

2016-10-26 Thread Paolo Valente
Annual International Systems and Storage Conference (SYSTOR '12), June 2012. Slightly extended version: http://algogroup.unimore.it/people/paolo/disk_sched/bfq-v1-suite- results.pdf Signed-off-by: Paolo Valente <paolo.vale...

Re: [PATCH 00/14] introduce the BFQ-v0 I/O scheduler as an extra scheduler

2016-10-28 Thread Paolo Valente
> Il giorno 26 ott 2016, alle ore 18:12, Jens Axboe <ax...@kernel.dk> ha > scritto: > > On 10/26/2016 10:04 AM, Paolo Valente wrote: >> >>> Il giorno 26 ott 2016, alle ore 17:32, Jens Axboe <ax...@kernel.dk> ha >>> scritto: >>> >>

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-16 Thread Paolo Valente
> Il giorno 14 ott 2016, alle ore 20:35, Tejun Heo <t...@kernel.org> ha scritto: > > Hello, Paolo. > > On Fri, Oct 14, 2016 at 07:13:41PM +0200, Paolo Valente wrote: >> That said, your 'thus' seems a little too strong: "bfq does not yet >> handle fast SSD

Re: [PATCH V3 00/11] block-throttle: add .high limit

2016-10-14 Thread Paolo Valente
, that's absolutely true. I'm already thinking about an idleless solution. As I already wrote, I'm willing to help with scheduling in blk-mq. I hope there will be the opportunity to find some way to go at KS. Thanks, Paolo > Thanks. > > -- > tejun -- Paolo Valente Algogroup Dipartime

Re: [PATCHSET/RFC v2] blk-mq scheduling framework

2016-12-13 Thread Paolo Valente
> Il giorno 08 dic 2016, alle ore 21:13, Jens Axboe ha scritto: > > As a followup to this posting from yesterday: > > https://marc.info/?l=linux-block=148115232806065=2 > > this is version 2. I wanted to post a new one fairly quickly, as there > ended up being a number of

Re: [PATCHSET v6] blk-mq scheduling framework

2017-01-15 Thread Paolo Valente
> Il giorno 11 gen 2017, alle ore 22:39, Jens Axboe ha scritto: > > Another year, another posting of this patchset. The previous posting > was here: > > https://www.spinics.net/lists/kernel/msg2406106.html > > (yes, I've skipped v5, it was fixes on top of v4, not the rework). >

Re: [PATCHSET/RFC v2] Make legacy IO schedulers work with blk-mq

2016-12-06 Thread Paolo Valente
> Il giorno 05 dic 2016, alle ore 19:26, Jens Axboe ha scritto: > > Version 2 of the hack/patchset, that enables blk-mq to use the legacy > IO schedulers with single queue devices. Original posting is here: > > https://marc.info/?l=linux-block=148073493203664=2 > > You can also

Re: [LSF/MM ATTEND AND AGENDA TOPIC] request to attend the summit

2017-01-03 Thread Paolo Valente
> Il giorno 03 gen 2017, alle ore 09:17, Bart Van Assche > <bart.vanass...@sandisk.com> ha scritto: > > On Mon, 2017-01-02 at 19:14 +0100, Paolo Valente wrote: >> This is to retry to request to attend the summit. This time I'm >> trying to propose and agenda

Re: [LSF/MM ATTEND AND AGENDA TOPIC] request to attend the summit

2017-01-03 Thread Paolo Valente
> Il giorno 03 gen 2017, alle ore 13:00, Bart Van Assche > <bart.vanass...@sandisk.com> ha scritto: > > On Tue, 2017-01-03 at 10:39 +0100, Paolo Valente wrote: >> In this respect, I hope that the committee does not meet too soon. > > Hello Paolo, > Hi

[LSF/MM ATTEND AND AGENDA TOPIC] request to attend the summit

2017-01-02 Thread Paolo Valente
Hi, this is to retry to request to attend the summit. This time I'm trying to propose and agenda topic too. I would like to attend, and propose a topic, because: 1) the project for adding (only) the BFQ I/O scheduler to blk-mq has entered a quite active phase: the framework prepared by Jens

Re: [LSF/MM ATTEND AND AGENDA TOPIC] request to attend the summit

2017-01-08 Thread Paolo Valente
> Il giorno 08 gen 2017, alle ore 17:30, Bart Van Assche > <bart.vanass...@sandisk.com> ha scritto: > > On Tue, 2017-01-03 at 10:39 +0100, Paolo Valente wrote: >>> Il giorno 03 gen 2017, alle ore 09:17, Bart Van Assche >> c...@sandisk.com> ha scritto: &g

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-19 Thread Paolo Valente
> Il giorno 19 dic 2016, alle ore 16:20, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/19/2016 04:32 AM, Paolo Valente wrote: >> >>> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> This is

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > ... > + > +static bool

Re: [PATCH 3/8] block: move rq_ioc() to blk.h

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > We want to use it outside of blk-core.c. > Hi Jens, no hooks equivalent to elevator_init_icq_fn and elevator_exit_icq_fn are invoked. In particular, the second hook let bfq (as with cfq) know when it could

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-20 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This adds a set of hooks that intercepts the blk-mq path of > allocating/inserting/issuing/completing requests, allowing > us to develop a scheduler within that framework. > > We reuse the existing elevator

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > One last question (for today ...):in mq-deadline there are no "schedule

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-22 Thread Paolo Valente
> Il giorno 19 dic 2016, alle ore 22:05, Jens Axboe <ax...@fb.com> ha scritto: > > On 12/19/2016 11:21 AM, Paolo Valente wrote: >> >>> Il giorno 19 dic 2016, alle ore 16:20, Jens Axboe <ax...@fb.com> ha scritto: >>> >>> On 12/19/2016 04:32

Re: [PATCH 7/8] mq-deadline: add blk-mq adaptation of the deadline IO scheduler

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is basically identical to deadline-iosched, except it registers > as a MQ capable scheduler. This is still a single queue design. > > Signed-off-by: Jens Axboe > --- ... > diff --git

Re: [PATCH 6/8] blk-mq-sched: add framework for MQ capable IO schedulers

2016-12-22 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This adds a set of hooks that intercepts the blk-mq path of > allocating/inserting/issuing/completing requests, allowing > us to develop a scheduler within that framework. > > We reuse the existing elevator

Re: [PATCHSET v4] blk-mq-scheduling framework

2016-12-19 Thread Paolo Valente
> Il giorno 17 dic 2016, alle ore 01:12, Jens Axboe ha scritto: > > This is version 4 of this patchset, version 3 was posted here: > > https://marc.info/?l=linux-block=148178513407631=2 > > From the discussion last time, I looked into the feasibility of having > two sets of tags

  1   2   3   4   5   >