Re: Read starvation by sync writes

2013-01-23 Thread Jeff Moyer
Jens Axboe writes: >>> The problem is really that the WRITE_SYNC is (for Jan's case) behaving >>> like buffered writes, so it eats up a queue of requests very easily. On >>> the allocation side, the assumption is that WRITE_SYNC behaves like >>> dependent reads. Similar to a dd with

Re: Read starvation by sync writes

2013-01-23 Thread Jeff Moyer
Jens Axboe ax...@kernel.dk writes: The problem is really that the WRITE_SYNC is (for Jan's case) behaving like buffered writes, so it eats up a queue of requests very easily. On the allocation side, the assumption is that WRITE_SYNC behaves like dependent reads. Similar to a dd with

Re: Read starvation by sync writes

2012-12-13 Thread Jens Axboe
On 2012-12-13 16:02, Jan Kara wrote: > On Thu 13-12-12 14:30:42, Jens Axboe wrote: >> On 2012-12-12 20:41, Jeff Moyer wrote: >>> Jeff Moyer writes: >>> > I agree. This isn't about scheduling, we haven't even reached that part > yet. Back when we split the queues into read vs write, this

Re: Read starvation by sync writes

2012-12-13 Thread Jan Kara
On Thu 13-12-12 14:30:42, Jens Axboe wrote: > On 2012-12-12 20:41, Jeff Moyer wrote: > > Jeff Moyer writes: > > > >>> I agree. This isn't about scheduling, we haven't even reached that part > >>> yet. Back when we split the queues into read vs write, this problem > >>> obviously wasn't there.

Re: Read starvation by sync writes

2012-12-13 Thread Jeff Moyer
Jens Axboe writes: > On 2012-12-12 20:41, Jeff Moyer wrote: >> Jeff Moyer writes: >> I agree. This isn't about scheduling, we haven't even reached that part yet. Back when we split the queues into read vs write, this problem obviously wasn't there. Now we have sync writes and

Re: Read starvation by sync writes

2012-12-13 Thread Jens Axboe
On 2012-12-12 20:41, Jeff Moyer wrote: > Jeff Moyer writes: > >>> I agree. This isn't about scheduling, we haven't even reached that part >>> yet. Back when we split the queues into read vs write, this problem >>> obviously wasn't there. Now we have sync writes and reads, both eating >>> from

Re: Read starvation by sync writes

2012-12-13 Thread Jan Kara
On Wed 12-12-12 14:41:13, Jeff Moyer wrote: > Jeff Moyer writes: > > >> I agree. This isn't about scheduling, we haven't even reached that part > >> yet. Back when we split the queues into read vs write, this problem > >> obviously wasn't there. Now we have sync writes and reads, both eating >

Re: Read starvation by sync writes

2012-12-13 Thread Jan Kara
On Thu 13-12-12 09:43:31, Shaohua Li wrote: > 2012/12/12 Jan Kara : > > On Wed 12-12-12 10:55:15, Shaohua Li wrote: > >> 2012/12/11 Jan Kara : > >> > Hi, > >> > > >> > I was looking into IO starvation problems where streaming sync writes > >> > (in > >> > my case from kjournald but DIO would

Re: Read starvation by sync writes

2012-12-13 Thread Jan Kara
On Thu 13-12-12 09:43:31, Shaohua Li wrote: 2012/12/12 Jan Kara j...@suse.cz: On Wed 12-12-12 10:55:15, Shaohua Li wrote: 2012/12/11 Jan Kara j...@suse.cz: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would

Re: Read starvation by sync writes

2012-12-13 Thread Jan Kara
On Wed 12-12-12 14:41:13, Jeff Moyer wrote: Jeff Moyer jmo...@redhat.com writes: I agree. This isn't about scheduling, we haven't even reached that part yet. Back when we split the queues into read vs write, this problem obviously wasn't there. Now we have sync writes and reads, both

Re: Read starvation by sync writes

2012-12-13 Thread Jens Axboe
On 2012-12-12 20:41, Jeff Moyer wrote: Jeff Moyer jmo...@redhat.com writes: I agree. This isn't about scheduling, we haven't even reached that part yet. Back when we split the queues into read vs write, this problem obviously wasn't there. Now we have sync writes and reads, both eating from

Re: Read starvation by sync writes

2012-12-13 Thread Jeff Moyer
Jens Axboe ax...@kernel.dk writes: On 2012-12-12 20:41, Jeff Moyer wrote: Jeff Moyer jmo...@redhat.com writes: I agree. This isn't about scheduling, we haven't even reached that part yet. Back when we split the queues into read vs write, this problem obviously wasn't there. Now we have

Re: Read starvation by sync writes

2012-12-13 Thread Jan Kara
On Thu 13-12-12 14:30:42, Jens Axboe wrote: On 2012-12-12 20:41, Jeff Moyer wrote: Jeff Moyer jmo...@redhat.com writes: I agree. This isn't about scheduling, we haven't even reached that part yet. Back when we split the queues into read vs write, this problem obviously wasn't there.

Re: Read starvation by sync writes

2012-12-13 Thread Jens Axboe
On 2012-12-13 16:02, Jan Kara wrote: On Thu 13-12-12 14:30:42, Jens Axboe wrote: On 2012-12-12 20:41, Jeff Moyer wrote: Jeff Moyer jmo...@redhat.com writes: I agree. This isn't about scheduling, we haven't even reached that part yet. Back when we split the queues into read vs write, this

Re: Read starvation by sync writes

2012-12-12 Thread Shaohua Li
2012/12/12 Jan Kara : > On Wed 12-12-12 10:55:15, Shaohua Li wrote: >> 2012/12/11 Jan Kara : >> > Hi, >> > >> > I was looking into IO starvation problems where streaming sync writes (in >> > my case from kjournald but DIO would look the same) starve reads. This is >> > because reads happen in

Re: Read starvation by sync writes

2012-12-12 Thread Dave Chinner
On Wed, Dec 12, 2012 at 11:26:17AM +0100, Jan Kara wrote: > On Wed 12-12-12 15:18:21, Dave Chinner wrote: > > On Wed, Dec 12, 2012 at 03:31:37AM +0100, Jan Kara wrote: > > > On Tue 11-12-12 16:44:15, Jeff Moyer wrote: > > > > Jan Kara writes: > > > > > > > > > Hi, > > > > > > > > > > I was

Re: Read starvation by sync writes

2012-12-12 Thread Jeff Moyer
Jeff Moyer writes: >> I agree. This isn't about scheduling, we haven't even reached that part >> yet. Back when we split the queues into read vs write, this problem >> obviously wasn't there. Now we have sync writes and reads, both eating >> from the same pool. The io scheduler can impact this a

Re: Read starvation by sync writes

2012-12-12 Thread Jeff Moyer
Jens Axboe writes: > On 2012-12-12 11:11, Jan Kara wrote: >> On Wed 12-12-12 10:55:15, Shaohua Li wrote: >>> 2012/12/11 Jan Kara : Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve

Re: Read starvation by sync writes

2012-12-12 Thread Jens Axboe
On 2012-12-12 11:11, Jan Kara wrote: > On Wed 12-12-12 10:55:15, Shaohua Li wrote: >> 2012/12/11 Jan Kara : >>> Hi, >>> >>> I was looking into IO starvation problems where streaming sync writes (in >>> my case from kjournald but DIO would look the same) starve reads. This is >>> because reads

Re: Read starvation by sync writes

2012-12-12 Thread Jan Kara
On Wed 12-12-12 15:18:21, Dave Chinner wrote: > On Wed, Dec 12, 2012 at 03:31:37AM +0100, Jan Kara wrote: > > On Tue 11-12-12 16:44:15, Jeff Moyer wrote: > > > Jan Kara writes: > > > > > > > Hi, > > > > > > > > I was looking into IO starvation problems where streaming sync writes > > > >

Re: Read starvation by sync writes

2012-12-12 Thread Jan Kara
On Wed 12-12-12 10:55:15, Shaohua Li wrote: > 2012/12/11 Jan Kara : > > Hi, > > > > I was looking into IO starvation problems where streaming sync writes (in > > my case from kjournald but DIO would look the same) starve reads. This is > > because reads happen in small chunks and until a

Re: Read starvation by sync writes

2012-12-12 Thread Jan Kara
On Wed 12-12-12 10:55:15, Shaohua Li wrote: 2012/12/11 Jan Kara j...@suse.cz: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads happen in small chunks and until a

Re: Read starvation by sync writes

2012-12-12 Thread Jan Kara
On Wed 12-12-12 15:18:21, Dave Chinner wrote: On Wed, Dec 12, 2012 at 03:31:37AM +0100, Jan Kara wrote: On Tue 11-12-12 16:44:15, Jeff Moyer wrote: Jan Kara j...@suse.cz writes: Hi, I was looking into IO starvation problems where streaming sync writes (in my case

Re: Read starvation by sync writes

2012-12-12 Thread Jens Axboe
On 2012-12-12 11:11, Jan Kara wrote: On Wed 12-12-12 10:55:15, Shaohua Li wrote: 2012/12/11 Jan Kara j...@suse.cz: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads happen

Re: Read starvation by sync writes

2012-12-12 Thread Jeff Moyer
Jens Axboe ax...@kernel.dk writes: On 2012-12-12 11:11, Jan Kara wrote: On Wed 12-12-12 10:55:15, Shaohua Li wrote: 2012/12/11 Jan Kara j...@suse.cz: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve

Re: Read starvation by sync writes

2012-12-12 Thread Jeff Moyer
Jeff Moyer jmo...@redhat.com writes: I agree. This isn't about scheduling, we haven't even reached that part yet. Back when we split the queues into read vs write, this problem obviously wasn't there. Now we have sync writes and reads, both eating from the same pool. The io scheduler can

Re: Read starvation by sync writes

2012-12-12 Thread Dave Chinner
On Wed, Dec 12, 2012 at 11:26:17AM +0100, Jan Kara wrote: On Wed 12-12-12 15:18:21, Dave Chinner wrote: On Wed, Dec 12, 2012 at 03:31:37AM +0100, Jan Kara wrote: On Tue 11-12-12 16:44:15, Jeff Moyer wrote: Jan Kara j...@suse.cz writes: Hi, I was looking into IO

Re: Read starvation by sync writes

2012-12-12 Thread Shaohua Li
2012/12/12 Jan Kara j...@suse.cz: On Wed 12-12-12 10:55:15, Shaohua Li wrote: 2012/12/11 Jan Kara j...@suse.cz: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads

Re: Read starvation by sync writes

2012-12-11 Thread Dave Chinner
On Wed, Dec 12, 2012 at 03:31:37AM +0100, Jan Kara wrote: > On Tue 11-12-12 16:44:15, Jeff Moyer wrote: > > Jan Kara writes: > > > > > Hi, > > > > > > I was looking into IO starvation problems where streaming sync writes > > > (in > > > my case from kjournald but DIO would look the same)

Re: Read starvation by sync writes

2012-12-11 Thread Shaohua Li
2012/12/11 Jan Kara : > Hi, > > I was looking into IO starvation problems where streaming sync writes (in > my case from kjournald but DIO would look the same) starve reads. This is > because reads happen in small chunks and until a request completes we don't > start reading further (reader

Re: Read starvation by sync writes

2012-12-11 Thread Jan Kara
On Tue 11-12-12 16:44:15, Jeff Moyer wrote: > Jan Kara writes: > > > Hi, > > > > I was looking into IO starvation problems where streaming sync writes (in > > my case from kjournald but DIO would look the same) starve reads. This is > > because reads happen in small chunks and until a

Re: Read starvation by sync writes

2012-12-11 Thread Jan Engelhardt
On Monday 2012-12-10 23:12, Jan Kara wrote: > > I was looking into IO starvation problems where streaming sync writes (in >my case from kjournald but DIO would look the same) starve reads. This is >because reads happen in small chunks and until a request completes we don't >start reading further

Re: Read starvation by sync writes

2012-12-11 Thread Jeff Moyer
Jan Kara writes: > Hi, > > I was looking into IO starvation problems where streaming sync writes (in > my case from kjournald but DIO would look the same) starve reads. This is > because reads happen in small chunks and until a request completes we don't > start reading further (reader reads

Re: Read starvation by sync writes

2012-12-11 Thread Jeff Moyer
Jan Kara j...@suse.cz writes: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads happen in small chunks and until a request completes we don't start reading further (reader

Re: Read starvation by sync writes

2012-12-11 Thread Jan Engelhardt
On Monday 2012-12-10 23:12, Jan Kara wrote: I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads happen in small chunks and until a request completes we don't start reading further

Re: Read starvation by sync writes

2012-12-11 Thread Jan Kara
On Tue 11-12-12 16:44:15, Jeff Moyer wrote: Jan Kara j...@suse.cz writes: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads happen in small chunks and until a

Re: Read starvation by sync writes

2012-12-11 Thread Shaohua Li
2012/12/11 Jan Kara j...@suse.cz: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads happen in small chunks and until a request completes we don't start reading further

Re: Read starvation by sync writes

2012-12-11 Thread Dave Chinner
On Wed, Dec 12, 2012 at 03:31:37AM +0100, Jan Kara wrote: On Tue 11-12-12 16:44:15, Jeff Moyer wrote: Jan Kara j...@suse.cz writes: Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve

Read starvation by sync writes

2012-12-10 Thread Jan Kara
Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads happen in small chunks and until a request completes we don't start reading further (reader reads lots of small files) while

Read starvation by sync writes

2012-12-10 Thread Jan Kara
Hi, I was looking into IO starvation problems where streaming sync writes (in my case from kjournald but DIO would look the same) starve reads. This is because reads happen in small chunks and until a request completes we don't start reading further (reader reads lots of small files) while