[Devel] Re: Too many I/O controller patches

2008-08-06 Thread Hirokazu Takahashi
Hi, Buffered write I/O is also related with cache system. We must consider this problem as I/O control. Agree. At least, maybe we should consider if an IO controller could be a valid solution also for these problems. Isn't this one of the core points that we keep going

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread Balbir Singh
Paul Menage wrote: On Mon, Aug 4, 2008 at 1:44 PM, Andrea Righi [EMAIL PROTECTED] wrote: A safer approach IMHO is to force the tasks to wait synchronously on each operation that directly or indirectly generates i/o. In particular the solution used by the io-throttle controller to limit the

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread Hirokazu Takahashi
Hi, Andrea, I'm working with Ryo on dm-ioband and other stuff. On Mon, 2008-08-04 at 20:22 +0200, Andrea Righi wrote: But I'm not yet convinced that limiting the IO writes at the device mapper layer is the best solution. IMHO it would be better to throttle applications' writes when

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread Hirokazu Takahashi
Hi, But I'm not yet convinced that limiting the IO writes at the device mapper layer is the best solution. IMHO it would be better to throttle applications' writes when they're dirtying pages in the page cache (the io-throttle way), because when the IO requests arrive to the device

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread Hirokazu Takahashi
Hi, Hi, Andrea, I'm working with Ryo on dm-ioband and other stuff. On Mon, 2008-08-04 at 20:22 +0200, Andrea Righi wrote: But I'm not yet convinced that limiting the IO writes at the device mapper layer is the best solution. IMHO it would be better to throttle applications'

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread Ryo Tsuruta
Hi Andrea, Satoshi and all, Thanks for giving a chance to discuss. Mr. Andrew gave a advice Should discuss about design more and more to me. And, in Containers Mini-summit (and Linux Symposium 2008 in Ottawa), Paul said that a necessary to us is to decide a requirement first. So, we must

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread Dave Hansen
On Tue, 2008-08-05 at 11:28 +0200, Andrea Righi wrote: Buffered write I/O is also related with cache system. We must consider this problem as I/O control. Agree. At least, maybe we should consider if an IO controller could be a valid solution also for these problems. Isn't this one of the

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread Dave Hansen
On Mon, 2008-08-04 at 22:55 -0700, Paul Menage wrote: As Dave suggested, I think it would make more sense to have your page-dirtying throttle points hook into the memory controller instead, and allow the memory controller to track/limit dirty pages for a cgroup, and potentially do throttling

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread KAMEZAWA Hiroyuki
On Tue, 05 Aug 2008 09:20:18 -0700 Dave Hansen [EMAIL PROTECTED] wrote: On Tue, 2008-08-05 at 11:28 +0200, Andrea Righi wrote: Buffered write I/O is also related with cache system. We must consider this problem as I/O control. Agree. At least, maybe we should consider if an IO

[Devel] Re: Too many I/O controller patches

2008-08-05 Thread Balbir Singh
KAMEZAWA Hiroyuki wrote: On Tue, 05 Aug 2008 09:20:18 -0700 Dave Hansen [EMAIL PROTECTED] wrote: On Tue, 2008-08-05 at 11:28 +0200, Andrea Righi wrote: Buffered write I/O is also related with cache system. We must consider this problem as I/O control. Agree. At least, maybe we should

[Devel] Re: Too many I/O controller patches

2008-08-04 Thread Andrea Righi
Dave Hansen wrote: On Mon, 2008-08-04 at 17:51 +0900, Ryo Tsuruta wrote: This series of patches of dm-ioband now includes The bio tracking mechanism, which has been posted individually to this mailing list. This makes it easy for anybody to control the I/O bandwidth even when the I/O is one

[Devel] Re: Too many I/O controller patches

2008-08-04 Thread Balbir Singh
Dave Hansen wrote: On Mon, 2008-08-04 at 17:51 +0900, Ryo Tsuruta wrote: This series of patches of dm-ioband now includes The bio tracking mechanism, which has been posted individually to this mailing list. This makes it easy for anybody to control the I/O bandwidth even when the I/O is one

[Devel] Re: Too many I/O controller patches

2008-08-04 Thread Dave Hansen
On Mon, 2008-08-04 at 20:22 +0200, Andrea Righi wrote: But I'm not yet convinced that limiting the IO writes at the device mapper layer is the best solution. IMHO it would be better to throttle applications' writes when they're dirtying pages in the page cache (the io-throttle way), because

[Devel] Re: Too many I/O controller patches

2008-08-04 Thread Andrea Righi
Balbir Singh wrote: Dave Hansen wrote: On Mon, 2008-08-04 at 17:51 +0900, Ryo Tsuruta wrote: This series of patches of dm-ioband now includes The bio tracking mechanism, which has been posted individually to this mailing list. This makes it easy for anybody to control the I/O bandwidth even

[Devel] Re: Too many I/O controller patches

2008-08-04 Thread Andrea Righi
Dave Hansen wrote: On Mon, 2008-08-04 at 20:22 +0200, Andrea Righi wrote: But I'm not yet convinced that limiting the IO writes at the device mapper layer is the best solution. IMHO it would be better to throttle applications' writes when they're dirtying pages in the page cache (the

[Devel] Re: Too many I/O controller patches

2008-08-04 Thread Dave Hansen
On Mon, 2008-08-04 at 22:44 +0200, Andrea Righi wrote: Dave Hansen wrote: On Mon, 2008-08-04 at 20:22 +0200, Andrea Righi wrote: But I'm not yet convinced that limiting the IO writes at the device mapper layer is the best solution. IMHO it would be better to throttle applications' writes

[Devel] RE: Too many I/O controller patches

2008-08-04 Thread Satoshi UCHIDA
Hi, Andrea. I participated in Containers Mini-summit. And, I talked with Mr. Andrew Morton in The Linux Foundation Japan Symposium BoF, Japan, July 10th. Currently, in ML, some I/O controller patches is sent and the respective patch keeps sending the improvement version. We and maintainers

[Devel] Re: Too many I/O controller patches

2008-08-04 Thread Paul Menage
On Mon, Aug 4, 2008 at 1:44 PM, Andrea Righi [EMAIL PROTECTED] wrote: A safer approach IMHO is to force the tasks to wait synchronously on each operation that directly or indirectly generates i/o. In particular the solution used by the io-throttle controller to limit the dirty-ratio in