Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-23 Thread Andrea Righi
Pavel Machek wrote: > On Tue 2008-01-15 17:49:36, Andrea Righi wrote: >> Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing >> additional delays on those processes that exceed the limits defined in a >> configfs tree. >> >> Examples: >> >> Limit the I/O bandwidth for user

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-23 Thread Pavel Machek
On Tue 2008-01-15 17:49:36, Andrea Righi wrote: > Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing > additional delays on those processes that exceed the limits defined in a > configfs tree. > > Examples: > > Limit the I/O bandwidth for user www-data (UID 33) to 4MB/s: >

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-23 Thread Pavel Machek
On Tue 2008-01-15 17:49:36, Andrea Righi wrote: Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing additional delays on those processes that exceed the limits defined in a configfs tree. Examples: Limit the I/O bandwidth for user www-data (UID 33) to 4MB/s: [EMAIL

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-23 Thread Andrea Righi
Pavel Machek wrote: On Tue 2008-01-15 17:49:36, Andrea Righi wrote: Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing additional delays on those processes that exceed the limits defined in a configfs tree. Examples: Limit the I/O bandwidth for user www-data (UID 33)

Re: [RFC][PATCH] per-task I/O throttling

2008-01-16 Thread David Newall
Andrea Righi wrote: > David Newall wrote: > >> Andrea Righi wrote: >> >>> [I/O-intensive] processes can noticeably impact the system responsiveness >>> for some time and playing with tasks' priority is not always an >>> acceptable solution. >>> >>> >> Why? >> >> > > Well, I

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Andrea Righi
Balbir Singh wrote: > * Andrea Righi <[EMAIL PROTECTED]> [2008-01-15 17:49:36]: > >> Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing >> additional delays on those processes that exceed the limits defined in a >> configfs tree. >> >> Examples: >> >> Limit the I/O bandwidth

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Valdis . Kletnieks
On Wed, 16 Jan 2008 17:35:33 +0530, Balbir Singh said: > Control groups is derived from cpusets and for those interested in > grouping tasks for control, is the preferred method of providing > control. Ahh, that's why I didn't notice it - "cpusets" didn't seem to do much for the 1 and 2 CPU

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Balbir Singh
* [EMAIL PROTECTED] <[EMAIL PROTECTED]> [2008-01-16 06:30:31]: > On Wed, 16 Jan 2008 16:15:41 +0530, Balbir Singh said: > > > Thanks for doing this. I am going to review the patches in greater > > detail and also test them. Why do you use configfs when we have a > > control group filesystem

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Valdis . Kletnieks
On Wed, 16 Jan 2008 16:15:41 +0530, Balbir Singh said: > Thanks for doing this. I am going to review the patches in greater > detail and also test them. Why do you use configfs when we have a > control group filesystem available for grouping tasks and providing a > file system based interface for

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Balbir Singh
* Andrea Righi <[EMAIL PROTECTED]> [2008-01-15 17:49:36]: > Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing > additional delays on those processes that exceed the limits defined in a > configfs tree. > > Examples: > > Limit the I/O bandwidth for user www-data (UID 33) to

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Valdis . Kletnieks
On Wed, 16 Jan 2008 16:15:41 +0530, Balbir Singh said: Thanks for doing this. I am going to review the patches in greater detail and also test them. Why do you use configfs when we have a control group filesystem available for grouping tasks and providing a file system based interface for

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Balbir Singh
* [EMAIL PROTECTED] [EMAIL PROTECTED] [2008-01-16 06:30:31]: On Wed, 16 Jan 2008 16:15:41 +0530, Balbir Singh said: Thanks for doing this. I am going to review the patches in greater detail and also test them. Why do you use configfs when we have a control group filesystem available for

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Valdis . Kletnieks
On Wed, 16 Jan 2008 17:35:33 +0530, Balbir Singh said: Control groups is derived from cpusets and for those interested in grouping tasks for control, is the preferred method of providing control. Ahh, that's why I didn't notice it - cpusets didn't seem to do much for the 1 and 2 CPU systems I

Re: [RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-16 Thread Andrea Righi
Balbir Singh wrote: * Andrea Righi [EMAIL PROTECTED] [2008-01-15 17:49:36]: Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing additional delays on those processes that exceed the limits defined in a configfs tree. Examples: Limit the I/O bandwidth for user www-data

Re: [RFC][PATCH] per-task I/O throttling

2008-01-16 Thread David Newall
Andrea Righi wrote: David Newall wrote: Andrea Righi wrote: [I/O-intensive] processes can noticeably impact the system responsiveness for some time and playing with tasks' priority is not always an acceptable solution. Why? Well, I mean, we can't use 'nice' to

[RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-15 Thread Andrea Righi
Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing additional delays on those processes that exceed the limits defined in a configfs tree. Examples: Limit the I/O bandwidth for user www-data (UID 33) to 4MB/s: [EMAIL PROTECTED]:/config/io-throttle# mkdir uid:33 [EMAIL

[RFC][PATCH] per-uid/gid I/O throttling (was Re: [RFC][PATCH] per-task I/O throttling)

2008-01-15 Thread Andrea Righi
Allow to limit the I/O bandwidth for specific uid(s) or gid(s) imposing additional delays on those processes that exceed the limits defined in a configfs tree. Examples: Limit the I/O bandwidth for user www-data (UID 33) to 4MB/s: [EMAIL PROTECTED]:/config/io-throttle# mkdir uid:33 [EMAIL

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Balbir Singh
* Andrea Righi <[EMAIL PROTECTED]> [2008-01-12 19:01:14]: > Peter Zijlstra wrote: > > On Sat, 2008-01-12 at 16:27 +0530, Balbir Singh wrote: > >> * Peter Zijlstra <[EMAIL PROTECTED]> [2008-01-12 10:46:37]: > >> > >>> On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: > On Fri, 11

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Andrea Righi
Peter Zijlstra wrote: > On Sat, 2008-01-12 at 16:27 +0530, Balbir Singh wrote: >> * Peter Zijlstra <[EMAIL PROTECTED]> [2008-01-12 10:46:37]: >> >>> On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: > The interesting

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Peter Zijlstra
On Sat, 2008-01-12 at 16:27 +0530, Balbir Singh wrote: > * Peter Zijlstra <[EMAIL PROTECTED]> [2008-01-12 10:46:37]: > > > > > On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: > > > On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: > > > > > > > The interesting feature is that

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Balbir Singh
* Peter Zijlstra <[EMAIL PROTECTED]> [2008-01-12 10:46:37]: > > On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: > > On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: > > > > > The interesting feature is that it allows to set a priority for each > > > process container, but

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Peter Zijlstra
On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: > On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: > > > The interesting feature is that it allows to set a priority for each > > process container, but AFAIK it doesn't allow to "partition" the > > bandwidth between different

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Peter Zijlstra
On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: The interesting feature is that it allows to set a priority for each process container, but AFAIK it doesn't allow to partition the bandwidth between different containers

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Balbir Singh
* Peter Zijlstra [EMAIL PROTECTED] [2008-01-12 10:46:37]: On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: The interesting feature is that it allows to set a priority for each process container, but AFAIK it doesn't

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Peter Zijlstra
On Sat, 2008-01-12 at 16:27 +0530, Balbir Singh wrote: * Peter Zijlstra [EMAIL PROTECTED] [2008-01-12 10:46:37]: On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: The interesting feature is that it allows to set a

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Andrea Righi
Peter Zijlstra wrote: On Sat, 2008-01-12 at 16:27 +0530, Balbir Singh wrote: * Peter Zijlstra [EMAIL PROTECTED] [2008-01-12 10:46:37]: On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: The interesting feature is that it allows

Re: [RFC][PATCH] per-task I/O throttling

2008-01-12 Thread Balbir Singh
* Andrea Righi [EMAIL PROTECTED] [2008-01-12 19:01:14]: Peter Zijlstra wrote: On Sat, 2008-01-12 at 16:27 +0530, Balbir Singh wrote: * Peter Zijlstra [EMAIL PROTECTED] [2008-01-12 10:46:37]: On Fri, 2008-01-11 at 23:57 -0500, [EMAIL PROTECTED] wrote: On Fri, 11 Jan 2008 17:32:49 +0100,

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Valdis . Kletnieks
On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: > The interesting feature is that it allows to set a priority for each > process container, but AFAIK it doesn't allow to "partition" the > bandwidth between different containers (that would be a nice feature > IMHO). For example it would be

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Andrea Righi
Balbir Singh wrote: > On Jan 11, 2008 4:15 AM, Andrea Righi <[EMAIL PROTECTED]> wrote: >> Allow to limit the bandwidth of I/O-intensive processes, like backup >> tools running in background, large files copy, checksums on huge files, >> etc. >> >> This kind of processes can noticeably impact the

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Balbir Singh
On Jan 11, 2008 4:15 AM, Andrea Righi <[EMAIL PROTECTED]> wrote: > Allow to limit the bandwidth of I/O-intensive processes, like backup > tools running in background, large files copy, checksums on huge files, > etc. > > This kind of processes can noticeably impact the system responsiveness > for

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Andrea Righi
David Newall wrote: > Andrea Righi wrote: >> [I/O-intensive] processes can noticeably impact the system responsiveness >> for some time and playing with tasks' priority is not always an >> acceptable solution. >> > > Why? > Well, I mean, we can't use 'nice' to grant less priority for the I/O

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Andrea Righi
Peter Zijlstra wrote: >> >> Anyway, I'm wondering if it's possible (and how) to already do this with >> process containers... > > I think there is an IO controller somewhere based on CFQ. > > I don't like this patch, because it throttles requests/s, and that > doesn't say much. If a task would

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Peter Zijlstra
On Fri, 2008-01-11 at 11:28 +0100, Andrea Righi wrote: > Bill Davidsen wrote: > > Andrea Righi wrote: > >> Allow to limit the bandwidth of I/O-intensive processes, like backup > >> tools running in background, large files copy, checksums on huge files, > >> etc. > >> > >> This kind of processes

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread David Newall
Andrea Righi wrote: [I/O-intensive] processes can noticeably impact the system responsiveness for some time and playing with tasks' priority is not always an acceptable solution. Why? -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Andrea Righi
Bill Davidsen wrote: > Andrea Righi wrote: >> Allow to limit the bandwidth of I/O-intensive processes, like backup >> tools running in background, large files copy, checksums on huge files, >> etc. >> >> This kind of processes can noticeably impact the system responsiveness >> for some time and

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Andrea Righi
Bill Davidsen wrote: Andrea Righi wrote: Allow to limit the bandwidth of I/O-intensive processes, like backup tools running in background, large files copy, checksums on huge files, etc. This kind of processes can noticeably impact the system responsiveness for some time and playing with

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Peter Zijlstra
On Fri, 2008-01-11 at 11:28 +0100, Andrea Righi wrote: Bill Davidsen wrote: Andrea Righi wrote: Allow to limit the bandwidth of I/O-intensive processes, like backup tools running in background, large files copy, checksums on huge files, etc. This kind of processes can noticeably

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Andrea Righi
David Newall wrote: Andrea Righi wrote: [I/O-intensive] processes can noticeably impact the system responsiveness for some time and playing with tasks' priority is not always an acceptable solution. Why? Well, I mean, we can't use 'nice' to grant less priority for the I/O intensive

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Andrea Righi
Peter Zijlstra wrote: Anyway, I'm wondering if it's possible (and how) to already do this with process containers... I think there is an IO controller somewhere based on CFQ. I don't like this patch, because it throttles requests/s, and that doesn't say much. If a task would generate a

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Balbir Singh
On Jan 11, 2008 4:15 AM, Andrea Righi [EMAIL PROTECTED] wrote: Allow to limit the bandwidth of I/O-intensive processes, like backup tools running in background, large files copy, checksums on huge files, etc. This kind of processes can noticeably impact the system responsiveness for some

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Andrea Righi
Balbir Singh wrote: On Jan 11, 2008 4:15 AM, Andrea Righi [EMAIL PROTECTED] wrote: Allow to limit the bandwidth of I/O-intensive processes, like backup tools running in background, large files copy, checksums on huge files, etc. This kind of processes can noticeably impact the system

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread David Newall
Andrea Righi wrote: [I/O-intensive] processes can noticeably impact the system responsiveness for some time and playing with tasks' priority is not always an acceptable solution. Why? -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL

Re: [RFC][PATCH] per-task I/O throttling

2008-01-11 Thread Valdis . Kletnieks
On Fri, 11 Jan 2008 17:32:49 +0100, Andrea Righi said: The interesting feature is that it allows to set a priority for each process container, but AFAIK it doesn't allow to partition the bandwidth between different containers (that would be a nice feature IMHO). For example it would be great

Re: [RFC][PATCH] per-task I/O throttling

2008-01-10 Thread Bill Davidsen
Andrea Righi wrote: Allow to limit the bandwidth of I/O-intensive processes, like backup tools running in background, large files copy, checksums on huge files, etc. This kind of processes can noticeably impact the system responsiveness for some time and playing with tasks' priority is not

[RFC][PATCH] per-task I/O throttling

2008-01-10 Thread Andrea Righi
Allow to limit the bandwidth of I/O-intensive processes, like backup tools running in background, large files copy, checksums on huge files, etc. This kind of processes can noticeably impact the system responsiveness for some time and playing with tasks' priority is not always an acceptable

[RFC][PATCH] per-task I/O throttling

2008-01-10 Thread Andrea Righi
Allow to limit the bandwidth of I/O-intensive processes, like backup tools running in background, large files copy, checksums on huge files, etc. This kind of processes can noticeably impact the system responsiveness for some time and playing with tasks' priority is not always an acceptable

Re: [RFC][PATCH] per-task I/O throttling

2008-01-10 Thread Bill Davidsen
Andrea Righi wrote: Allow to limit the bandwidth of I/O-intensive processes, like backup tools running in background, large files copy, checksums on huge files, etc. This kind of processes can noticeably impact the system responsiveness for some time and playing with tasks' priority is not