[Devel] [PATCH -mm 5/6] i/o controller instrumentation: accounting and throttling

2008-10-07 Thread Andrea Righi
Apply the cgroup-io-throttle controller to the opportune kernel functions. Both accounting and throttling functionalities are performed by cgroup_io_throttle(). Signed-off-by: Andrea Righi [EMAIL PROTECTED] --- block/blk-core.c |4 fs/aio.c | 12

[Devel] [PATCH -mm 1/6] i/o controller documentation

2008-10-07 Thread Andrea Righi
Documentation of the block device I/O controller: description, usage, advantages and design. Signed-off-by: Andrea Righi [EMAIL PROTECTED] --- Documentation/controllers/io-throttle.txt | 409 + 1 files changed, 409 insertions(+), 0 deletions(-) create mode 100644

[Devel] Re: [PATCH] netns: Delete virtual interfaces during namespace cleanup

2008-10-07 Thread Daniel Lezcano
Eric W. Biederman wrote: When physical devices are inside of network namespace and that network namespace terminates we can not make them go away. We have to keep them and moving them to the initial network namespace is the best we can do. For virtual devices left in a network namespace

[Devel] Re: [PATCH] netns: Delete virtual interfaces during namespace cleanup

2008-10-07 Thread Eric W. Biederman
Daniel Lezcano [EMAIL PROTECTED] writes: I agree that will make the life easier for user space developer :) I have a few questions about this new behaviour. After discussing with Benjamin, this patch means an user can no longer manage a pool of virtual devices because they will be

[Devel] Re: [RFC] [PATCH -mm 0/2] memcg: per cgroup dirty_ratio

2008-10-07 Thread Balbir Singh
Michael Rubin wrote: On Fri, Sep 12, 2008 at 1:18 PM, Andrew Morton [EMAIL PROTECTED] wrote: One thing to think about please: Michael Rubin is hitting problems with the existing /proc/sys/vm/dirty-ratio. Its present granularity of 1% is just too coarse for really large machines, and as

[Devel] Re: [PATCH] netns: Delete virtual interfaces during namespace cleanup

2008-10-07 Thread Eric W. Biederman
Daniel Lezcano [EMAIL PROTECTED] writes: Perhaps, I am misunderstanding your sentence :) But just in case, let me clarify my idea. If you have a TCP connection with a send queue not empty (the kernel has buffered the data the application has sent), when your process exits because the

[Devel] Re: [PATCH] netns: Delete virtual interfaces during namespace cleanup

2008-10-07 Thread Daniel Lezcano
Eric W. Biederman wrote: Daniel Lezcano [EMAIL PROTECTED] writes: Perhaps, I am misunderstanding your sentence :) But just in case, let me clarify my idea. If you have a TCP connection with a send queue not empty (the kernel has buffered the data the application has sent), when your

[Devel] Re: [PATCH] netns: Delete virtual interfaces during namespace cleanup

2008-10-07 Thread Daniel Lezcano
Eric W. Biederman wrote: Daniel Lezcano [EMAIL PROTECTED] writes: I agree that will make the life easier for user space developer :) I have a few questions about this new behaviour. After discussing with Benjamin, this patch means an user can no longer manage a pool of virtual devices

[Devel] Re: [PATCH] netns: Delete virtual interfaces during namespace cleanup

2008-10-07 Thread Eric W. Biederman
Pavel Emelyanov [EMAIL PROTECTED] writes: I remember that I promised to prepare the wait-extending patch. But I haven't manage to find time for this, sorry :( In a month or two I will finish one time-hungry task and hopefully be able to do it. As far as this particular patch is concerned.

[Devel] Re: [PATCH] net: Support specifying the network namespace upon device creation.

2008-10-07 Thread Daniel Lezcano
Eric W. Biederman wrote: There is no good reason to not support userspace specifying the network namespace during device creation and it seems a handy thing to do. We have to be a little extra careful in this case to ensure that the network namespace exists through the point where we call

[Devel] Re: [RFC] [PATCH -mm 0/2] memcg: per cgroup dirty_ratio

2008-10-07 Thread Andrea Righi
KOSAKI Motohiro wrote: Currently the problem we are hitting is that we cannot specify pdflush to have background limits less than 1% of memory. I am currently finishing up a patch right now that adds a dirty_ratio_millis interface. I hope to submit the patch to LKML by the end of the week.

[Devel] [PATCH -mm 0/6] cgroup: block device i/o controller (v11)

2008-10-07 Thread Andrea Righi
The objective of the i/o controller is to improve i/o performance predictability of different cgroups sharing the same block devices. Respect to other priority/weight-based solutions the approach used by this controller is to explicitly choke applications' requests that directly (or indirectly)

[Devel] [PATCH -mm 6/6] export per-task i/o throttling statistics to userspace

2008-10-07 Thread Andrea Righi
Export the throttling statistics collected for each task through /proc/PID/io-throttle-stat. Example: $ cat /proc/$$/io-throttle-stat 0 0 0 0 ^ ^ ^ ^ \ \ \ \_global iops sleep (in clock ticks) \ \ \__global iops counter \ \___global bandwidth sleep (in clock ticks)

[Devel] [PATCH -mm 2/6] introduce ratelimiting attributes and functionality to res_counter

2008-10-07 Thread Andrea Righi
Introduce attributes and functions in res_counter to implement throttling-based cgroup subsystems. The following attributes have been added to struct res_counter: * @policy: the limiting policy / algorithm * @capacity: the maximum capacity of the resource * @timestamp: timestamp of the

[Devel] Re: [PATCH] netns: Delete virtual interfaces during namespace cleanup

2008-10-07 Thread Pavel Emelyanov
Daniel Lezcano wrote: Eric W. Biederman wrote: When physical devices are inside of network namespace and that network namespace terminates we can not make them go away. We have to keep them and moving them to the initial network namespace is the best we can do. For virtual devices left in

[Devel] [PATCH -mm 3/6] i/o controller infrastructure

2008-10-07 Thread Andrea Righi
This is the core of the cgroup-io-throttle kernel infrastructure. It creates the basic interfaces to cgroups and implements the I/O measurement and throttling functionality. Signed-off-by: Andrea Righi [EMAIL PROTECTED] --- block/Makefile |2 + block/blk-io-throttle.c

[Devel] [PATCH -mm 4/6] memcg: interface to charge the right cgroup of asynchronous i/o activity

2008-10-07 Thread Andrea Righi
Implement get_cgroup_from_page() / put_cgroup_from_page() in the cgroup memory controller to retrieve the owner of a page during writes in submit_bio() processed asynchronously by kernel threads (i.e. pdflush). Note: right now this is no more than a hack to keep the things simpler; in perspective

[Devel] Re: [RFC] [PATCH -mm 0/2] memcg: per cgroup dirty_ratio

2008-10-07 Thread Andrea Righi
Balbir Singh wrote: Michael Rubin wrote: On Fri, Sep 12, 2008 at 1:18 PM, Andrew Morton [EMAIL PROTECTED] wrote: One thing to think about please: Michael Rubin is hitting problems with the existing /proc/sys/vm/dirty-ratio. Its present granularity of 1% is just too coarse for really large

[Devel] Re: [PATCH 1/8] sysfs: Implement sysfs tagged directory support.

2008-10-07 Thread Mark Ryden
Hello, So I wonder: the sysfs tagged directory support patch is in GerKH tree for more than a month. I cloned today latest Linus tree (2.6.27-rc9) and it is not there as far as I can see. It is also not in linux-next tree (from september). Now, I wonder what is the process of merging this GregKH

[Devel] Re: [PATCH 1/8] sysfs: Implement sysfs tagged directory support.

2008-10-07 Thread Greg KH
On Tue, Oct 07, 2008 at 06:39:04PM +0200, Mark Ryden wrote: Hello, So I wonder: the sysfs tagged directory support patch is in GerKH tree for more than a month. I dropped it from my tree 2 days ago, see the thread on lkml for why. thanks, greg k-h

[Devel] Re: [PATCH 1/8] sysfs: Implement sysfs tagged directory support.

2008-10-07 Thread Daniel Lezcano
Mark Ryden wrote: Hello, So I wonder: the sysfs tagged directory support patch is in GerKH tree for more than a month. I cloned today latest Linus tree (2.6.27-rc9) and it is not there as far as I can see. It is also not in linux-next tree (from september). Now, I wonder what is the

[Devel] Re: [PATCH 1/3] user namespaces: introduce user_struct-user_namespace relationship

2008-10-07 Thread Serge E. Hallyn
Quoting James Morris ([EMAIL PROTECTED]): On Mon, 6 Oct 2008, Serge E. Hallyn wrote: Quoting James Morris ([EMAIL PROTECTED]): On Fri, 3 Oct 2008, Serge E. Hallyn wrote: Hi James, here are 3 patches to fix up the user namespaces a bit in preparation for real userns

[Devel] Re: [PATCH 1/8] sysfs: Implement sysfs tagged directory support.

2008-10-07 Thread Eric W. Biederman
Greg KH [EMAIL PROTECTED] writes: On Tue, Oct 07, 2008 at 06:39:04PM +0200, Mark Ryden wrote: Hello, So I wonder: the sysfs tagged directory support patch is in GerKH tree for more than a month. I dropped it from my tree 2 days ago, see the thread on lkml for why. Greg why did you drop

[Devel] Re: [PATCH 1/3] user namespaces: introduce user_struct-user_namespace relationship

2008-10-07 Thread James Morris
On Tue, 7 Oct 2008, Serge E. Hallyn wrote: the fixups could be carried in linux-next, or generate them against creds-next-subsys for inclusion after that. creds-next-subsys is not yet feeding into linux-next, right? Correct. So I should wait until they hit linux-next? Unless akpm

[Devel] Re: [PATCH 1/8] sysfs: Implement sysfs tagged directory support.

2008-10-07 Thread Greg KH
On Tue, Oct 07, 2008 at 01:31:52PM -0700, Eric W. Biederman wrote: Greg KH [EMAIL PROTECTED] writes: On Tue, Oct 07, 2008 at 06:39:04PM +0200, Mark Ryden wrote: Hello, So I wonder: the sysfs tagged directory support patch is in GerKH tree for more than a month. I dropped it from

[Devel] Re: [PATCH net-next 0/9] ipv6: making UDP mibs per/namespace

2008-10-07 Thread David Miller
From: Denis V. Lunev [EMAIL PROTECTED] Date: Thu, 02 Oct 2008 14:13:14 +0400 This patch series provides a basic infrastructure to make snmp6 statistics per/namespace and actually virtualize udp6/udplite6 mibs. This set follows approach used by Pavel Emelyanov in IPv4 code. IP6/icmp6

[Devel] Re: [PATCH] netns: Delete virtual interfaces during namespace cleanup

2008-10-07 Thread David Miller
From: Daniel Lezcano [EMAIL PROTECTED] Date: Tue, 07 Oct 2008 14:07:00 +0200 Eric W. Biederman wrote: Well there is the cheap trick with this patch of waiting until the local end of veth dies. I actually use veth, macvlan, empty netns and physical. But if you are planning the send netns

[Devel] Re: [PATCH] net: Support specifying the network namespace upon device creation.

2008-10-07 Thread Eric W. Biederman
Daniel Lezcano [EMAIL PROTECTED] writes: Eric W. Biederman wrote: There is no good reason to not support userspace specifying the network namespace during device creation and it seems a handy thing to do. We have to be a little extra careful in this case to ensure that the network

[Devel] Re: [RFC] [PATCH -mm 0/2] memcg: per cgroup dirty_ratio

2008-10-07 Thread KAMEZAWA Hiroyuki
On Tue, 07 Oct 2008 17:49:49 +0200 Andrea Righi [EMAIL PROTECTED] wrote: Balbir Singh wrote: Michael Rubin wrote: On Fri, Sep 12, 2008 at 1:18 PM, Andrew Morton [EMAIL PROTECTED] wrote: One thing to think about please: Michael Rubin is hitting problems with the existing