Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Bill Davidsen
Ingo Molnar wrote: * Davide Libenzi <[EMAIL PROTECTED]> wrote: The same user nicing two different multi-threaded processes would expect a predictable CPU distribution too. [...] i disagree that the user 'would expect' this. Some users might. Others would say: 'my 10-thread rendering engine

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Bill Davidsen
Linus Torvalds wrote: On Wed, 18 Apr 2007, Matt Mackall wrote: Why is X special? Because it does work on behalf of other processes? Lots of things do this. Perhaps a scheduler should focus entirely on the implicit and directed wakeup matrix and optimizing that instead[1]. I 100% agree - the p

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Bill Davidsen
Matt Mackall wrote: On Wed, Apr 18, 2007 at 08:37:11AM +0200, Nick Piggin wrote: [2] It's trivial to construct two or more perfectly reasonable and desirable definitions of fairness that are mutually incompatible. Probably not if you use common sense, and in the context of a replacement for t

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Willy Tarreau
Hi Björn, On Sat, Apr 21, 2007 at 01:29:41PM +0200, Björn Steinbrink wrote: > Hi, > > On 2007.04.21 13:07:48 +0200, Willy Tarreau wrote: > > > another thing i noticed: when using a -y larger then 1, then the window > > > title (at least on Metacity) overlaps and thus the ocbench tasks have > >

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Björn Steinbrink
Hi, On 2007.04.21 13:07:48 +0200, Willy Tarreau wrote: > > another thing i noticed: when using a -y larger then 1, then the window > > title (at least on Metacity) overlaps and thus the ocbench tasks have > > different X overhead and get scheduled a bit assymetrically as well. Is > > there any

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Willy Tarreau
Hi Ingo, I'm replying to your 3 mails at once. On Sat, Apr 21, 2007 at 12:45:22PM +0200, Ingo Molnar wrote: > > * Ingo Molnar <[EMAIL PROTECTED]> wrote: > > > > It could become a useful scheduler benchmark ! > > > > i just tried ocbench-0.3, and it is indeed very nice! So as you've noticed ju

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Ingo Molnar
* Ingo Molnar <[EMAIL PROTECTED]> wrote: > > It could become a useful scheduler benchmark ! > > i just tried ocbench-0.3, and it is indeed very nice! another thing i noticed: when using a -y larger then 1, then the window title (at least on Metacity) overlaps and thus the ocbench tasks have d

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Ingo Molnar
* Ingo Molnar <[EMAIL PROTECTED]> wrote: > > The modified code is here : > > > > http://linux.1wt.eu/sched/orbitclock-0.2bench.tgz > > > > What is interesting to note is that it's easy to make X work a lot > > (99%) by using 0 as the sleeping time, and it's easy to make the > > process work

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Ingo Molnar
* Willy Tarreau <[EMAIL PROTECTED]> wrote: > I hacked it a bit to make it accept two parameters : > -R : time spent burning CPU cycles at each round > -S : time spent getting a rest > > It now advances what it thinks is a second at each iteration, so that > it makes it easy to compare its

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Ingo Molnar
* Bill Davidsen <[EMAIL PROTECTED]> wrote: > All of my testing has been on desktop machines, although in most cases > they were really loaded desktops which had load avg 10..100 from time > to time, and none were low memory machines. Up to CFS v3 I thought > nicksched was my winner, now CFSv3

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-21 Thread Nick Piggin
On Fri, Apr 20, 2007 at 04:47:27PM -0400, Bill Davidsen wrote: > Ingo Molnar wrote: > > >( Lets be cautious though: the jury is still out whether people actually > > like this more than the current approach. While CFS feedback looks > > promising after a whopping 3 days of it being released [

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-20 Thread Bill Davidsen
Ingo Molnar wrote: ( Lets be cautious though: the jury is still out whether people actually like this more than the current approach. While CFS feedback looks promising after a whopping 3 days of it being released [ ;-) ], the test coverage of all 'fairness centric' schedulers, even cons

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-20 Thread Bill Davidsen
Mike Galbraith wrote: On Tue, 2007-04-17 at 05:40 +0200, Nick Piggin wrote: On Tue, Apr 17, 2007 at 04:29:01AM +0200, Mike Galbraith wrote: Yup, and progress _is_ happening now, quite rapidly. Progress as in progress on Ingo's scheduler. I still don't know how we'd decide when to replace the

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Peter Williams
William Lee Irwin III wrote: William Lee Irwin III wrote: I'd further recommend making priority levels accessible to kernel threads that are not otherwise accessible to processes, both above and below user-available priority levels. Basically, if you can get SCHED_RR and SCHED_FIFO to coexist as

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread William Lee Irwin III
William Lee Irwin III wrote: >> I'd further recommend making priority levels accessible to kernel threads >> that are not otherwise accessible to processes, both above and below >> user-available priority levels. Basically, if you can get SCHED_RR and >> SCHED_FIFO to coexist as "intimate scheduler

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Mike Galbraith
On Thu, 2007-04-19 at 09:55 -0700, Davide Libenzi wrote: > On Thu, 19 Apr 2007, Mike Galbraith wrote: > > > On Thu, 2007-04-19 at 09:09 +0200, Ingo Molnar wrote: > > > * Mike Galbraith <[EMAIL PROTECTED]> wrote: > > > > > > > With a heavily reniced X (perfectly fine), that should indeed solve my

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Willy Tarreau
On Fri, Apr 20, 2007 at 02:52:38AM +0300, Jan Knutar wrote: > On Thursday 19 April 2007 18:18, Ingo Molnar wrote: > > * Willy Tarreau <[EMAIL PROTECTED]> wrote: > > > You can certainly script it with -geometry. But it is the wrong > > > application for this matter, because you benchmark X more than

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Jan Knutar
On Thursday 19 April 2007 18:18, Ingo Molnar wrote: > * Willy Tarreau <[EMAIL PROTECTED]> wrote: > > You can certainly script it with -geometry. But it is the wrong > > application for this matter, because you benchmark X more than > > glxgears itself. What would be better is something like a line

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Willy Tarreau
On Thu, Apr 19, 2007 at 05:18:03PM +0200, Ingo Molnar wrote: > > * Willy Tarreau <[EMAIL PROTECTED]> wrote: > > > You can certainly script it with -geometry. But it is the wrong > > application for this matter, because you benchmark X more than > > glxgears itself. What would be better is somet

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Bernd Eckenfels
In article <[EMAIL PROTECTED]> you wrote: > Top (VCPU maybe?) >User >Process >Thread The problem with that is, that not all Schedulers might work on the User level. You can think of Batch/Job, Parent, Group, Session or namespace level. That would be IMHO a generic Top, with

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Gene Heskett
On Thursday 19 April 2007, Ingo Molnar wrote: >* Willy Tarreau <[EMAIL PROTECTED]> wrote: >> You can certainly script it with -geometry. But it is the wrong >> application for this matter, because you benchmark X more than >> glxgears itself. What would be better is something like a line >> rotatin

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Gene Heskett
On Thursday 19 April 2007, Ingo Molnar wrote: >* Willy Tarreau <[EMAIL PROTECTED]> wrote: >> Good idea. The machine I'm typing from now has 1000 scheddos running >> at +19, and 12 gears at nice 0. [...] >> >> From time to time, one of the 12 aligned gears will quickly perform a >> full quarter of r

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Davide Libenzi
On Thu, 19 Apr 2007, Mike Galbraith wrote: > On Thu, 2007-04-19 at 09:09 +0200, Ingo Molnar wrote: > > * Mike Galbraith <[EMAIL PROTECTED]> wrote: > > > > > With a heavily reniced X (perfectly fine), that should indeed solve my > > > daily usage pattern nicely (always need godmode for shells, bu

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Davide Libenzi
On Thu, 19 Apr 2007, Ingo Molnar wrote: > i disagree that the user 'would expect' this. Some users might. Others > would say: 'my 10-thread rendering engine is more important than a > 1-thread job because it's using 10 threads for a reason'. And the CFS > feedback so far strengthens this point:

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Ingo Molnar
* Willy Tarreau <[EMAIL PROTECTED]> wrote: > You can certainly script it with -geometry. But it is the wrong > application for this matter, because you benchmark X more than > glxgears itself. What would be better is something like a line > rotating 360 degrees and doing some short stuff betwe

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Willy Tarreau
Hi Ingo, On Thu, Apr 19, 2007 at 11:01:44AM +0200, Ingo Molnar wrote: > > * Willy Tarreau <[EMAIL PROTECTED]> wrote: > > > Good idea. The machine I'm typing from now has 1000 scheddos running > > at +19, and 12 gears at nice 0. [...] > > > From time to time, one of the 12 aligned gears will qu

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Peter Williams
William Lee Irwin III wrote: * Andrew Morton <[EMAIL PROTECTED]> wrote: Yes, there are potential compatibility problems. Example: a machine with 100 busy httpd processes and suddenly a big gzip starts up from console or cron. [...] On Thu, Apr 19, 2007 at 08:38:10AM +0200, Ingo Molnar wrote:

Re: CFS and suspend2: hang in atomic copy (was: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS])

2007-04-19 Thread Ingo Molnar
* Ingo Molnar <[EMAIL PROTECTED]> wrote: > > I think a better approach would be to keep track of the rightmost > > entry, set the key to the rightmost's key +1 and then simply insert > > it there. > > yeah. I had that implemented at a stage but was trying to be too > clever for my own good ;-

Re: CFS and suspend2: hang in atomic copy (was: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS])

2007-04-19 Thread Ingo Molnar
* Esben Nielsen <[EMAIL PROTECTED]> wrote: > >+/* > >+ * Temporarily insert at the last position of the tree: > >+ */ > >+p->fair_key = LLONG_MAX; > >+__enqueue_task_fair(rq, p); > > p->on_rq = 1; > >+ > >+/* > >+ * Update the key to the real value, so that when al

Re: CFS and suspend2: hang in atomic copy (was: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS])

2007-04-19 Thread Esben Nielsen
On Wed, 18 Apr 2007, Ingo Molnar wrote: * Christian Hesse <[EMAIL PROTECTED]> wrote: Hi Ingo and all, On Friday 13 April 2007, Ingo Molnar wrote: as usual, any sort of feedback, bugreports, fixes and suggestions are more than welcome, I just gave CFS a try on my system. From a user's po

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Ingo Molnar
* Willy Tarreau <[EMAIL PROTECTED]> wrote: > Good idea. The machine I'm typing from now has 1000 scheddos running > at +19, and 12 gears at nice 0. [...] > From time to time, one of the 12 aligned gears will quickly perform a > full quarter of round while others slowly turn by a few degrees. I

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Nick Piggin
On Thu, Apr 19, 2007 at 08:38:10AM +0200, Ingo Molnar wrote: > > * Andrew Morton <[EMAIL PROTECTED]> wrote: > > > > And yes, by fairly, I mean fairly among all threads as a base > > > resource class, because that's what Linux has always done > > > > Yes, there are potential compatibility proble

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Ingo Molnar
* Davide Libenzi <[EMAIL PROTECTED]> wrote: > > That's one reason why i dont think it's necessarily a good idea to > > group-schedule threads, we dont really want to do a per thread group > > percpu_alloc(). > > I still do not have clear how much overhead this will bring into the > table, but

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread William Lee Irwin III
* Andrew Morton <[EMAIL PROTECTED]> wrote: >> Yes, there are potential compatibility problems. Example: a machine >> with 100 busy httpd processes and suddenly a big gzip starts up from >> console or cron. [...] On Thu, Apr 19, 2007 at 08:38:10AM +0200, Ingo Molnar wrote: > h. How about the

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Mike Galbraith
On Thu, 2007-04-19 at 09:09 +0200, Ingo Molnar wrote: > * Mike Galbraith <[EMAIL PROTECTED]> wrote: > > > With a heavily reniced X (perfectly fine), that should indeed solve my > > daily usage pattern nicely (always need godmode for shells, but not > > for mozilla and ilk. 50/50 split automatic

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Mike Galbraith
On Thu, 2007-04-19 at 08:52 +0200, Mike Galbraith wrote: > On Wed, 2007-04-18 at 23:48 +0200, Ingo Molnar wrote: > > > so my current impression is that we want per UID accounting to solve the > > X problem, the kernel threads problem and the many-users problem, but > > i'd not want to do it for

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-19 Thread Ingo Molnar
* Mike Galbraith <[EMAIL PROTECTED]> wrote: > With a heavily reniced X (perfectly fine), that should indeed solve my > daily usage pattern nicely (always need godmode for shells, but not > for mozilla and ilk. 50/50 split automatic without renice of entire > gui) how about the first-approxima

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Mike Galbraith
On Wed, 2007-04-18 at 23:48 +0200, Ingo Molnar wrote: > so my current impression is that we want per UID accounting to solve the > X problem, the kernel threads problem and the many-users problem, but > i'd not want to do it for threads just yet because for them there's not > really any apparen

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* Andrew Morton <[EMAIL PROTECTED]> wrote: > > And yes, by fairly, I mean fairly among all threads as a base > > resource class, because that's what Linux has always done > > Yes, there are potential compatibility problems. Example: a machine > with 100 busy httpd processes and suddenly a big

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair

2007-04-18 Thread Ph. Marek
Pine.LNX.4.64.0704181515290.25880 () alien ! or ! mcafeemobile ! com Davide Libenzi wrote: > On Wed, 18 Apr 2007, Ingo Molnar wrote: > > That's one reason why i dont think it's necessarily a good idea to > > group-schedule threads, we dont really want to do a per thread group > > percpu_alloc(). >

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Andrew Morton
On Thu, 19 Apr 2007 05:18:07 +0200 Nick Piggin <[EMAIL PROTECTED]> wrote: > And yes, by fairly, I mean fairly among all threads as a base resource > class, because that's what Linux has always done Yes, there are potential compatibility problems. Example: a machine with 100 busy httpd processes

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Nick Piggin
On Wed, Apr 18, 2007 at 10:49:45PM +1000, Con Kolivas wrote: > On Wednesday 18 April 2007 22:13, Nick Piggin wrote: > > > > The kernel compile (make -j8 on 4 thread system) is doing 1800 total > > context switches per second (450/s per runqueue) for cfs, and 670 > > for mainline. Going up to 20ms g

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Nick Piggin
On Wed, Apr 18, 2007 at 07:48:21AM -0700, Linus Torvalds wrote: > > > On Wed, 18 Apr 2007, Matt Mackall wrote: > > > > Why is X special? Because it does work on behalf of other processes? > > Lots of things do this. Perhaps a scheduler should focus entirely on > > the implicit and directed wakeu

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Peter Williams
Ingo Molnar wrote: * Peter Williams <[EMAIL PROTECTED]> wrote: And my scheduler for example cuts down the amount of policy code and code size significantly. Yours is one of the smaller patches mainly because you perpetuate (or you did in the last one I looked at) the (horrible to my eyes) dual

Re: [ck] Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Peter Williams
Chris Friesen wrote: Mark Glines wrote: One minor question: is it even possible to be completely fair on SMP? For instance, if you have a 2-way SMP box running 3 applications, one of which has 2 threads, will the threaded app have an advantage here? (The current system seems to try to keep eac

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Linus Torvalds
On Wed, 18 Apr 2007, Davide Libenzi wrote: > > I know, we agree there. But that did not fit my "Pirates of the Caribbean" > quote :) Ahh, I'm clearly not cultured enough, I didn't catch that reference. Linus "yes, I've seen the movie, but it apparently left more of a

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Peter Williams
Linus Torvalds wrote: On Wed, 18 Apr 2007, Matt Mackall wrote: On Wed, Apr 18, 2007 at 07:48:21AM -0700, Linus Torvalds wrote: And "fairness by euid" is probably a hell of a lot easier to do than trying to figure out the wakeup matrix. For the record, you actually don't need to track a whole

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Davide Libenzi
On Wed, 18 Apr 2007, Linus Torvalds wrote: > On Wed, 18 Apr 2007, Davide Libenzi wrote: > > > > "Perhaps on the rare occasion pursuing the right course demands an act of > > unfairness, unfairness itself can be the right course?" > > I don't think that's the right issue. > > It's just that "f

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Davide Libenzi
On Wed, 18 Apr 2007, Ingo Molnar wrote: > That's one reason why i dont think it's necessarily a good idea to > group-schedule threads, we dont really want to do a per thread group > percpu_alloc(). I still do not have clear how much overhead this will bring into the table, but I think (like Li

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Con Kolivas
On Wednesday 18 April 2007 22:33, Con Kolivas wrote: > On Wednesday 18 April 2007 22:14, Nick Piggin wrote: > > On Wed, Apr 18, 2007 at 07:33:56PM +1000, Con Kolivas wrote: > > > On Wednesday 18 April 2007 18:55, Nick Piggin wrote: > > > > Again, for comparison 2.6.21-rc7 mainline: > > > > > > > >

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* Davide Libenzi <[EMAIL PROTECTED]> wrote: > I think Ingo's idea of a new sched_group to contain the generic > parameters needed for the "key" calculation, works better than adding > more fields to existing strctures (that would, of course, host > pointers to it). Otherwise I can already the

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* Linus Torvalds <[EMAIL PROTECTED]> wrote: > > perhaps a more fitting term would be 'precise group-scheduling'. > > Within the lowest level task group entity (be that thread group or > > uid group, etc.) 'precise scheduling' is equivalent to 'fairness'. > > Yes. Absolutely. Except I think tha

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Linus Torvalds
On Wed, 18 Apr 2007, Davide Libenzi wrote: > > "Perhaps on the rare occasion pursuing the right course demands an act of > unfairness, unfairness itself can be the right course?" I don't think that's the right issue. It's just that "fairness" != "equal". Do you think it "fair" to pay everyb

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Davide Libenzi
On Wed, 18 Apr 2007, Linus Torvalds wrote: > For example, maybe we can approximate it by spreading out the statistics: > right now you have things like > > - last_ran, wait_runtime, sum_wait_runtime.. > > be per-thread things. Maybe some of those can be spread out, so that you > put a part of

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Davide Libenzi
On Wed, 18 Apr 2007, Linus Torvalds wrote: > I'm not arguing against fairness. I'm arguing against YOUR notion of > fairness, which is obviously bogus. It is *not* fair to try to give out > CPU time evenly! "Perhaps on the rare occasion pursuing the right course demands an act of unfairness,

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Davide Libenzi
On Wed, 18 Apr 2007, William Lee Irwin III wrote: > Thinking of the scheduler as a CPU bandwidth allocator, this means > handing out shares of CPU bandwidth to all users on the system, which > in turn hand out shares of bandwidth to all sessions, which in turn > hand out shares of bandwidth to all

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* Linus Torvalds <[EMAIL PROTECTED]> wrote: > For example, maybe we can approximate it by spreading out the > statistics: right now you have things like > > - last_ran, wait_runtime, sum_wait_runtime.. > > be per-thread things. [...] yes, yes, yes! :) My thinking is "struct sched_group" embe

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Linus Torvalds
On Wed, 18 Apr 2007, Ingo Molnar wrote: > > perhaps a more fitting term would be 'precise group-scheduling'. Within > the lowest level task group entity (be that thread group or uid group, > etc.) 'precise scheduling' is equivalent to 'fairness'. Yes. Absolutely. Except I think that at least

Re: [ck] Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Chris Friesen
Mark Glines wrote: One minor question: is it even possible to be completely fair on SMP? For instance, if you have a 2-way SMP box running 3 applications, one of which has 2 threads, will the threaded app have an advantage here? (The current system seems to try to keep each thread on a specific

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Linus Torvalds
On Wed, 18 Apr 2007, Ingo Molnar wrote: > > But note that most of the reported CFS interactivity wins, as surprising > as it might be, were due to fairness between _the same user's tasks_. And *ALL* of the CFS interactivity *losses* and complaints have been because it did the wrong thing _bet

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Michael K. Edwards
On 4/18/07, Matt Mackall <[EMAIL PROTECTED]> wrote: For the record, you actually don't need to track a whole NxN matrix (or do the implied O(n**3) matrix inversion!) to get to the same result. You can converge on the same node weightings (ie dynamic priorities) by applying a damped function at ea

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Davide Libenzi
On Wed, 18 Apr 2007, Matt Mackall wrote: > On Wed, Apr 18, 2007 at 07:48:21AM -0700, Linus Torvalds wrote: > > And "fairness by euid" is probably a hell of a lot easier to do than > > trying to figure out the wakeup matrix. > > For the record, you actually don't need to track a whole NxN matrix

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Diego Calleja
El Wed, 18 Apr 2007 10:22:59 -0700 (PDT), Linus Torvalds <[EMAIL PROTECTED]> escribió: > So if you have 2 users on a machine running CPU hogs, you should *first* > try to be fair among users. If one user then runs 5 programs, and the > other one runs just 1, then the *one* program should get 50

Re: [ck] Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Mark Glines
On Wed, 18 Apr 2007 10:22:59 -0700 (PDT) Linus Torvalds <[EMAIL PROTECTED]> wrote: > So if you have 2 users on a machine running CPU hogs, you should > *first* try to be fair among users. If one user then runs 5 programs, > and the other one runs just 1, then the *one* program should get 50% > of

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* William Lee Irwin III <[EMAIL PROTECTED]> wrote: > It does largely achieve the sort of fairness it set out for itself as > its design goal. One should also note that the queueing mechanism is > more than flexible enough to handle prioritization by a number of > different methods, and the lar

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread William Lee Irwin III
On Wed, Apr 18, 2007 at 10:22:59AM -0700, Linus Torvalds wrote: > So I claim that anything that cannot be fair by user ID is actually really > REALLY unfair. I think it's absolutely humongously STUPID to call > something the "Completely Fair Scheduler", and then just be fair on a > thread level.

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* Ingo Molnar <[EMAIL PROTECTED]> wrote: > In that sense 'fairness' is not global (and in fact it is almost > _never_ a global property, as X runs under root uid [*]), it is only > the most lowlevel scheduling machinery that can then be built upon. > [...] perhaps a more fitting term would be

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* Linus Torvalds <[EMAIL PROTECTED]> wrote: > The fact is: > > - "fairness" is *not* about giving everybody the same amount of CPU >time (scaled by some niceness level or not). Anybody who thinks >that is "fair" is just being silly and hasn't thought it through. yeah, very much so.

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Linus Torvalds
On Wed, 18 Apr 2007, Matt Mackall wrote: > > On Wed, Apr 18, 2007 at 07:48:21AM -0700, Linus Torvalds wrote: > > And "fairness by euid" is probably a hell of a lot easier to do than > > trying to figure out the wakeup matrix. > > For the record, you actually don't need to track a whole NxN matr

Re: CFS and suspend2: hang in atomic copy (was: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS])

2007-04-18 Thread Ingo Molnar
* Christian Hesse <[EMAIL PROTECTED]> wrote: > Hi Ingo and all, > > On Friday 13 April 2007, Ingo Molnar wrote: > > as usual, any sort of feedback, bugreports, fixes and suggestions are > > more than welcome, > > I just gave CFS a try on my system. From a user's point of view it > looks good s

CFS and suspend2: hang in atomic copy (was: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS])

2007-04-18 Thread Christian Hesse
Hi Ingo and all, On Friday 13 April 2007, Ingo Molnar wrote: > as usual, any sort of feedback, bugreports, fixes and suggestions are > more than welcome, I just gave CFS a try on my system. From a user's point of view it looks good so far. Thanks for your work. However I found a problem: When t

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Matt Mackall
On Wed, Apr 18, 2007 at 07:48:21AM -0700, Linus Torvalds wrote: > And "fairness by euid" is probably a hell of a lot easier to do than > trying to figure out the wakeup matrix. For the record, you actually don't need to track a whole NxN matrix (or do the implied O(n**3) matrix inversion!) to get

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Linus Torvalds
On Wed, 18 Apr 2007, Matt Mackall wrote: > > Why is X special? Because it does work on behalf of other processes? > Lots of things do this. Perhaps a scheduler should focus entirely on > the implicit and directed wakeup matrix and optimizing that > instead[1]. I 100% agree - the perfect schedul

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread William Lee Irwin III
On Wed, Apr 18, 2007 at 12:55:25AM -0500, Matt Mackall wrote: > Why are processes special? Should user A be able to get more CPU time > for his job than user B by splitting it into N parallel jobs? Should > we be fair per process, per user, per thread group, per session, per > controlling terminal?

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Peter Williams
Chris Friesen wrote: Peter Williams wrote: Chris Friesen wrote: Suppose I have a really high priority task running. Another very high priority task wakes up and would normally preempt the first one. However, there happens to be another cpu available. It seems like it would be a win if we

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Con Kolivas
On Wednesday 18 April 2007 22:13, Nick Piggin wrote: > On Wed, Apr 18, 2007 at 11:53:34AM +0200, Ingo Molnar wrote: > > * Nick Piggin <[EMAIL PROTECTED]> wrote: > > > So looking at elapsed time, a granularity of 100ms is just behind the > > > mainline score. However it is using slightly less user t

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Con Kolivas
On Wednesday 18 April 2007 22:14, Nick Piggin wrote: > On Wed, Apr 18, 2007 at 07:33:56PM +1000, Con Kolivas wrote: > > On Wednesday 18 April 2007 18:55, Nick Piggin wrote: > > > Again, for comparison 2.6.21-rc7 mainline: > > > > > > 508.87user 32.47system 2:17.82elapsed 392%CPU > > > 509.05user 32

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Nick Piggin
On Wed, Apr 18, 2007 at 07:33:56PM +1000, Con Kolivas wrote: > On Wednesday 18 April 2007 18:55, Nick Piggin wrote: > > Again, for comparison 2.6.21-rc7 mainline: > > > > 508.87user 32.47system 2:17.82elapsed 392%CPU > > 509.05user 32.25system 2:17.84elapsed 392%CPU > > 508.75user 32.26system 2:17.

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Nick Piggin
On Wed, Apr 18, 2007 at 11:53:34AM +0200, Ingo Molnar wrote: > > * Nick Piggin <[EMAIL PROTECTED]> wrote: > > > So looking at elapsed time, a granularity of 100ms is just behind the > > mainline score. However it is using slightly less user time and > > slightly more idle time, which indicates

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* Andy Whitcroft <[EMAIL PROTECTED]> wrote: > > as usual, any sort of feedback, bugreports, fixes and suggestions > > are more than welcome, > > Pushed this through the test.kernel.org and nothing new blew up. > Notably the kernbench figures are within expectations even on the > bigger numa s

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Ingo Molnar
* Nick Piggin <[EMAIL PROTECTED]> wrote: > > > 535.43user 30.62system 2:23.72elapsed 393%CPU > > > > Thanks for testing this! Could you please try this also with: > > > >echo 1 > /proc/sys/kernel/sched_granularity > > 507.68user 31.87system 2:18.05elapsed 390%CPU > 507.99user 31.93

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Con Kolivas
On Wednesday 18 April 2007 18:55, Nick Piggin wrote: > On Tue, Apr 17, 2007 at 11:59:00AM +0200, Ingo Molnar wrote: > > * Nick Piggin <[EMAIL PROTECTED]> wrote: > > > 2.6.21-rc7-cfs-v2 > > > 534.80user 30.92system 2:23.64elapsed 393%CPU > > > 534.75user 31.01system 2:23.70elapsed 393%CPU > > > 534.

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Nick Piggin
On Tue, Apr 17, 2007 at 11:59:00AM +0200, Ingo Molnar wrote: > > * Nick Piggin <[EMAIL PROTECTED]> wrote: > > > 2.6.21-rc7-cfs-v2 > > 534.80user 30.92system 2:23.64elapsed 393%CPU > > 534.75user 31.01system 2:23.70elapsed 393%CPU > > 534.66user 31.07system 2:23.76elapsed 393%CPU > > 534.56user 30

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread James Bruce
Matt Mackall wrote: On Tue, Apr 17, 2007 at 03:59:02PM -0700, William Lee Irwin III wrote: On Tue, Apr 17, 2007 at 03:32:56PM -0700, William Lee Irwin III wrote: I'm working with the following suggestion: On Tue, Apr 17, 2007 at 09:07:49AM -0400, James Bruce wrote: Nonlinear is a must IMO. I

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Nick Piggin
On Wed, Apr 18, 2007 at 01:55:34AM -0500, Matt Mackall wrote: > On Wed, Apr 18, 2007 at 08:37:11AM +0200, Nick Piggin wrote: > > I don't know how that supports your argument for unfairness, > > I never had such an argument. I like fairness. > > My argument is that -you- don't have an argument for

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-18 Thread Matt Mackall
On Wed, Apr 18, 2007 at 08:37:11AM +0200, Nick Piggin wrote: > I don't know how that supports your argument for unfairness, I never had such an argument. I like fairness. My argument is that -you- don't have an argument for making fairness a -requirement-. > processes are special only because th

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Nick Piggin
On Wed, Apr 18, 2007 at 12:55:25AM -0500, Matt Mackall wrote: > On Wed, Apr 18, 2007 at 07:00:24AM +0200, Nick Piggin wrote: > > > It's also not yet clear that a scheduler can't be taught to do the > > > right thing with X without fiddling with nice levels. > > > > Being fair doesn't prevent that.

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Matt Mackall
On Wed, Apr 18, 2007 at 07:00:24AM +0200, Nick Piggin wrote: > > It's also not yet clear that a scheduler can't be taught to do the > > right thing with X without fiddling with nice levels. > > Being fair doesn't prevent that. Implicit unfairness is wrong though, > because it will bite people. >

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Chris Friesen
Peter Williams wrote: Chris Friesen wrote: Suppose I have a really high priority task running. Another very high priority task wakes up and would normally preempt the first one. However, there happens to be another cpu available. It seems like it would be a win if we moved one of those tas

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Nick Piggin
On Tue, Apr 17, 2007 at 11:38:31PM -0500, Matt Mackall wrote: > On Wed, Apr 18, 2007 at 05:15:11AM +0200, Nick Piggin wrote: > > > > I don't know why this would be a useful feature (of course I'm talking > > about processes at the same nice level). One of the big problems with > > the current sche

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Matt Mackall
On Wed, Apr 18, 2007 at 05:15:11AM +0200, Nick Piggin wrote: > On Tue, Apr 17, 2007 at 04:39:54PM -0500, Matt Mackall wrote: > > On Tue, Apr 17, 2007 at 09:01:55AM +0200, Nick Piggin wrote: > > > On Mon, Apr 16, 2007 at 11:26:21PM -0700, William Lee Irwin III wrote: > > > > On Mon, Apr 16, 2007 at

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair

2007-04-17 Thread Al Boldi
William Lee Irwin III wrote: > Ingo Molnar wrote: > >> Anyone who thinks that there exists only two kinds of code: 100% > >> correct and 100% incorrect with no shades of grey inbetween is in > >> reality a sort of an extremist: whom, depending on mood and affection, > >> we could call either a 'cod

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Nick Piggin
On Tue, Apr 17, 2007 at 11:16:54PM +1000, Peter Williams wrote: > Nick Piggin wrote: > >I don't like the timeslice based nice in mainline. It's too nasty > >with latencies. nicksched is far better in that regard IMO. > > > >But I don't know how you can assert a particular way is the best way > >to

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Davide Libenzi
On Tue, 17 Apr 2007, William Lee Irwin III wrote: > 100**(1/39.0) ~= 1.12534 may do if so, but it seems a little weak, and > even 1000**(1/39.0) ~= 1.19378 still seems weak. > > I suspect that in order to get low nice numbers strong enough without > making high nice numbers too strong something s

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Mike Galbraith
On Wed, 2007-04-18 at 05:56 +0200, Nick Piggin wrote: > On Wed, Apr 18, 2007 at 05:45:20AM +0200, Mike Galbraith wrote: > > On Wed, 2007-04-18 at 05:15 +0200, Nick Piggin wrote: > > > > > > > > > So on what basis would you allow unfairness? On the basis that it doesn't > > > seem to harm anyone? I

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread William Lee Irwin III
On Tue, Apr 17, 2007 at 09:07:49AM -0400, James Bruce wrote: >>> Nonlinear is a must IMO. I would suggest X = exp(ln(10)/10) ~= 1.2589 >>> That value has the property that a nice=10 task gets 1/10th the cpu of a >>> nice=0 task, and a nice=20 task gets 1/100 of nice=0. I think that >>> would be f

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Nick Piggin
On Wed, Apr 18, 2007 at 05:45:20AM +0200, Mike Galbraith wrote: > On Wed, 2007-04-18 at 05:15 +0200, Nick Piggin wrote: > > On Tue, Apr 17, 2007 at 04:39:54PM -0500, Matt Mackall wrote: > > > > > > I'm a big fan of fairness, but I think it's a bit early to declare it > > > a mandatory feature. Bou

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Mike Galbraith
On Wed, 2007-04-18 at 05:15 +0200, Nick Piggin wrote: > On Tue, Apr 17, 2007 at 04:39:54PM -0500, Matt Mackall wrote: > > > > I'm a big fan of fairness, but I think it's a bit early to declare it > > a mandatory feature. Bounded unfairness is probably something we can > > agree on, ie "if we decid

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Nick Piggin
On Tue, Apr 17, 2007 at 04:39:54PM -0500, Matt Mackall wrote: > On Tue, Apr 17, 2007 at 09:01:55AM +0200, Nick Piggin wrote: > > On Mon, Apr 16, 2007 at 11:26:21PM -0700, William Lee Irwin III wrote: > > > On Mon, Apr 16, 2007 at 11:09:55PM -0700, William Lee Irwin III wrote: > > > >> All things ar

Re: [Announce] [patch] Modular Scheduler Core and Completely Fair Scheduler [CFS]

2007-04-17 Thread Peter Williams
Michael K. Edwards wrote: On 4/17/07, Peter Williams <[EMAIL PROTECTED]> wrote: The other way in which the code deviates from the original as that (for a few years now) I no longer calculated CPU bandwidth usage directly. I've found that the overhead is less if I keep a running average of the si

  1   2   3   4   >