Re: Resource modelling questions

- Original Message - > Zhou, > > I haven't read the *Design* yet, but I don't think it is solving the same > > question between priorities and quota. For example, assume we only have 10G > > memory reservating for framework A totally, then another urgency framework > > is getting nothing

Re: Resource modelling questions

Alex, thanks a lot. I have understood your idea now. Pretty good quota solution. -:) 2015-06-19 17:00 GMT+08:00 Alex Rukletsov : > Inlined. > > On Fri, Jun 19, 2015 at 4:17 AM, zhou weitao wrote: > >> Alex, hi, >> >> 2015-06-18 23:25 GMT+08:00 Alex Rukletsov : >> >>> Zhou, >>> >>> I haven't rea

Re: Resource modelling questions

Inlined. On Fri, Jun 19, 2015 at 4:17 AM, zhou weitao wrote: > Alex, hi, > > 2015-06-18 23:25 GMT+08:00 Alex Rukletsov : > >> Zhou, >> >> I haven't read the *Design* yet, but I don't think it is solving the same >>> question between priorities and quota. For example, assume we only have 10G >>>

Re: Resource modelling questions

On 19/06/2015 01:59, Benjamin Mahler wrote: 100ms is the default period for quota: https://www.kernel.org/doc/Documentation/scheduler/sched-bwc.txt Ah, that's very interesting: thank you. Now if I understand this correctly, assuming Mesos runs all its tasks in cgroups with CPU bandwidth cont

Re: Resource modelling questions

Alex, hi, 2015-06-18 23:25 GMT+08:00 Alex Rukletsov : > Zhou, > > I haven't read the *Design* yet, but I don't think it is solving the same >> question between priorities and quota. For example, assume we only have 10G >> memory reservating for framework A totally, then another urgency framework

Re: Resource modelling questions

Zhou, I haven't read the *Design* yet, but I don't think it is solving the same > question between priorities and quota. For example, assume we only have 10G > memory reservating for framework A totally, then another urgency framework > is getting nothing. which is statical partition still. While

Re: Resource modelling questions

On 18/06/2015 06:41, zhou weitao wrote: A partial solution might be if each task could request a fraction of a CPU. But CPU fraction is Time-Division. I don't think it's possible to request a fraction. Because it's timeslicing, there should be no problem at all requesting fractions. F

Re: Resource modelling questions

2015-06-17 17:33 GMT+08:00 Brian Candler : > I have some questions about resource accounting in Mesos. > > In the [mesos architecture]( > http://mesos.apache.org/documentation/latest/mesos-architecture/) and the > [2010 white paper](https://www.cs.berkeley.edu/~alig/papers/mesos.pdf), > the follow

Re: Resource modelling questions

2015-06-17 20:01 GMT+08:00 Alex Rukletsov : > Brian, > > these are very good and nicely written questions, let me try to ask them. > > Mesos built-in allocator does the bookkeeping based on the declared > resource consumption and not actual (you call it "measured"). This means > the example in Apa

Re: Resource modelling questions

On 06/17/2015 07:01 AM, Alex Rukletsov wrote: Brian, these are very good and nicely written questions, let me try to ask them. Mesos built-in allocator does the bookkeeping based on the declared resource consumption and not actual (you call it "measured"). This means the example in Apache docs

Re: Resource modelling questions

On 17/06/2015 13:01, Alex Rukletsov wrote: IMO it is planned to measure the actual resource consumption on each Mesos agent node and notify Mesos master (including allocator) about extra free but revokable resources. Here

Re: Resource modelling questions

Brian, these are very good and nicely written questions, let me try to ask them. Mesos built-in allocator does the bookkeeping based on the declared resource consumption and not actual (you call it "measured"). This means the example in Apache docs and the white paper is correct. However, there

Re: Resource modelling questions

On 17/06/2015 10:33, Brian Candler wrote: It's made more complicated by the fact that the jobs use mmap() on large shared databases, so running multiple instances of the same task doesn't use N times as much memory as one task. Aside: combined with cgroups this gets hairy. As I understand it,