Bernd Mathiske created MESOS-2738:
-------------------------------------
Summary: Report resources allocated to default executors equally
for frameworks and slaves in state.json
Key: MESOS-2738
URL: https://issues.apache.org/jira/browse/MESOS-2738
Project: Mesos
Issue Type: Improvement
Components: json api, master
Reporter: Bernd Mathiske
[~rcorral] recently observed that according to state.json summing up the
resources allocated to tasks from different frameworks on a slave does not
match the total that is reported for the slave. The latter number is higher.
[~adam-mesos] and I have the strong suspicion that when in state.json the sum
of all resources allocated to a framework is reported, this does not include
the resources for default (command line) executors. However, when the resources
of a slave are summed up in state.json, these resources are included in the
total. Custom executor resources are included in both cases. Browsing master
source code supports this theory.
It would be desirable for tools that display allocation statistics to find
balanced tallies.
Possible alternative approaches:
- Exclude default executors from the sum for slaves.
- Include default executors for frameworks and their tasks.
- Emit a global record listing the canonical resource values for default
executors, which are always the same. Then the sums of such resources can be
determined by multiplying by the number of tasks involved.
Workaround for now: determine the latter amounts by reading Mesos source code
and hardcode them into your external tool.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
