Benjamin Mahler created MESOS-9234:
--------------------------------------
Summary: Improve performance of offer fan-out in the master.
Key: MESOS-9234
URL: https://issues.apache.org/jira/browse/MESOS-9234
Project: Mesos
Issue Type: Improvement
Components: allocation, master
Reporter: Benjamin Mahler
Of interest to improving scalability is the ability for the master to quickly
fan out offers as the allocator makes new allocation decisions.
Some low hanging fruit:
* Low hanging copy elimination.
* Send more compact and cache-friendlier data structures across master <->
allocator interface boundary (right now the allocator makes a call back into
the master with a double-nested hashmap<role,hashmap<SlaveID,Resources>>).
* Reduce excessive map lookups.
Longer term:
* Update v1 message evolution paths to avoid de-serializing / serializing in
favor of copying fields (either manually or with a reflection based copier), or
by moving individual fields when possible (this will only help with string
fields AFAICT).
* Update the master <-> allocator interface to send all framework allocations
in one call, and use a parallel loop (see MESOS-8587) in the master to speed up
the fan-out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
