Arun Suresh created YARN-5501:
---------------------------------
Summary: Container Pooling in YARN
Key: YARN-5501
URL: https://issues.apache.org/jira/browse/YARN-5501
Project: Hadoop YARN
Issue Type: Improvement
Reporter: Arun Suresh
This JIRA proposes a method for reducing the container launch latency in YARN.
It introduces a notion of pooling *Unattached Pre-Initialized Containers*.
Proposal in brief:
* Have a *Pre-Initialized Container Factory* service within the NM to create
these unattached containers.
* The NM would then advertise these containers as special resource types (this
should be possible via YARN-3926).
* When a start container request is received by the node manager for launching
a container requesting this specific type of resource, it will take one of
these unattached pre-initialized containers from the pool, and use it to
service the container request.
* Once the request is complete, the pre-initialized container would be released
and ready to serve another request.
This capability would help reduce container launch latencies and thereby allow
for development of more interactive applications on YARN.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
