Chris Trezzo created YARN-5192:
----------------------------------
Summary: Limit the number of resources a container can localize
Key: YARN-5192
URL: https://issues.apache.org/jira/browse/YARN-5192
Project: Hadoop YARN
Issue Type: New Feature
Reporter: Chris Trezzo
Users will sometimes submit YARN applications where containers localize a large
number of resources. This thrashes the YARN local cache on the node managers
and can impact other running applications. It would be nice if there was
server-side enforcement of localization limits that an admin could configure.
For example:
# Total size of the resources a container can localize.
# Total number of files a container can localize.
# The maximum size of an individual resource (i.e. a large fat jar) that a
container can localize.
MAPREDUCE-6690 is being worked on to provide a set of MapReduce client-side
limits.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
