Naganarasimha G R created YARN-6523:
---------------------------------------
Summary: RM requires large memory in sending out security tokens
as part of Node Heartbeat in large cluster
Key: YARN-6523
URL: https://issues.apache.org/jira/browse/YARN-6523
Project: Hadoop YARN
Issue Type: Bug
Components: RM
Affects Versions: 2.7.3, 2.8.0
Reporter: Naganarasimha G R
Assignee: Naganarasimha G R
Priority: Critical
Currently as part of heartbeat response RM sets all application's tokens though
all applications might not be active on the node. On top of it
NodeHeartbeatResponsePBImpl converts tokens for each app into
SystemCredentialsForAppsProto. Hence for each node and each heartbeat too many
SystemCredentialsForAppsProto objects were getting created.
We hit a OOM while testing for 2000 concurrent apps on 500 nodes cluster with
8GB RAM configured for RM
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
