[
https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157376#comment-16157376
]
Manikandan R commented on YARN-65:
----------------------------------
[~rohithsharma], [~Naganarasimha] Thanks for review.
Cloned {{ApplicationSubmissionContext}} before adding and updating the
ApplicationStateData and kept the cloned object in map against their
{{ApplicationId}} as there are many test cases wherein more than 1 apps gets
submitted and RM restart happens after that. This cloned object would get used
while passing statestore during RM restarts. Modified MockRMMemoryStateStore
(which already extends MemoryRMStateStore) to accomodate all the above
described changes and used the same in all test cases, rather than doing
changes in MemoryRMStateStore. Inaddition, renamed MockRMMemoryStateStore to
MockMemoryRMStateStore to reflect the proper base class name. With this
approach, changes in test cases had become simpler. Attached patch for the same.
> Reduce RM app memory footprint once app has completed
> -----------------------------------------------------
>
> Key: YARN-65
> URL: https://issues.apache.org/jira/browse/YARN-65
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
> Affects Versions: 0.23.3
> Reporter: Jason Lowe
> Assignee: Manikandan R
> Attachments: YARN-65.001.patch, YARN-65.002.patch, YARN-65.003.patch,
> YARN-65.004.patch, YARN-65.005.patch, YARN-65.006.patch, YARN-65.007.patch,
> YARN-65.008.patch, YARN-65.009.patch, YARN-65.010.patch, YARN-65.011.patch
>
>
> The ResourceManager holds onto a configurable number of completed
> applications (yarn.resource.max-completed-applications, defaults to 10000),
> and the memory footprint of these completed applications can be significant.
> For example, the {{submissionContext}} in RMAppImpl contains references to
> protocolbuffer objects and other items that probably aren't necessary to keep
> around once the application has completed. We could significantly reduce the
> memory footprint of the RM by releasing objects that are no longer necessary
> once an application completes.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
