[ 
https://issues.apache.org/jira/browse/YARN-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941370#comment-17941370
 ] 

ASF GitHub Bot commented on YARN-11808:
---------------------------------------

ASHISH-RANJAN59 opened a new pull request, #7583:
URL: https://github.com/apache/hadoop/pull/7583

   <!--
     Thanks for sending a pull request!
       1. If this is your first time, please read our contributor guidelines: 
https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
       2. Make sure your PR title starts with JIRA issue id, e.g., 
'HADOOP-17799. Your PR title ...'.
   -->
   
   ### Description of PR
   
   
   ### How was this patch tested?
   
   
   ### For code changes:
   
   - [Y ] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the 
endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, 
`NOTICE-binary` files?
   
   




> RM memory leak due to Opportunistic container request cancellation at App 
> level
> -------------------------------------------------------------------------------
>
>                 Key: YARN-11808
>                 URL: https://issues.apache.org/jira/browse/YARN-11808
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: RM, yarn
>            Reporter: Ashish Ranjan
>            Priority: Major
>
> 2025-02-20T09:07:40,735 INFO  [2991] OpportunisticContainerContext: # of 
> outstandingOpReqs in ANY (at priority = 68, allocationReqId = 50657, with 
> capability = <memory:3072, vCores:2, network: 640Mi> ) : , with location = * 
> ) : , numContainers = 0
> 2025-02-20T09:07:40,735 INFO  [2991] OpportunisticContainerContext: # of 
> outstandingOpReqs in ANY (at priority = 68, allocationReqId = 50658, with 
> capability = <memory:3072, vCores:2, network: 640Mi> ) : , with location = * 
> ) : , numContainers = 0
> 2025-02-20T09:07:40,735 INFO  [2991] OpportunisticContainerContext: # of 
> outstandingOpReqs in ANY (at priority = 68, allocationReqId = 50659, with 
> capability = <memory:3072, vCores:2, network: 640Mi> ) : , with location = * 
> ) : , numContainers = 0
>  
>  
> numContainers = 0 denote we don't ant allocation of this type. But the map 
> object is persisted per application attempt and causing heap issue wastage in 
> RM.
>  
> In function addToOutstandingReqs * Incase the container request from AM is 
> zero we should make sure to clean up the map.
> Multiple issue due to this:
>  * Too much unnecessary logging.
>  * Memory leak in RM side.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to