Inigo Goiri commented on YARN-3534:

[~sunilg], my plan is to send the same entity as in YARN-3482: 
ResourceUtilization. For now, it will have memory in MB and Virtual Cores as a 
float. We can extend this for other resources.
In terms of the collection of the utilization, this will be monitored by the 
NodeResourceMonitor (currently empty) which will mimic the behavior of the 
ContainerMonitor which uses two configuration parameters: (1) if we monitor the 
resources of the node and (2) how often the resources are monitored.

I'm in the last stages of testing it and tomorrow I'll post a patch with this 
change. The structure was already there so it's a matter of adding the 
communication part..

> Report node resource utilization
> --------------------------------
>                 Key: YARN-3534
>                 URL: https://issues.apache.org/jira/browse/YARN-3534
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Inigo Goiri
>            Assignee: Inigo Goiri
>   Original Estimate: 336h
>  Remaining Estimate: 336h
> YARN should be aware of the resource utilization of the nodes when scheduling 
> containers. For this, this task will implement the NodeResourceMonitor and 
> send this information to the Resource Manager in the heartbeat.

This message was sent by Atlassian JIRA

Reply via email to