Karthik Kambatla commented on YARN-3534:

bq. I'm not sure if we should use RPC to expose the stats. 
As YARN-3332 suggests, we should expose these stats through REST. However, for 
the RM (scheduler) to get this information, I think RPC (through node 
heartbeat) is better. That way, the RM doesn't have to poll the REST API for 
every node there is an NM heartbeat for. 

If the suggestion is for the NM to get this information from the REST API, I 
think that is fine. However, since this communication is private to NM, we can 
always change this later once YARN-3332 is ready. 

> Report node resource utilization
> --------------------------------
>                 Key: YARN-3534
>                 URL: https://issues.apache.org/jira/browse/YARN-3534
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Inigo Goiri
>            Assignee: Inigo Goiri
>         Attachments: YARN-3534-1.patch, YARN-3534-2.patch, YARN-3534-3.patch, 
> YARN-3534-3.patch
>   Original Estimate: 336h
>  Remaining Estimate: 336h
> YARN should be aware of the resource utilization of the nodes when scheduling 
> containers. For this, this task will implement the NodeResourceMonitor and 
> send this information to the Resource Manager in the heartbeat.

This message was sent by Atlassian JIRA

Reply via email to