Zhijie Shen commented on YARN-3334:

Junping, thanks for the patch. Here's my comments:

1. Do you want change "initialized" to "started" 
512             // only put initialized client

2. The following method seems unnecessary, because there's 
{{getTimelineClient(ApplicationId id)}}.
500         public Map<ApplicationId, TimelineClient> getTimelineClients() {
501           return this.timelineClients;
502         }

3. It seems there's no need to maintain rmKnownCollectors. We can blindly put 
the service addr into timeline client. It won't affect anything if the address 
is not changed? Or we can do a simple check {{client.getAddr != 
newServiceAddr}} to avoid trivial set.

4. IMHO, the better description is to use ContainerEntity whose ID is this 
container ID.
441               TimelineEntity entity = new TimelineEntity();
442               entity.setType(NMEntity.NM_CONTAINER_METRICS.toString());
443               entity.setId(containerId.toString());

5. We need flag to control NM emitting the timeline data or not.

6. Unnecessary empty string.
        503                     "" + cpuUsageTotalCoresPercentage);

7. You probably want to use addTimeSeriesData to add single key/value pair.
526                 memoryMetric.setTimeSeries(timeSeries);

8. NM needs to remove the timelineClient of a finished app. Otherwise, 
timelineClients will eat increasingly more resource as NM keeps running, but 
actually don't use it. The difficulty is how to know if an application is 
already finished. We need to think about it.
368         private ConcurrentHashMap<ApplicationId, TimelineClient> 
timelineClients = 
369             new ConcurrentHashMap<ApplicationId, TimelineClient>();

> [Event Producers] NM start to posting some app related metrics in early POC 
> stage of phase 2.
> ---------------------------------------------------------------------------------------------
>                 Key: YARN-3334
>                 URL: https://issues.apache.org/jira/browse/YARN-3334
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager
>    Affects Versions: YARN-2928
>            Reporter: Junping Du
>            Assignee: Junping Du
>         Attachments: YARN-3334-demo.patch, YARN-3334-v1.patch

This message was sent by Atlassian JIRA

Reply via email to