[ 
https://issues.apache.org/jira/browse/YARN-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bibin A Chundatt updated YARN-4454:
-----------------------------------
    Attachment: 0001-YARN-4454.patch

Hi [~leftnoteasy]
Thank you for looking into the issue . i was checking how to keep the order 
based on insertion order. Thts not required since when *host* is used all other 
labels we are getting updated in replace.

Your solution totally make sense. Currently before internal label update for 
the normalize have used treeMap to keep sorting based on Node ID is required.

Please do review the same.

> NM to nodelabel mapping going wrong after RM restart
> ----------------------------------------------------
>
>                 Key: YARN-4454
>                 URL: https://issues.apache.org/jira/browse/YARN-4454
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Bibin A Chundatt
>            Assignee: Bibin A Chundatt
>            Priority: Critical
>         Attachments: 0001-YARN-4454.patch, test.patch
>
>
> *Nodelabel mapping with NodeManager  is going wrong if combination of 
> hostname and then NodeId is used to update nodelabel mapping*
> *Steps to reproduce*
> 1.Create cluster with 2 NM
> 2.Add label X,Y to cluster
> 3.replace  Label of node  1 using <HOSTNAME1:PORT>,x
> 4.replace label for node 1 by <HOSTNAME1>,y
> 5.Again replace label of node 1 by <HOSTNAME1:PORT>,x
> Check cluster label mapping HOSTNAME1 will be mapped with X 
> Now restart RM 2 times NODE LABEL mapping of HOSTNAME1:PORT changes to Y
> {noformat}
> 2015-12-14 17:17:54,901 INFO 
> org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager: Add labels: 
> [<ResourcePool_1:exclusivity=true>,<ResourcePool_null:exclusivity=true>]
> 2015-12-14 17:17:54,905 INFO 
> org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager: REPLACE labels on 
> nodes:
> 2015-12-14 17:17:54,906 INFO 
> org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager:   
> NM=host-10-19-92-188:64318, labels=[ResourcePool_1]
> 2015-12-14 17:17:54,906 INFO 
> org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager:   
> NM=host-10-19-92-188:0, labels=[ResourcePool_null]
> 2015-12-14 17:17:54,906 INFO 
> org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager:   
> NM=host-10-19-92-187:64318, labels=[ResourcePool_null]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to