Bibin A Chundatt created YARN-4362: -------------------------------------- Summary: Too many preemption activity when nodelabels are non exclusive Key: YARN-4362 URL: https://issues.apache.org/jira/browse/YARN-4362 Project: Hadoop YARN Issue Type: Bug Reporter: Bibin A Chundatt Priority: Critical
Steps to reproduce =============== 1.Configure HA cluster with 6 nodes and 3 partition(1,2,3) all non exclusive *Partition configuration is as follows* 1,2 NM's mapped with Label 1 NM 3 to label 2 4,5 NM's mapped to Label 3 NM 6 in DEFAULT partition In capacity scheduler the queue are linked only to 1,3 partition. The NM 3 with label 2 is a backup node for any partition whenever required will change the label. Submit and application/job with 200 containers to default queue. All containers that gets assigned to partition 2 gets preempted The application/map task execution is taking more time since 30-40 task gets assigned to partition 2 then gets preempted and all of them needs to be relaunched. -- This message was sent by Atlassian JIRA (v6.3.4#6332)