[
https://issues.apache.org/jira/browse/TEZ-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907241#comment-14907241
]
Bikas Saha commented on TEZ-2808:
---------------------------------
0.7
commit 91fd5a607e9d8e41bce9365e4ad29fb8828f0c6c
Author: Bikas Saha <[email protected]>
Date: Thu Sep 10 18:26:09 2015 -0700
TEZ-2808. Race condition between preemption and container assignment (bikas)
(cherry picked from commit 59f8d2ae81110a6d11fbc9affc76bc57c6f86732)
Conflicts:
CHANGES.txt
0.6
commit ad9206b0065e07f45e1fbca3fe3bff125cb0b914
Author: Bikas Saha <[email protected]>
Date: Thu Sep 10 18:26:09 2015 -0700
TEZ-2808. Race condition between preemption and container assignment (bikas)
(cherry picked from commit 59f8d2ae81110a6d11fbc9affc76bc57c6f86732)
0.5
commit de87d72c2f81d244f38b3312222389fe6e142858
Author: Bikas Saha <[email protected]>
Date: Thu Sep 10 18:26:09 2015 -0700
TEZ-2808. Race condition between preemption and container assignment (bikas)
(cherry picked from commit 59f8d2ae81110a6d11fbc9affc76bc57c6f86732)
> Race condition between preemption and container assignment
> ----------------------------------------------------------
>
> Key: TEZ-2808
> URL: https://issues.apache.org/jira/browse/TEZ-2808
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Fix For: 0.7.1, 0.5.5, 0.6.3, 0.8.1
>
> Attachments: TEZ-2808.1.patch
>
>
> New container allocated. Put in delayed container manager queue. Triggers
> assignment run on delayed container manager thread.
> On AMRMClient thread callback, preemption is called. This is to ensure
> preemption logic is guaranteed to be invoked at regular intervals even though
> nothing else may be happening because there are no containers
> allocated/to-match. Preemption logic checks if containers are available to
> assign by looking at delayed container manager queue. If by this time, the
> assignment thread has polled the queue to remove the container for assignment
> checking, then the preemption code will see no containers available to
> assign. So it proceeds to preempt containers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
