[
https://issues.apache.org/jira/browse/TEZ-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
junbiao chen updated TEZ-4315:
------------------------------
Description:
When assigning task to container,YarnTaskSchedulerService need to traverse
pending cookieContainerRequests(stored in LinkedHashSet) to select one that
mathing the container by calling method getMatchingRequestWithoutPriority. In
the meantime, YarnTaskSchedulerService will also remove the completed
cookieContainerRequest from LinkedHashSet by calling method
removeTaskRequest.This may cause ConcurrentModificationException,because
LinkedHashSet is not thread-safe.
[https://github.com/apache/tez/pull/133]
was:
When assigning task to container,YarnTaskSchedulerService need to traverse
pending cookieContainerRequests(stored in LinkedHashSet) to select one that
mathing the container by calling method getMatchingRequestWithoutPriority. In
the meantime, YarnTaskSchedulerService will also remove the completed
cookieContainerRequest from LinkedHashSet by calling method
removeTaskRequest.This may cause ConcurrentModificationException,because
LinkedHashSet is not thread-safe.
> There is potential risk of ConcurrentModificationException when scheduling
> task for container
> ---------------------------------------------------------------------------------------------
>
> Key: TEZ-4315
> URL: https://issues.apache.org/jira/browse/TEZ-4315
> Project: Apache Tez
> Issue Type: Improvement
> Affects Versions: 0.9.1, 0.10.0
> Reporter: junbiao chen
> Priority: Major
>
> When assigning task to container,YarnTaskSchedulerService need to traverse
> pending cookieContainerRequests(stored in LinkedHashSet) to select one that
> mathing the container by calling method getMatchingRequestWithoutPriority. In
> the meantime, YarnTaskSchedulerService will also remove the completed
> cookieContainerRequest from LinkedHashSet by calling method
> removeTaskRequest.This may cause ConcurrentModificationException,because
> LinkedHashSet is not thread-safe.
>
> [https://github.com/apache/tez/pull/133]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
