[
https://issues.apache.org/jira/browse/TEZ-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
junbiao chen updated TEZ-4315:
------------------------------
Description:
When assigning task to container,YarnTaskSchedulerService need to traverse
pending cookieContainerRequests(stored in LinkedHashSet) to select one that
mathing the container by calling method getMatchingRequestWithoutPriority. In
the meantime, YarnTaskSchedulerService will also remove the completed
cookieContainerRequest from LinkedHashSet by calling method
removeTaskRequest
.This may cause ConcurrentModificationException,because LinkedHashSet is not
thread-safe.
was:When assigning task to container,YarnTaskSchedulerService need to
traverse pending cookieContainerRequests(stored in LinkedHashSet) to select
one that mathing the container. In the meantime, YarnTaskSchedulerService will
also remove the completed cookieContainerRequest from LinkedHashSet.This may
cause ConcurrentModificationException,because LinkedHashSet is not thread-safe.
> There is potential risk of ConcurrentModificationException when scheduling
> task for container
> ---------------------------------------------------------------------------------------------
>
> Key: TEZ-4315
> URL: https://issues.apache.org/jira/browse/TEZ-4315
> Project: Apache Tez
> Issue Type: Improvement
> Affects Versions: 0.9.1, 0.10.0
> Reporter: junbiao chen
> Priority: Major
>
> When assigning task to container,YarnTaskSchedulerService need to traverse
> pending cookieContainerRequests(stored in LinkedHashSet) to select one that
> mathing the container by calling method getMatchingRequestWithoutPriority. In
> the meantime, YarnTaskSchedulerService will also remove the completed
> cookieContainerRequest from LinkedHashSet by calling method
> removeTaskRequest
> .This may cause ConcurrentModificationException,because LinkedHashSet is not
> thread-safe.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
