[ 
https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170457#comment-14170457
 ] 

Chen He commented on TEZ-1542:
------------------------------

Thank you for the review, [~sseth]. We met this problem when we run two 
DAGAppMasters (Concurrent testing two tez jobs that both running in local mode) 
in a single JVM. This patch can fix the problem when there are concurrent  
EnvironmentUpdateUtils.put() calls. 

> Local Mode crashes on concurrentModificationException
> -----------------------------------------------------
>
>                 Key: TEZ-1542
>                 URL: https://issues.apache.org/jira/browse/TEZ-1542
>             Project: Apache Tez
>          Issue Type: Sub-task
>    Affects Versions: 0.5.0
>            Reporter: Chen He
>            Assignee: Chen He
>         Attachments: TEZ-1542-2.patch, TEZ-1542-3.patch, TEZ-1542-4.patch, 
> TEZ-1542.patch
>
>
> java.util.ConcurrentModificationException
>         at java.util.HashMap$HashIterator.nextEntry(HashMap.java:894)
>         at java.util.HashMap$EntryIterator.next(HashMap.java:934)
>         at java.util.HashMap$EntryIterator.next(HashMap.java:932)
>         at
> java.lang.ProcessEnvironment$StringEntrySet$1.next(ProcessEnvironment.java:332)
>         at
> java.lang.ProcessEnvironment$StringEntrySet$1.next(ProcessEnvironment.java:328)
>         at
> java.util.Collections$UnmodifiableMap$UnmodifiableEntrySet$1.next(Collections.java:1403)
>         at
> java.util.Collections$UnmodifiableMap$UnmodifiableEntrySet$1.next(Collections.java:1396)
>         at java.util.HashMap.putAllForCreate(HashMap.java:533)
>         at java.util.HashMap.<init>(HashMap.java:320)
>         at
> org.apache.tez.dag.utils.EnvironmentUpdateUtils.put(EnvironmentUpdateUtils.java:42)
>         at
> org.apache.tez.dag.app.launcher.LocalContainerLauncher.<init>(LocalContainerLauncher.java:112)
>         at
> org.apache.tez.dag.app.DAGAppMaster.createContainerLauncher(DAGAppMaster.java:819)
>         at
> org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:379)
>         at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at org.apache.tez.dag.app.DAGAppMaster$5.run(DAGAppMaster.java:1904)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1637)
>         at
> org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:1901)
>         at org.apache.tez.client.LocalClient$1.run(LocalClient.java:294)
>         at java.lang.Thread.run(Thread.java:722)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to