[
https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801904#comment-13801904
]
Jonathan Eagles commented on YARN-1183:
---------------------------------------
Also, could you comment on the initial thread concurrency from default of 16 to
2. This is mainly for me to understand it better. I'm assuming you
intentionally choose a low thread concurrency to reduce overhead for sequential
test running and let the thread concurrency scale up as needed during parallel
execution.
> MiniYARNCluster shutdown takes several minutes intermittently
> -------------------------------------------------------------
>
> Key: YARN-1183
> URL: https://issues.apache.org/jira/browse/YARN-1183
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Andrey Klochkov
> Assignee: Andrey Klochkov
> Attachments: YARN-1183--n2.patch, YARN-1183--n3.patch,
> YARN-1183--n4.patch, YARN-1183.patch
>
>
> As described in MAPREDUCE-5501 sometimes M/R tests leave MRAppMaster java
> processes living for several minutes after successful completion of the
> corresponding test. There is a concurrency issue in MiniYARNCluster shutdown
> logic which leads to this. Sometimes RM stops before an app master sends it's
> last report, and then the app master keeps retrying for >6 minutes. In some
> cases it leads to failures in subsequent tests, and it affects performance of
> tests as app masters eat resources.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
