[jira] [Commented] (YARN-2623) Linux container executor only use the first local directory to copy token file in container-executor.c.
[
https://issues.apache.org/jira/browse/YARN-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153023#comment-14153023
]
Remus Rusanu commented on YARN-2623:
Note that DCE also picks first local dir, DefaultContainerExecutor.java@99:
{code}
// TODO: Why pick first app dir. The same in LCE why not random?
Path appStorageDir = getFirstApplicationDir(localDirs, user, appId);
{code}
Linux container executor only use the first local directory to copy token
file in container-executor.c.
---
Key: YARN-2623
URL: https://issues.apache.org/jira/browse/YARN-2623
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Affects Versions: 2.5.0
Environment: Linux container executor only use the first local
directory to copy token file in container-executor.c.
Reporter: zhihai xu
Assignee: zhihai xu
Linux container executor only use the first local directory to copy token
file in container-executor.c. if It failed to copy token file to the first
local directory, the localization failure event will happen. Even though it
can copy token file to the other local directory successfully. The correct
way should be to copy token file to the next local directory if the first
one failed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2623) Linux container executor only use the first local directory to copy token file in container-executor.c.
[ https://issues.apache.org/jira/browse/YARN-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153709#comment-14153709 ] zhihai xu commented on YARN-2623: - Thanks for the information. I think the better way to solve the issue is to choose the local directory which has the most free disk space. I will implement the patch by copying the token file to the local directory which has the most free disk space. Linux container executor only use the first local directory to copy token file in container-executor.c. --- Key: YARN-2623 URL: https://issues.apache.org/jira/browse/YARN-2623 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 2.5.0 Environment: Linux container executor only use the first local directory to copy token file in container-executor.c. Reporter: zhihai xu Assignee: zhihai xu Linux container executor only use the first local directory to copy token file in container-executor.c. if It failed to copy token file to the first local directory, the localization failure event will happen. Even though it can copy token file to the other local directory successfully. The correct way should be to copy token file to the next local directory if the first one failed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
