[jira] [Commented] (YARN-2623) Linux container executor only use the first local directory to copy token file in container-executor.c.

[zhihai xu (JIRA)]

[ 
https://issues.apache.org/jira/browse/YARN-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153709#comment-14153709
 ] 

zhihai xu commented on YARN-2623:
-

Thanks for the information. I think the better way to solve the issue is to 
choose the local directory which has the most free disk space.
I will implement the patch by copying the token file to the local directory 
which has the most free disk space.

> Linux container executor only use the first local directory to copy token 
> file in container-executor.c.
> ---
>
> Key: YARN-2623
> URL: https://issues.apache.org/jira/browse/YARN-2623
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.5.0
> Environment: Linux container executor only use the first local 
> directory to copy token file in container-executor.c.
>Reporter: zhihai xu
>Assignee: zhihai xu
>
> Linux container executor only use the first local directory to copy token 
> file in container-executor.c. if It failed to copy token file to the first 
> local directory, the  localization failure event will happen. Even though it 
> can copy token file to the other local directory successfully. The correct 
> way should be to copy token file  to the next local directory  if the first 
> one failed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YARN-2623) Linux container executor only use the first local directory to copy token file in container-executor.c.

[Remus Rusanu (JIRA)]

[ 
https://issues.apache.org/jira/browse/YARN-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153023#comment-14153023
 ] 

Remus Rusanu commented on YARN-2623:


Note that DCE also picks first local dir, DefaultContainerExecutor.java@99:

{code}
// TODO: Why pick first app dir. The same in LCE why not random?
Path appStorageDir = getFirstApplicationDir(localDirs, user, appId);
{code}

> Linux container executor only use the first local directory to copy token 
> file in container-executor.c.
> ---
>
> Key: YARN-2623
> URL: https://issues.apache.org/jira/browse/YARN-2623
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.5.0
> Environment: Linux container executor only use the first local 
> directory to copy token file in container-executor.c.
>Reporter: zhihai xu
>Assignee: zhihai xu
>
> Linux container executor only use the first local directory to copy token 
> file in container-executor.c. if It failed to copy token file to the first 
> local directory, the  localization failure event will happen. Even though it 
> can copy token file to the other local directory successfully. The correct 
> way should be to copy token file  to the next local directory  if the first 
> one failed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)