[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yuan LUO updated MAPREDUCE-7227:
--------------------------------
    Description: 
Our yarn cluster is made up of some independent hdfs cluster, the 'default.FS' 
in every hdfs cluster is different.when user submit job to yarn cluster,if the 
'default.FS'  between client and nodemanager  is inconsistent,then the job 
staging dir can't be cleanup by AppMaster. Because it will produce two job 
staging dir in our conditions by client and appmaster. So we can modify 
AppMaster  through  client's ‘default.FS’ to create job staging dir.


  was:Our yarn cluster is made up of some independent hdfs cluster, the 
'default.FS' in every hdfs cluster is different.when user submit job to yarn 
cluster,if the 'default.FS'  between client and nodemanager  is 
inconsistent,then the job-staging dir  can't be cleanup by AppMaster.Because it 
will produce two job-staging dir in our conditions by client and appmaster.


> Repair job staging directory residual problem in a big yarn cluster composed 
> of multiple independent hdfs clusters
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-7227
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7227
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: applicationmaster, mrv2
>    Affects Versions: 2.6.0, 2.7.0, 3.1.2
>            Reporter: Yuan LUO
>            Priority: Major
>         Attachments: HADOOP-MAPREDUCE-7227.001.patch
>
>
> Our yarn cluster is made up of some independent hdfs cluster, the 
> 'default.FS' in every hdfs cluster is different.when user submit job to yarn 
> cluster,if the 'default.FS'  between client and nodemanager  is 
> inconsistent,then the job staging dir can't be cleanup by AppMaster. Because 
> it will produce two job staging dir in our conditions by client and 
> appmaster. So we can modify AppMaster  through  client's ‘default.FS’ to 
> create job staging dir.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

Reply via email to