[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105125#comment-13105125
 ] 

Eli Collins commented on MAPREDUCE-2928:
----------------------------------------

Owen, Ravi - thank you for the feedback.

Will re-introduce getGoodLocalDirsString.

Wrt #1 are we worried about this case? It doesn't seem like something that 
would happen in practice as disk failures aren't typically recoverable, and per 
MAPREDUCE-3011 I'm thinking once a local path is identified as bad we should 
remove it from the config. In the DN we maintain a count of total failures, how 
about we do that here and use it instead of the # of valid dirs? This value 
always increases and is therefore not susceptible to the bug you described.
 
Wrt #2 - good point, will fix this.

> MR-2413 improvements
> --------------------
>
>                 Key: MAPREDUCE-2928
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2928
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: tasktracker
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>             Fix For: 0.20.205.0
>
>         Attachments: mapreduce-2928-1.patch
>
>
> Tracks improvements to MR-2413. See [this 
> comment|https://issues.apache.org/jira/browse/MAPREDUCE-2413?focusedCommentId=13095073&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13095073].

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to