[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603903#comment-13603903
 ] 

Chris Nauroth commented on MAPREDUCE-5075:
------------------------------------------

I discovered this while testing on Windows, where file locking is enforced more 
strictly.  The DistCp tests would fail sporadically due to not being able to 
delete the temp files.  I have a patch in progress.
                
> DistCp leaks input file handles
> -------------------------------
>
>                 Key: MAPREDUCE-5075
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5075
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: distcp
>    Affects Versions: 3.0.0
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>
> DistCp wraps the {{InputStream}} for each input file it reads in an instance 
> of {{ThrottledInputStream}}.  This class does not close the wrapped 
> {{InputStream}}.  {{RetriableFileCopyCommand}} guarantees that the 
> {{ThrottledInputStream}} gets closed, but without closing the underlying 
> wrapped stream, it still leaks a file handle.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to