[
https://issues.apache.org/jira/browse/HADOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-3025:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this. Thanks Mahadev!
> ChecksumFileSystem needs to support the new delete method
> ---------------------------------------------------------
>
> Key: HADOOP-3025
> URL: https://issues.apache.org/jira/browse/HADOOP-3025
> Project: Hadoop Core
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.17.0
> Reporter: Devaraj Das
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: HADOOP_3025_1.patch, HADOOP_3025_2.patch,
> HADOOP_3025_3.patch, HADOOP_3025_4.patch
>
>
> The method FileSystem.delete(path) has been deprecated in favor of the new
> method delete(path, recursive). Temporary files gets created in the MapReduce
> framework and when the time for deletion comes, they are deleted via
> delete(path, recursive). This doesn't delete the associated checksum files.
> This has a big impact when the FileSystem is the InMemoryFileSystem, where
> space is at a premium and wasting space here might hurt the performance of
> MapReduce jobs overall. One solution to this problem is to implement the
> method delete(path, recursive) in the ChecksumFileSystem but is there is a
> reason why it was left out as part of HADOOP-771?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
