[
https://issues.apache.org/jira/browse/MAPREDUCE-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gil Vernik updated MAPREDUCE-6857:
----------------------------------
Attachment: HADOOP-6857-002.patch
> Reduce number of exists() calls on the target object
> ----------------------------------------------------
>
> Key: MAPREDUCE-6857
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6857
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: distcp
> Affects Versions: 3.0.0-alpha2
> Reporter: Gil Vernik
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-6857-002.patch
>
>
> CopyMapper.map(..) calls targetStatus = targetFS.getFileStatus(target).
> Few steps later RetriableFileCopyCommand.promoteTmpToTarget(..) will call
> again exists(target) and delete if present.
> The second exists() is useless, since if targetStatus==null it can be easily
> seen if overwrite mode is activated and so target object can be deleted.
> The propose of this patch is to delete target object by using targetStatus
> and thus avoid calling exists() method.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
