[
https://issues.apache.org/jira/browse/MAPREDUCE-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sunil Govindan updated MAPREDUCE-6857:
--------------------------------------
Target Version/s: 3.3.0 (was: 3.2.0)
Bulk update: moved all 3.2.0 non-blocker issues, please move back if it is a
blocker.
> Reduce number of exists() calls on the target object
> ----------------------------------------------------
>
> Key: MAPREDUCE-6857
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6857
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: distcp
> Affects Versions: 3.0.0-alpha2
> Reporter: Gil Vernik
> Priority: Major
> Attachments: HADOOP-6857-002.patch
>
>
> CopyMapper.map(..) calls targetStatus = targetFS.getFileStatus(target).
> Few steps later RetriableFileCopyCommand.promoteTmpToTarget(..) will call
> again exists(target) and delete if present.
> The second exists() is useless, since if targetStatus==null it can be easily
> seen if overwrite mode is activated and so target object can be deleted.
> The propose of this patch is to delete target object by using targetStatus
> and thus avoid calling exists() method.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]