[ https://issues.apache.org/jira/browse/MAPREDUCE-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shilun Fan updated MAPREDUCE-6857: ---------------------------------- Target Version/s: 3.5.0 (was: 3.4.0) > Reduce number of exists() calls on the target object > ---------------------------------------------------- > > Key: MAPREDUCE-6857 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6857 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: distcp > Affects Versions: 3.0.0-alpha2 > Reporter: Gil Vernik > Priority: Major > Attachments: HADOOP-6857-002.patch > > > CopyMapper.map(..) calls targetStatus = targetFS.getFileStatus(target). > Few steps later RetriableFileCopyCommand.promoteTmpToTarget(..) will call > again exists(target) and delete if present. > The second exists() is useless, since if targetStatus==null it can be easily > seen if overwrite mode is activated and so target object can be deleted. > The propose of this patch is to delete target object by using targetStatus > and thus avoid calling exists() method. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org