[
https://issues.apache.org/jira/browse/HADOOP-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated HADOOP-15120:
------------------------------
Description:
AzureNativeFileSystemStore's rename calls
[waitForCopyToComplete|https://github.com/apache/hadoop/blob/d69b7358b65128197b4c0fe5ef3c02f3d59864b3/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/AzureNativeFileSystemStore.java#L2742].
If the copy executed inside waitForCopyToComplete cannot finish quickly,
waitForCopyToComplete will wait for at least 1 second to check the status
again. This behavior can introduce a significant overhead if the actual data
operation finishes pretty fast.
> Reduce the overhead of AzureNativeFileSystemStore's rename
> ----------------------------------------------------------
>
> Key: HADOOP-15120
> URL: https://issues.apache.org/jira/browse/HADOOP-15120
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/azure
> Reporter: Yin Huai
>
> AzureNativeFileSystemStore's rename calls
> [waitForCopyToComplete|https://github.com/apache/hadoop/blob/d69b7358b65128197b4c0fe5ef3c02f3d59864b3/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/AzureNativeFileSystemStore.java#L2742].
> If the copy executed inside waitForCopyToComplete cannot finish quickly,
> waitForCopyToComplete will wait for at least 1 second to check the status
> again. This behavior can introduce a significant overhead if the actual data
> operation finishes pretty fast.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
