[ 
https://issues.apache.org/jira/browse/HDFS-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei (Eddy) Xu updated HDFS-7705:
--------------------------------
    Summary: FileSystem should expose some performance characteristics for 
caller (e.g., FsShell) to choose the right algorithm.  (was: {{FileSystem}} 
should expose some performance characteristics for caller (e.g., FsShell) to 
choose right algorithm.)

> FileSystem should expose some performance characteristics for caller (e.g., 
> FsShell) to choose the right algorithm.
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-7705
>                 URL: https://issues.apache.org/jira/browse/HDFS-7705
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: tools
>    Affects Versions: 2.6.0
>            Reporter: Lei (Eddy) Xu
>
> When running {{hadoop fs -put}},  {{FsShell}} creates a {{._COPYING_.}} file 
> on the target directory, and then renames it to target file when the write is 
> done. However, for some targeted systems, such as S3, Azure and Swift, a 
> partial failure write request (i.e., {{PUT}}) has not side effect, while the 
> {{rename}} operation is expensive. 
> {{FileSystem}} should expose some characteristics so that the operation such 
> as {{CommandWithDestination#copyStreamToTarget()}} can detect and choose the 
> right way to do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to