[
https://issues.apache.org/jira/browse/HDFS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15765403#comment-15765403
]
chendong commented on HDFS-291:
-------------------------------
CopyToLocal is useful for us. We use this as a backup of whole HDFS data.
We only have 500G HDFS data. That is not big data.
We don't have much budget to create another cluster for backup purpose.
So we backup the whole HDFS data into local file system.
This is a use case which seems not a typical big data scenario. However, as far
as I know, a lot of business start from small data with the requirement for the
disaster recovery.
> combine FsShell.copyToLocal to ChecksumFileSystem.copyToLocalFile
> -----------------------------------------------------------------
>
> Key: HDFS-291
> URL: https://issues.apache.org/jira/browse/HDFS-291
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Tsz Wo Nicholas Sze
> Priority: Minor
>
> - Two methods provide similar functions
> - ChecksumFileSystem.copyToLocalFile(Path src, Path dst, boolean copyCrc) is
> no longer used anywhere in the system
> - It is better to use ChecksumFileSystem.getRawFileSystem() for copying crc
> in FsShell.copyToLocal
> - FileSystem.isDirectory(Path) used in FsShell.copyToLocal is deprecated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
