[
https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16075157#comment-16075157
]
Virajith Jalaparti edited comment on HDFS-9806 at 7/5/17 6:07 PM:
------------------------------------------------------------------
An updated design document is attached. This JIRA will be limited to a
read-only implementation for {{PROVIDED}} storage, i.e., using HDFS to read
files/data in remote stores assuming that the data on the remote store does not
change. The work on the write-path will be tracked as part of HDFS-12090 (the
design document for this has been posted to HDFS-12090).
was (Author: virajith):
An updated design document is attached. This JIRA will be limited to a
read-only implementation for {{PROVIDED}} storage, i.e., using HDFS to read
files/data in remote stores assuming that the data on the remote store does not
change. The work on the write-path will be tracked as part of HDFS-12090.
> Allow HDFS block replicas to be provided by an external storage system
> ----------------------------------------------------------------------
>
> Key: HDFS-9806
> URL: https://issues.apache.org/jira/browse/HDFS-9806
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Chris Douglas
> Attachments: HDFS-9806-design.001.pdf, HDFS-9806-design.002.pdf
>
>
> In addition to heterogeneous media, many applications work with heterogeneous
> storage systems. The guarantees and semantics provided by these systems are
> often similar, but not identical to those of
> [HDFS|https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/index.html].
> Any client accessing multiple storage systems is responsible for reasoning
> about each system independently, and must propagate/and renew credentials for
> each store.
> Remote stores could be mounted under HDFS. Block locations could be mapped to
> immutable file regions, opaque IDs, or other tokens that represent a
> consistent view of the data. While correctness for arbitrary operations
> requires careful coordination between stores, in practice we can provide
> workable semantics with weaker guarantees.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
