[
https://issues.apache.org/jira/browse/HDFS-14805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16923770#comment-16923770
]
Ashvin commented on HDFS-14805:
-------------------------------
Hi [~ehiggs],
Thanks for reviewing the design doc.
As of now there is no dependency on HDFS-12478. For most part the two proposed
commands are similar and this produces an opportunity to collaborate and reuse.
At the very least avoid conflicting contributions.
{noformat}
HDFS-14805:: hdfs dfsadmin -addMount <remoteURI> <mountPath> [<config>]
HDFS-12478:: hdfs syncservice -create [-name <name>] -backupOnly <local HDFS
Path> <externalBackupPath>
{noformat}
Some points to discuss:
# Should the "noun" be top level or under {{dfsadmin}}? given both the
operations are admin only operations, I think a subcommand under {{dfsadmin}}
fits well?
# I see you replaced {{attach}} with {{syncservice}}, how does mount sound to
you?
# I like the data movement "directionality" hint in the command you proposed.
Please let us know if you have any suggestions.
> Mounting external stores in HDFS on-the-fly
> -------------------------------------------
>
> Key: HDFS-14805
> URL: https://issues.apache.org/jira/browse/HDFS-14805
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Virajith Jalaparti
> Priority: Major
> Attachments: dynamic-mounts-in-hdfs.pdf
>
>
> Provided storage (HDFS-9806) allows HDFS to address data in external storage
> systems, including cloud stores. Data mounted in this manner, seamlessly,
> appears to be part of HDFS for applications/clients. The external data can
> also be cached by HDFS on local disks and SSDs, accelerating remote data
> reads (HDFS-13069).
> However, Provided storage was originally targeted at ephemeral HDFS
> deployments in the cloud (e.g., Azure HDInsight). Long running HDFS clusters
> are common in many other scenarios which can benefit from accessing data in
> remote stores. This JIRA targets such scenarios and aims to provide the
> ability to:
> (a) Dynamically mount external stores in a HDFS cluster while supporting high
> availability.
> (b) Mount multiple remote stores simultaneously.
> (c) Reduce deployment overheads and simplify usability of Provided storage.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
