[
https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lei (Eddy) Xu updated HADOOP-13650:
-----------------------------------
Attachment: HADOOP-13650-HADOOP-13345.001.patch
Hi, [~ste...@apache.org].
Updated the patch to address the most of the comments.
Regarding:
bq. Isn't the S3aFS going to create/init its store? So no need to do that again
in this class, just ask for the (inited) one in S3AFS.
My thoughts were that, for commands like {{import}} and {{diff}}, it is better
to avoid the filesystem holding a metadata store. It prevents that the file
systems returning {{FileStatus}} from the metadata store during {{import}} or
{{diff}} process.
For {{initializeS3A()}}, it might be removed from the final patch. It needs to
talk with [~liuml07] and [~fabbri] for a consensus of the interfaces used
between Metadata Store and S3AFileSystem.
bq. this patch could go in as an interim measure, with a separate JIRA "migrate
to s3cmd" being another subtask, one dependent on s3cmd existing.
That works for me.
Thanks.
> S3Guard: Provide command line tools to manipulate metadata store.
> -----------------------------------------------------------------
>
> Key: HADOOP-13650
> URL: https://issues.apache.org/jira/browse/HADOOP-13650
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Lei (Eddy) Xu
> Assignee: Lei (Eddy) Xu
> Attachments: HADOOP-13650-HADOOP-13345.000.patch,
> HADOOP-13650-HADOOP-13345.001.patch
>
>
> Similar systems like EMRFS has the CLI tools to manipulate the metadata
> store, i.e., create or delete metadata store, or {{import}}, {{sync}} the
> file metadata between metadata store and S3.
> http://docs.aws.amazon.com//ElasticMapReduce/latest/ReleaseGuide/emrfs-cli-reference.html
> S3Guard should offer similar functionality.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
