[
https://issues.apache.org/jira/browse/HADOOP-13651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622969#comment-15622969
]
Lei (Eddy) Xu commented on HADOOP-13651:
----------------------------------------
To make the test deterministic, I was thinking that we should populate the
metadata store and a *testing* file system separately (i.e., files are in
metadata store , but are not in the testing file system, to simulate list after
create). And similarly for the listing after delete scenarios.
Regarding the prove of algorithms, I found that, it is easy to prove that
metadata store can detect the inconsistency between itself and s3, it was hard
to me to prove that what is the actual cause of the inconsistency between
metadata store and S3, within the context of S3AFileSystem.
> S3Guard: S3AFileSystem Integration with MetadataStore
> -----------------------------------------------------
>
> Key: HADOOP-13651
> URL: https://issues.apache.org/jira/browse/HADOOP-13651
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Aaron Fabbri
> Assignee: Aaron Fabbri
> Attachments: HADOOP-13651-HADOOP-13345.001.patch,
> HADOOP-13651-HADOOP-13345.002.patch, HADOOP-13651-HADOOP-13345.003.patch
>
>
> Modify S3AFileSystem et al. to optionally use a MetadataStore for metadata
> consistency and caching.
> Implementation should have minimal overhead when no MetadataStore is
> configured.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
