[
https://issues.apache.org/jira/browse/HADOOP-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780013#comment-16780013
]
wujinhu commented on HADOOP-15038:
----------------------------------
Sure. [~uncleGen]
First, I add *hadoop-cloud-core* module according to the discussion above.
Then, I move below classes from *s3guard* to *hadoop-cloud-core*
{code:java}
//sources
{code}
*DescendantsIterator.java
DirListingMetadata.java
ExpirableMetadata.java
LocalMetadataEntry.java
LocalMetadataStore.java
MetadataStore.java
MetadataStoreCapabilities.java
MetadataStoreListFilesIterator.java
NullMetadataStore.java
PathMetadata.java
Tristate.java*
{code:java}
//tests
{code}
*AbstractMSContract.java
MetadataStoreTestBase.java
TestDirListingMetadata.java
TestLocalMetadataStore.java
TestNullMetadataStore.java*
Besides, I also move some utility constants and methods from *s3guard* to
{code:java}
Constants.java
MetadataUtils.java
MetadataTestUtils.java
{code}
So，I almost do not change existing logic.:)
> Abstract MetadataStore in S3Guard into a common module.
> -------------------------------------------------------
>
> Key: HADOOP-15038
> URL: https://issues.apache.org/jira/browse/HADOOP-15038
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 3.2.0, 2.9.2, 3.0.3, 3.1.2
> Reporter: Genmao Yu
> Assignee: wujinhu
> Priority: Major
> Attachments: HADOOP-15038.001.patch
>
>
> Open this JIRA to discuss if we should move {{MetadataStore}} in {{S3Guard}}
> into a common module.
> Based on this work, other filesystem or object store can implement their own
> metastore for optimization (known issues like consistency problem and
> metadata operation performance). [[email protected]] and other guys have
> done many base and great works in {{S3Guard}}. It is very helpful to start
> work. I did some perf test in HADOOP-14098, and started related work for
> Aliyun OSS. Indeed there are still works to do for {{S3Guard}}, like
> metadata cache inconsistent with S3 and so on. It also will be a problem for
> other object store. However, we can do these works in parallel.
> [[email protected]] [~fabbri] [~drankye] Any suggestion is appreciated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
