[
https://issues.apache.org/jira/browse/HADOOP-13651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Fabbri updated HADOOP-13651:
----------------------------------
Attachment: HADOOP-13651-HADOOP-13345.002.patch
Attaching v2 patch. We should consider merging this soon as it makes a lot of
changes in the MetadataStore test code around the new requirement for
fully-qualified paths.
Implements keeping {{S3AFileStatus#isEmptyDirectory()}} updated. Also hardens
treatment of Path objects, so we are consistently dealing with fully qualified
paths.
All unit and integration tests pass as is.
If you enable LocalMetadataStore with authoritative = true (See commented-out
core-site.xml changes in patch), all tests pass except I see occasional
failures in {{
ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRecursiveRootListing}}.
I'm still working on that one.
If you enable LocalMetadataStore with authoritative = false, almost all tests
are passing as well, but I think I need to fix a FS statistics delta test that
is off-by-one still.
> S3Guard: S3AFileSystem Integration with MetadataStore
> -----------------------------------------------------
>
> Key: HADOOP-13651
> URL: https://issues.apache.org/jira/browse/HADOOP-13651
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Aaron Fabbri
> Assignee: Aaron Fabbri
> Attachments: HADOOP-13651-HADOOP-13345.001.patch,
> HADOOP-13651-HADOOP-13345.002.patch
>
>
> Modify S3AFileSystem et al. to optionally use a MetadataStore for metadata
> consistency and caching.
> Implementation should have minimal overhead when no MetadataStore is
> configured.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
