[
https://issues.apache.org/jira/browse/HADOOP-13926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HADOOP-13926:
-----------------------------------
Attachment: HADOOP-13926-HADOOP-13345.001.patch
I rebase and updated [~rajesh.balamohan]'s wip patch. Let's get this initial
patch in, and hopefully it will unblock [HADOOP-13998] initial preview, and
thus merging back to trunk. As future work (part of [HADOOP-14000]), we have to
revise this in two ways: 1) use paging for listing children from metadata store
2) for non-auth, union the results from S3 and metadata store, and populates to
metadata store.
Tested against us-west-1 region:
{code}
$ mvn -Dit.test='ITestS3A*,ITestS3Guard*,ITestDynamo*' -Dtest=none -Dscale
-Ds3guard -Ddynamo -q clean verify
Results :
Tests run: 357, Failures: 0, Errors: 0, Skipped: 16
{code}
> S3Guard: Improve listLocatedStatus and listFiles
> ------------------------------------------------
>
> Key: HADOOP-13926
> URL: https://issues.apache.org/jira/browse/HADOOP-13926
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Rajesh Balamohan
> Assignee: Steve Loughran
> Attachments: HADOOP-13926-HADOOP-13345.001.patch,
> HADOOP-13926.wip.proto.branch-13345.1.patch
>
>
> Need to check if {{listLocatedStatus}} can make use of metastore's
> listChildren feature.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]