[
https://issues.apache.org/jira/browse/HADOOP-13926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15899684#comment-15899684
]
Steve Loughran commented on HADOOP-13926:
-----------------------------------------
Looking at this some more, I'm happy with the limited-scalability list-to-array
code going into the initial preview release, HADOOP-13998.
I would like it if we can keep the code in S3AFileSystem under control,
especially given that multiple operations will want to get at roughly the same
data. I'd prefer for it to go into S3Guard.
There's also that little "TODO" about auth vs non-auth. That needs to be
resolved because it's quite a serious issue if there is a disconnect.
Presumably: non-auth goes to the filesystem; only auth can list on the DDB.
> S3Guard: Improve listLocatedStatus and listFiles
> ------------------------------------------------
>
> Key: HADOOP-13926
> URL: https://issues.apache.org/jira/browse/HADOOP-13926
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Rajesh Balamohan
> Assignee: Steve Loughran
> Priority: Minor
> Attachments: HADOOP-13926.wip.proto.branch-13345.1.patch
>
>
> Need to check if {{listLocatedStatus}} can make use of metastore's
> listChildren feature.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
