[
https://issues.apache.org/jira/browse/HADOOP-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235958#comment-17235958
]
Mukund Thakur commented on HADOOP-17323:
----------------------------------------
HEAD requests are already skipped currently because key is empty in case of
getFileStatus("/").
[https://github.com/apache/hadoop/blob/8fa699b53fea8728e008c46af949f92543c08170/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java#L3147]
> s3a getFileStatus("/") to skip IO
> ---------------------------------
>
> Key: HADOOP-17323
> URL: https://issues.apache.org/jira/browse/HADOOP-17323
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Assignee: Mukund Thakur
> Priority: Minor
>
> Calls to "hadoop fs ls s3a://something/" add a full getFileStatus() sequence
> (HEAD, LIST, LIST) because FsShell Ls calls getFileStatus on every input.
> We should just build a root status entry immediately. There's one
> consequence: if a user has disabled the s3a existence probe, there will be no
> checks for the bucket existence. But that can be viewed as a "well, that's
> what happens" behaviour
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
