[
https://issues.apache.org/jira/browse/HADOOP-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15959221#comment-15959221
]
Sean Mackrory commented on HADOOP-14172:
----------------------------------------
Pinging [~fabbri] or [~liuml07] for a review. This still applies cleanly and
I'd like to get it wrapped up.
> S3Guard: import does not import empty directory
> -----------------------------------------------
>
> Key: HADOOP-14172
> URL: https://issues.apache.org/jira/browse/HADOOP-14172
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Sean Mackrory
> Assignee: Sean Mackrory
> Attachments: HADOOP-14172-HADOOP-13345.001.patch
>
>
> It imports everything comes up from listFiles, which includes only files (and
> their parent directories as a side-effect). My first thought on doing this
> would be to override S3AFileSystem to add an optional parameter to use
> AcceptAllButSelfAndS3nDirs instead of AcceptFilesOnly. But we could also
> manually traverse the tree to get all FileStatus objects directory by
> directory like we do for diff. That's far slower but doesn't add surface area
> to S3AFileSystem. But there's also the impact to other S3 clients to worry
> about - I could go either way on that.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
