[
https://issues.apache.org/jira/browse/HADOOP-17281?focusedWorklogId=495417&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-495417
]
ASF GitHub Bot logged work on HADOOP-17281:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 05/Oct/20 16:11
Start Date: 05/Oct/20 16:11
Worklog Time Spent: 10m
Work Description: steveloughran commented on pull request #2354:
URL: https://github.com/apache/hadoop/pull/2354#issuecomment-703732717
_stevel_ and that if a path isn't there, that fact may not surface until
next/hasNext...that is, we do lazy eval for all file IO
_mukund_ Actually this is not correct, we do throw FNFE if a path is not
there, remember we have a check if the listing returns zeror results assuming
the path as a directory, we fall back to file checks.
I'd like the document to leave the option open of a fully async initial
listing operation. so the people coding against it *now* are lined up for
future filesystems that do that. Same for any other APIs we add, "late
reporting of existence of paths/permissions" is something callers MUST expect
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 495417)
Time Spent: 50m (was: 40m)
> Implement FileSystem.listStatusIterator() in S3AFileSystem
> ----------------------------------------------------------
>
> Key: HADOOP-17281
> URL: https://issues.apache.org/jira/browse/HADOOP-17281
> Project: Hadoop Common
> Issue Type: Task
> Components: fs/s3
> Affects Versions: 3.3.0
> Reporter: Mukund Thakur
> Assignee: Mukund Thakur
> Priority: Major
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Currently S3AFileSystem only implements listStatus() api which returns an
> array. Once we implement the listStatusIterator(), clients can benefit from
> the async listing done recently
> https://issues.apache.org/jira/browse/HADOOP-17074 by performing some tasks
> on files while iterating them.
>
> CC [~stevel]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
