[
https://issues.apache.org/jira/browse/HADOOP-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13207:
------------------------------------
Attachment: HADOOP-13207-branch-2-002.patch
Patch 002. The tests are added.
Add the list status/list located and listFiles tests.
It also tests the filtering operations, including that for the `protected
listLocatedStatus(Path, PathFilter)` method. We could point at that and say
"protected, not API, not needed", but the FilterFS delegates to it; in my tests
I subclass that to expose it. So it can be uprated to being public, and given
that FilterFS is in production code, we have to conclude its in use.
Indeed: it may actually be something to make public, though that's not a
concern here.
Testing: localfs, HDFS, s3a, azure. The object stores are slow to setup and
teardown the complex directory tree scanning, so I had to merge all the checks
there into one uber-test-case. Not ideal, as the first failure will hide the
others, but as the tests all currently work, bearable.
Note that this does appear to be the first addition of all the filtered list*
calls to all FS contract tests. There's some calls made in
{{TestFileInputFormat}} and elsewhere, but they're testing the splitting code,
not whether the FS implementations generate the right data for the splitters.
> Specify FileSystem listStatus and listFiles
> -------------------------------------------
>
> Key: HADOOP-13207
> URL: https://issues.apache.org/jira/browse/HADOOP-13207
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation, fs
> Affects Versions: 2.8.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Attachments: HADOOP-13207-branch-2-001.patch,
> HADOOP-13207-branch-2-002.patch
>
>
> The many `listStatus`, `listLocatedStatus` and `listFiles` operations have
> not been completely covered in the FS specification. There's lots of implicit
> use of {{listStatus()}} path, but no coverage or tests of the others.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
