: FileSystem contract of listStatus
To: common-dev@hadoop.apache.org
On Thu, Nov 3, 2011 at 4:27 AM, Uma Maheswara Rao G 72686
mahesw...@huawei.com wrote:
Yes, i remember this issue filed by Harsh recently.
GlobStatus will sort the results and return. May be we can fix for
listStatus
I have a question about the FileSystem contract in 0.20.
In FileSystemContractBaseBaseTest:testFileStatus() there
are several files created, and afterwards the test confirms
that they are present. Here is the relevant code:
FileStatus[] paths = fs.listStatus(path(/test));
paths =
Hey Noah,
HDFS returns items in lexographic order by byte (see
INode#compareBytes) but I don't think ordering was intended to be an
explicit part of the contract. Ie the test probably just needs to be
modified to ignore the order.
RawLocalFileSystem uses Java's File#list which has no guarantee
I think that the API docs actually say globStatus is ordered and leave the
ordering semantics for listStatus undefined.
http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/fs/FileSystem.html#globStatus(org.apache.hadoop.fs.Path)
