[
https://issues.apache.org/jira/browse/HDFS-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899398#comment-16899398
]
Wei-Chiu Chuang commented on HDFS-13759:
----------------------------------------
You should use DistributedFileSystem instead of DFSClient. The latter is a
private API.
DistributedFileSystem offers DirListingIterator for the purpose you described.
> [HDFS Pagination]Does HDFS Java api Support Pagination?
> -------------------------------------------------------
>
> Key: HDFS-13759
> URL: https://issues.apache.org/jira/browse/HDFS-13759
> Project: Hadoop HDFS
> Issue Type: Wish
> Components: fs, fs async
> Affects Versions: 2.6.0, 2.7.0, 2.8.0
> Reporter: wuchang
> Priority: Major
> Labels: HDFS, pagination
>
> I could use *FileSystem*
> {code:java}
> RemoteIterator<FileStatus> listed = fs.listStatusIterator(new
> Path("hdfs://warehousestore/user/chang.wu/flat_level_1"));{code}
> like this to get files *asynchronously*.
> But in fact what I want is a pagination support, where I could pass two
> parameters, the
> {code:java}
> offset{code}
> and
> {code:java}
> limit{code}
> , like MySQL does to get part of files under some directory;.
> I know I could just implement the pagination by wrapping the
> *listStatusIterator*, but I think it looks weird.
> So, why can't HDFS support pagination for user directly?
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
