[ 
https://issues.apache.org/jira/browse/HDFS-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899398#comment-16899398
 ] 

Wei-Chiu Chuang commented on HDFS-13759:
----------------------------------------

You should use DistributedFileSystem instead of DFSClient. The latter is a 
private API.
DistributedFileSystem offers DirListingIterator for the purpose you described.

> [HDFS Pagination]Does HDFS Java api Support Pagination?
> -------------------------------------------------------
>
>                 Key: HDFS-13759
>                 URL: https://issues.apache.org/jira/browse/HDFS-13759
>             Project: Hadoop HDFS
>          Issue Type: Wish
>          Components: fs, fs async
>    Affects Versions: 2.6.0, 2.7.0, 2.8.0
>            Reporter: wuchang
>            Priority: Major
>              Labels: HDFS, pagination
>
> I could use *FileSystem*
> {code:java}
> RemoteIterator<FileStatus> listed = fs.listStatusIterator(new 
> Path("hdfs://warehousestore/user/chang.wu/flat_level_1"));{code}
> like this to get files *asynchronously*.
> But in fact what I want is a pagination support, where I could pass two 
> parameters, the 
> {code:java}
> offset{code}
> and
> {code:java}
> limit{code}
> , like MySQL does to get part of files under some directory;.
> I know I could just implement the pagination by wrapping the 
> *listStatusIterator*, but I think it looks weird.
> So, why can't HDFS support pagination for user directly? 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to