[
https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435511#comment-15435511
]
Andrew Wang commented on HDFS-10784:
------------------------------------
Thanks for taking a look Xiao. FWIW, the limitation of starting the listing at
an offset is a function of the Java API, but not the REST API itself. Since Hue
doesn't use the Java API, it can implement an "iterator at offset" if it so
desires. We could implement it in the Java API too if that's desired, but I'm
hesitant to widen the FileSystem API any further.
> Implement WebHdfsFileSystem#listStatusIterator
> ----------------------------------------------
>
> Key: HDFS-10784
> URL: https://issues.apache.org/jira/browse/HDFS-10784
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: webhdfs
> Affects Versions: 2.6.4
> Reporter: Andrew Wang
> Assignee: Andrew Wang
> Attachments: HDFS-10784.001.patch
>
>
> It would be nice to implement the iterative listStatus in WebHDFS so client
> apps do not need to buffer the full file list for large directories.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
