[
https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457676#comment-15457676
]
Xiao Chen commented on HDFS-10823:
----------------------------------
Thanks Andrew for the nice investigation and thoughts here. I've only done
HDFS-10481 with httpfs, which is too trivial a jira to understand deeply...
If I understand this right, the main difference is for webhdfs in HDFS-10784,
we can conveniently batch via {{NamenodeWebHdfsMethods#getDirectoryListing}}.
But without such method for httpfs, we have to find our own way to batch.
Sounds big....
Could you explain why HttpFSServer is essentially doing webhdfs -> fs ->
webhdfs? I hope we can find a place to hook up on webhdfs and batch from there.
Sorry if I got it wrong somewhere, please feel free to correct me.
> Implement HttpFSFileSystem#listStatusIterator
> ---------------------------------------------
>
> Key: HDFS-10823
> URL: https://issues.apache.org/jira/browse/HDFS-10823
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: httpfs
> Affects Versions: 2.6.4
> Reporter: Andrew Wang
> Assignee: Andrew Wang
>
> Let's expose the same functionality added in HDFS-10784 for WebHDFS in HttpFS
> too.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
