[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457676#comment-15457676 ]
Xiao Chen commented on HDFS-10823: ---------------------------------- Thanks Andrew for the nice investigation and thoughts here. I've only done HDFS-10481 with httpfs, which is too trivial a jira to understand deeply... If I understand this right, the main difference is for webhdfs in HDFS-10784, we can conveniently batch via {{NamenodeWebHdfsMethods#getDirectoryListing}}. But without such method for httpfs, we have to find our own way to batch. Sounds big.... Could you explain why HttpFSServer is essentially doing webhdfs -> fs -> webhdfs? I hope we can find a place to hook up on webhdfs and batch from there. Sorry if I got it wrong somewhere, please feel free to correct me. > Implement HttpFSFileSystem#listStatusIterator > --------------------------------------------- > > Key: HDFS-10823 > URL: https://issues.apache.org/jira/browse/HDFS-10823 > Project: Hadoop HDFS > Issue Type: Improvement > Components: httpfs > Affects Versions: 2.6.4 > Reporter: Andrew Wang > Assignee: Andrew Wang > > Let's expose the same functionality added in HDFS-10784 for WebHDFS in HttpFS > too. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org