Duo Zhang created HDFS-8683:
-------------------------------
Summary: Implement flow control
Key: HDFS-8683
URL: https://issues.apache.org/jira/browse/HDFS-8683
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Duo Zhang
We have implemented read block over http2 on the POC branch.
https://github.com/Apache9/hadoop/tree/HDFS-7966-POC
The block reader is implemented using jetty. We wrote a testcase to test
performance with MiniCluster and we found that the the flow control of HTTP/2
has a big impact on the performance. Window update frame will be delayed if we
create many threads to read, and netty will stop sending data if there is no
window space left and thus cause a bad impact on performance.
Flow control is a built-in feature of HTTP/2. We ignore it does not mean we can
bypass it. So I think we need to support this feature at first place. Or at
least, find a way to bypass it(maybe a very large initial window size?)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
