Daryn Sharp created HDFS-6214:
---------------------------------
Summary: Webhdfs has poor throughput for files >2GB
Key: HDFS-6214
URL: https://issues.apache.org/jira/browse/HDFS-6214
Project: Hadoop HDFS
Issue Type: Bug
Components: webhdfs
Affects Versions: 2.0.0-alpha, 3.0.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp
For the DN's open call, jetty returns a Content-Length header for files <2GB,
and uses chunking for files >2GB. A "bug" in jetty's buffer handling results
in a ~8X reduction in throughput.
--
This message was sent by Atlassian JIRA
(v6.2#6252)