David Mollitor created HDFS-14872:
-------------------------------------
Summary: Read HDFS Blocks in Random Order
Key: HDFS-14872
URL: https://issues.apache.org/jira/browse/HDFS-14872
Project: Hadoop HDFS
Issue Type: New Feature
Components: hdfs-client
Affects Versions: 3.2.1, 2.8.5
Reporter: David Mollitor
When the HDFS client is downloading (copying) an entire file, allow the client
to download the blocks in random order. If a lot of clients are reading the
same file, in parallel, they will all download the first block, the second
block, and so on, stampeding down the line.
It would be interesting to spread the load across across all the available
DataNodes.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
