dynamic replication
-------------------
Key: HDFS-782
URL: https://issues.apache.org/jira/browse/HDFS-782
Project: Hadoop HDFS
Issue Type: New Feature
Reporter: Ning Zhang
In a large and busy cluster, a block can be requested by many clients at the
same time. HDFS-767 tries to solve the failing case when the # of retries
exceeds the maximum # of retries. However, that patch doesn't solve the
performance issue since all failing clients have to wait a certain period
before retry, and the # of retries could be high.
One solution to solve the performance issue is to increase the # of replicas
for this "hot" block dynamically when it is requested many times at a short
period. The name node need to be aware such situation and only clean up extra
replicas when they are not accessed recently.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
