Parallelize load of .regioninfo files in diagnostic/repair portion of hbck.
---------------------------------------------------------------------------

                 Key: HBASE-5712
                 URL: https://issues.apache.org/jira/browse/HBASE-5712
             Project: HBase
          Issue Type: Sub-task
            Reporter: Jonathan Hsieh


On heavily loaded hdfs's some dfs nodes may not respond quickly and backs off 
for 60s before attempting to read data from another datanode.  Portions of the 
information gathered from hdfs (.regioninfo files) are loaded serially.  With 
HBase with clusters with 100's, or 1000's, or 10000's regions encountering 
these 60s delay blocks progress and can be very painful.  

There is already some parallelization of portions of the hdfs information load 
operations and the goal here is move the reading of .regioninfos into the 
parallelized sections..

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to