Bryan Beaudreault created HBASE-26250:
-----------------------------------------

             Summary: Automatic and near real-time healing of locality
                 Key: HBASE-26250
                 URL: https://issues.apache.org/jira/browse/HBASE-26250
             Project: HBase
          Issue Type: New Feature
            Reporter: Bryan Beaudreault


I’m proposing a somewhat major new tool for quickly and efficiently alleviating 
latency pains due to locality. This is especially useful in cloud environments, 
and has been highly impactful at HubSpot, where we run thousands of 
RegionServers across 40+ multi-zone clusters. Please see the attached design 
doc for details on the problem, why compactions are not enough to solve the 
problem, and an overview (with diagram) of the components that make up this new 
tool.

As spec'd, this new feature would require submission of a new tool in the HDFS 
project. Once we reach consensus on the approach I can create the relevant 
upstream HDFS JIRA.

See the design doc here: 
https://docs.google.com/document/d/1GLGzrF1QLyhyOCr2fFw0LCymnyFPT0ktShTaaXn-75A/edit#heading=h.aswo7shg76b6



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to