[
https://issues.apache.org/jira/browse/HBASE-21014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574532#comment-16574532
]
Hari Sekhon edited comment on HBASE-21014 at 8/9/18 9:10 AM:
-------------------------------------------------------------
Yes this is what I thought hence I'd already linked HBASE-7932 and book
reference as well as a discussion on the mailing list from some of my
ex-colleagues from Cloudera who really know their stuff like Harsh J and Lars
George.
So really what I'm asking for is for the Stochastic Balancer to include the
hint writes like the FavoredNodeBalancer.
I already have dfs.datanode.block-pinning.enabled = true, it's just not much
use until the Stochastic Balancer gets this support as I don't want to lose the
better balancing which is used more often than an hdfs rebalance.
was (Author: harisekhon):
Yes this is what I thought hence I'd already linked HBase-7932 and book
reference as well as a discussion on the mailing list from some of my
ex-colleagues from Cloudera who really know their stuff like Harsh J and Lars
George.
So really what I'm asking for is for the Stochastic Balancer to include the
hint writes like the FavoredNodeBalancer.
I already have dfs.datanode.block-pinning.enabled = true, it's just not much
use until the Stochastic Balancer gets this support as I don't want to lose the
better balancing which is used more often than an hdfs rebalance.
> Improve Stochastic Balancer to write HDFS favoured node hints for region
> primary blocks to avoid destroying data locality if needing to use HDFS
> Balancer
> ---------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HBASE-21014
> URL: https://issues.apache.org/jira/browse/HBASE-21014
> Project: HBase
> Issue Type: Improvement
> Components: Balancer
> Affects Versions: 1.1.2
> Reporter: Hari Sekhon
> Priority: Major
>
> Improve Stochastic Balancer to include the HDFS region location hints to
> avoid HDFS Balancer destroying data locality.
> Right now according to a mix of docs, jiras and mailing list info it appears
> that one must change
> {code:java}
> hbase.master.loadbalancer.class{code}
> to the org.apache.hadoop.hbase.favored.FavoredNodeLoadBalancer as it looks
> like this functionality is only within FavoredNodeBalancer and not the
> standard Stochastic Balancer.
> [http://hbase.apache.org/book.html#_hbase_and_hdfs]
> This is not ideal because we'd still like to use all the heuristics and work
> that has gone in the Stochastic Balancer which I believe right now is the
> best and most mature HBase balancer.
> See also the linked Jiras and this discussion:
> [http://apache-hbase.679495.n3.nabble.com/HDFS-Balancer-td4086607.html]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
