[jira] [Commented] (HBASE-21006) Balancer - data locality drops 30-40% across all nodes after every cluster-wide rolling restart, not migrating regions back to original RegionServers?

2018-08-03 Thread Hari Sekhon (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568720#comment-16568720
 ] 

Hari Sekhon commented on HBASE-21006:
-

I will do follow up analysis of this on Monday as it's late here in London.

I saw HBASE-18164 but I didn't think it quite fitted, and I didn't see 
HBASE-18036. If it's covered by that one then I'll close this as a duplicate 
after we review it next week.

> Balancer - data locality drops 30-40% across all nodes after every 
> cluster-wide rolling restart, not migrating regions back to original 
> RegionServers?
> --
>
> Key: HBASE-21006
> URL: https://issues.apache.org/jira/browse/HBASE-21006
> Project: HBase
>  Issue Type: Improvement
>  Components: Balancer
>Affects Versions: 1.1.2
> Environment: HDP 2.6
>Reporter: Hari Sekhon
>Priority: Major
>
> After doing rolling restarts of my HBase cluster the data locality drops by 
> 30-40% every time which implies the stochastic balancer is not optimizing for 
> data locality enough, at least not under the circumstance of rolling 
> restarts, and that it must not be balancing the regions back to their 
> original RegionServers.
> The stochastic balancer is supposed to take data locality in to account but 
> if this is the case, surely it should move regions back to their original 
> RegionServers and data locality should return back to around where it was, 
> not drop by 30-40% percent every time I need to do some tuning and a rolling 
> restart.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21006) Balancer - data locality drops 30-40% across all nodes after every cluster-wide rolling restart, not migrating regions back to original RegionServers?

2018-08-03 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568706#comment-16568706
 ] 

Josh Elser commented on HBASE-21006:


[~harisekhon], are you planning to do analysis of your issue? It seems like 
you're just dumping a report here which helps no one.

HBASE-18036 is pretty much what you're already describing, so I'm apt to close 
this as invalid unless you have more information to share about your specific 
situation.

> Balancer - data locality drops 30-40% across all nodes after every 
> cluster-wide rolling restart, not migrating regions back to original 
> RegionServers?
> --
>
> Key: HBASE-21006
> URL: https://issues.apache.org/jira/browse/HBASE-21006
> Project: HBase
>  Issue Type: Improvement
>  Components: Balancer
>Affects Versions: 1.1.2
> Environment: HDP 2.6
>Reporter: Hari Sekhon
>Priority: Major
>
> After doing rolling restarts of my HBase cluster the data locality drops by 
> 30-40% every time which implies the stochastic balancer is not optimizing for 
> data locality enough, at least not under the circumstance of rolling 
> restarts, and that it must not be balancing the regions back to their 
> original RegionServers.
> The stochastic balancer is supposed to take data locality in to account but 
> if this is the case, surely it should move regions back to their original 
> RegionServers and data locality should return back to around where it was, 
> not drop by 30-40% percent every time I need to do some tuning and a rolling 
> restart.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21006) Balancer - data locality drops 30-40% across all nodes after every cluster-wide rolling restart, not migrating regions back to original RegionServers?

2018-08-03 Thread Hari Sekhon (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568697#comment-16568697
 ] 

Hari Sekhon commented on HBASE-21006:
-

I have, and pointed them to this Jira - that way Google can do its job in case 
anyone else is wondering why their data locality is destroyed after every 
rolling restart.

> Balancer - data locality drops 30-40% across all nodes after every 
> cluster-wide rolling restart, not migrating regions back to original 
> RegionServers?
> --
>
> Key: HBASE-21006
> URL: https://issues.apache.org/jira/browse/HBASE-21006
> Project: HBase
>  Issue Type: Improvement
>  Components: Balancer
>Affects Versions: 1.1.2
> Environment: HDP 2.6
>Reporter: Hari Sekhon
>Priority: Major
>
> After doing rolling restarts of my HBase cluster the data locality drops by 
> 30-40% every time which implies the stochastic balancer is not optimizing for 
> data locality enough, at least not under the circumstance of rolling 
> restarts, and that it must not be balancing the regions back to their 
> original RegionServers.
> The stochastic balancer is supposed to take data locality in to account but 
> if this is the case, surely it should move regions back to their original 
> RegionServers and data locality should return back to around where it was, 
> not drop by 30-40% percent every time I need to do some tuning and a rolling 
> restart.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21006) Balancer - data locality drops 30-40% across all nodes after every cluster-wide rolling restart, not migrating regions back to original RegionServers?

2018-08-03 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568492#comment-16568492
 ] 

Josh Elser commented on HBASE-21006:


[~harisekhon], have you raised this internally with Hortonworks?

> Balancer - data locality drops 30-40% across all nodes after every 
> cluster-wide rolling restart, not migrating regions back to original 
> RegionServers?
> --
>
> Key: HBASE-21006
> URL: https://issues.apache.org/jira/browse/HBASE-21006
> Project: HBase
>  Issue Type: Improvement
>  Components: Balancer
>Affects Versions: 1.1.2
> Environment: HDP 2.6
>Reporter: Hari Sekhon
>Priority: Major
>
> After doing rolling restarts of my HBase cluster the data locality drops by 
> 30-40% every time which implies the stochastic balancer is not optimizing for 
> data locality enough, at least not under the circumstance of rolling 
> restarts, and that it must not be balancing the regions back to their 
> original RegionServers.
> The stochastic balancer is supposed to take data locality in to account but 
> if this is the case, surely it should move regions back to their original 
> RegionServers and data locality should return back to around where it was, 
> not drop by 30-40% percent every time I need to do some tuning and a rolling 
> restart.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)