[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2021-03-16 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302576#comment-17302576 ] Michael Stack commented on HBASE-24528: --- [~vjasani] Thanks. > Improve balancer decision

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2021-03-16 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302357#comment-17302357 ] Viraj Jasani commented on HBASE-24528: -- Sure thing [~stack] > Improve balancer decision

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2021-03-15 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301915#comment-17301915 ] Michael Stack commented on HBASE-24528: --- This nice feature needs a release note (Asking for a

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-10-16 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215501#comment-17215501 ] Hudson commented on HBASE-24528: Results for branch branch-1 [build #44 on

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-09-18 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198414#comment-17198414 ] Hudson commented on HBASE-24528: Results for branch branch-2 [build #45 on

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-09-16 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197344#comment-17197344 ] Hudson commented on HBASE-24528: Results for branch master [build #51 on

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-08-17 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179157#comment-17179157 ] Andrew Kyle Purtell commented on HBASE-24528: - Looked at

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-08-12 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17176539#comment-17176539 ] Viraj Jasani commented on HBASE-24528: -- Thanks Josh (y) > Improve balancer decision observability

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-08-12 Thread Josh Elser (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17176538#comment-17176538 ] Josh Elser commented on HBASE-24528: This JSON looks excellent to me. > Improve balancer decision

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-08-12 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17176530#comment-17176530 ] Viraj Jasani commented on HBASE-24528: -- Attached one sample json for balancer decision output,

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-07-12 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156365#comment-17156365 ] Viraj Jasani commented on HBASE-24528: -- Created sub-task HBASE-24718 for refactor work of current

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138701#comment-17138701 ] Viraj Jasani commented on HBASE-24528: -- {quote}That means, we could use an in memory queue,

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-14 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135344#comment-17135344 ] Duo Zhang commented on HBASE-24528: --- My assumption is that, these things are not critical so it is

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-13 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134935#comment-17134935 ] Andrew Kyle Purtell commented on HBASE-24528: - bq. For recording statistics, just use a new

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-12 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134612#comment-17134612 ] Duo Zhang commented on HBASE-24528: --- {quote} IMHO, this sounds like another use-case for the "local

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-12 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134458#comment-17134458 ] Andrew Kyle Purtell commented on HBASE-24528: - bq. Nobody is suggesting “everywhere”. That

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-12 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134443#comment-17134443 ] Andrew Kyle Purtell commented on HBASE-24528: - (y) > Improve balancer decision

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-12 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134438#comment-17134438 ] Viraj Jasani commented on HBASE-24528: -- Oh yes, all relevant classes are IA.Private. > Improve

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-12 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134432#comment-17134432 ] Andrew Kyle Purtell commented on HBASE-24528: - I have no strong opinion, but I don't think

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-12 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134021#comment-17134021 ] Viraj Jasani commented on HBASE-24528: -- {color:#172b4d}While I am not fully aware of all advantages

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-11 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133734#comment-17133734 ] Andrew Kyle Purtell commented on HBASE-24528: - For example: - For the slow log case, can we

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-11 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133726#comment-17133726 ] Andrew Kyle Purtell commented on HBASE-24528: - If we are going to discuss this let’s not use

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-11 Thread Nick Dimiduk (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133685#comment-17133685 ] Nick Dimiduk commented on HBASE-24528: -- I'm not a fan of standing up these ring buffers everywhere.

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-11 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133684#comment-17133684 ] Andrew Kyle Purtell commented on HBASE-24528: - Ok, so either way we develop on branch-2 and

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-11 Thread Nick Dimiduk (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133683#comment-17133683 ] Nick Dimiduk commented on HBASE-24528: -- bq. On the other hand a RM might have objection to such a

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-11 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133627#comment-17133627 ] Andrew Kyle Purtell commented on HBASE-24528: - IS.Private means we can change the

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-11 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133174#comment-17133174 ] Viraj Jasani commented on HBASE-24528: -- All great suggestions!  Although work done for slow_log

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-10 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132660#comment-17132660 ] Andrew Kyle Purtell commented on HBASE-24528: - {quote}how we solve using workflow in HMaster

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-10 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130895#comment-17130895 ] Andrew Kyle Purtell commented on HBASE-24528: - Regards filtering, a list of 100 or 1000

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-10 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130892#comment-17130892 ] Viraj Jasani commented on HBASE-24528: -- Yeah I was thinking about it but the problem is that code

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-10 Thread Sean Busbey (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130860#comment-17130860 ] Sean Busbey commented on HBASE-24528: - how much of the "dump the slow response stuff somewhere" code

[jira] [Commented] (HBASE-24528) Improve balancer decision observability

2020-06-10 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130539#comment-17130539 ] Viraj Jasani commented on HBASE-24528: -- {quote}The balancer should maintain a rolling window of