[jira] [Commented] (HBASE-23212) Provide config reload for Auto Region Reopen based on storeFile ref count

2019-11-07 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969785#comment-16969785
 ] 

Hudson commented on HBASE-23212:


Results for branch branch-2
[build #2347 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2347/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2347//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2347//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/2347//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Provide config reload for Auto Region Reopen based on storeFile ref count
> -
>
> Key: HBASE-23212
> URL: https://issues.apache.org/jira/browse/HBASE-23212
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
> Attachments: HBASE-23212.branch-1.000.patch, 
> HBASE-23212.branch-1.000.patch, HBASE-23212.branch-2.000.patch, 
> HBASE-23212.branch-2.000.patch
>
>
> We should provide flexibility to tune max storeFile Ref Count threshold that 
> is considered for auto region reopen as it represents leak on store file. 
> While running some perf tests, user can bring ref count very high if 
> required, but this config change should be dynamic and should not require 
> HMaster restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-23212) Provide config reload for Auto Region Reopen based on storeFile ref count

2019-11-07 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969198#comment-16969198
 ] 

Hudson commented on HBASE-23212:


Results for branch branch-1
[build #1130 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1130/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1130//General_Nightly_Build_Report/]


(/) {color:green}+1 jdk7 checks{color}
-- For more information [see jdk7 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1130//JDK7_Nightly_Build_Report/]


(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/1130//JDK8_Nightly_Build_Report_(Hadoop2)/]




(/) {color:green}+1 source release artifact{color}
-- See build output for details.


> Provide config reload for Auto Region Reopen based on storeFile ref count
> -
>
> Key: HBASE-23212
> URL: https://issues.apache.org/jira/browse/HBASE-23212
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
> Attachments: HBASE-23212.branch-1.000.patch, 
> HBASE-23212.branch-1.000.patch, HBASE-23212.branch-2.000.patch, 
> HBASE-23212.branch-2.000.patch
>
>
> We should provide flexibility to tune max storeFile Ref Count threshold that 
> is considered for auto region reopen as it represents leak on store file. 
> While running some perf tests, user can bring ref count very high if 
> required, but this config change should be dynamic and should not require 
> HMaster restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-23212) Provide config reload for Auto Region Reopen based on storeFile ref count

2019-11-06 Thread Andrew Kyle Purtell (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968543#comment-16968543
 ] 

Andrew Kyle Purtell commented on HBASE-23212:
-

Looking at the backport PRs now

> Provide config reload for Auto Region Reopen based on storeFile ref count
> -
>
> Key: HBASE-23212
> URL: https://issues.apache.org/jira/browse/HBASE-23212
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
> Attachments: HBASE-23212.branch-1.000.patch, 
> HBASE-23212.branch-1.000.patch, HBASE-23212.branch-2.000.patch, 
> HBASE-23212.branch-2.000.patch
>
>
> We should provide flexibility to tune max storeFile Ref Count threshold that 
> is considered for auto region reopen as it represents leak on store file. 
> While running some perf tests, user can bring ref count very high if 
> required, but this config change should be dynamic and should not require 
> HMaster restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-23212) Provide config reload for Auto Region Reopen based on storeFile ref count

2019-11-06 Thread Viraj Jasani (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968456#comment-16968456
 ] 

Viraj Jasani commented on HBASE-23212:
--

Since precommit build issue might take some time, raised PRs(#802 and #803) for 
backport. This should trigger builds for respective branch.

> Provide config reload for Auto Region Reopen based on storeFile ref count
> -
>
> Key: HBASE-23212
> URL: https://issues.apache.org/jira/browse/HBASE-23212
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
> Attachments: HBASE-23212.branch-1.000.patch, 
> HBASE-23212.branch-1.000.patch, HBASE-23212.branch-2.000.patch, 
> HBASE-23212.branch-2.000.patch
>
>
> We should provide flexibility to tune max storeFile Ref Count threshold that 
> is considered for auto region reopen as it represents leak on store file. 
> While running some perf tests, user can bring ref count very high if 
> required, but this config change should be dynamic and should not require 
> HMaster restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-23212) Provide config reload for Auto Region Reopen based on storeFile ref count

2019-11-05 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967552#comment-16967552
 ] 

Hudson commented on HBASE-23212:


Results for branch master
[build #1527 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/1527/]: (x) 
*{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1527//General_Nightly_Build_Report/]




(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1527//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/1527//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Provide config reload for Auto Region Reopen based on storeFile ref count
> -
>
> Key: HBASE-23212
> URL: https://issues.apache.org/jira/browse/HBASE-23212
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
> Attachments: HBASE-23212.branch-1.000.patch, 
> HBASE-23212.branch-2.000.patch
>
>
> We should provide flexibility to tune max storeFile Ref Count threshold that 
> is considered for auto region reopen as it represents leak on store file. 
> While running some perf tests, user can bring ref count very high if 
> required, but this config change should be dynamic and should not require 
> HMaster restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-23212) Provide config reload for Auto Region Reopen based on storeFile ref count

2019-11-05 Thread Viraj Jasani (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967350#comment-16967350
 ] 

Viraj Jasani commented on HBASE-23212:
--

Precommit jobs seem to have some issues and builds are not going well. However, 
I have tested attached patches locally with relevant tests and things look 
good. From my side, they are ready to go.

> Provide config reload for Auto Region Reopen based on storeFile ref count
> -
>
> Key: HBASE-23212
> URL: https://issues.apache.org/jira/browse/HBASE-23212
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
> Attachments: HBASE-23212.branch-1.000.patch, 
> HBASE-23212.branch-2.000.patch
>
>
> We should provide flexibility to tune max storeFile Ref Count threshold that 
> is considered for auto region reopen as it represents leak on store file. 
> While running some perf tests, user can bring ref count very high if 
> required, but this config change should be dynamic and should not require 
> HMaster restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-23212) Provide config reload for Auto Region Reopen based on storeFile ref count

2019-11-04 Thread Viraj Jasani (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967235#comment-16967235
 ] 

Viraj Jasani commented on HBASE-23212:
--

Thank you [~xucang]

Sure, let me upload backport patches soon

> Provide config reload for Auto Region Reopen based on storeFile ref count
> -
>
> Key: HBASE-23212
> URL: https://issues.apache.org/jira/browse/HBASE-23212
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
>
> We should provide flexibility to tune max storeFile Ref Count threshold that 
> is considered for auto region reopen as it represents leak on store file. 
> While running some perf tests, user can bring ref count very high if 
> required, but this config change should be dynamic and should not require 
> HMaster restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (HBASE-23212) Provide config reload for Auto Region Reopen based on storeFile ref count

2019-11-04 Thread Xu Cang (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966960#comment-16966960
 ] 

Xu Cang commented on HBASE-23212:
-

I gave +1 and merged the master branch patch. Thank you [~vjasani]!

Are you going to port this to branch-1 and branch-2 too? thanks. 

> Provide config reload for Auto Region Reopen based on storeFile ref count
> -
>
> Key: HBASE-23212
> URL: https://issues.apache.org/jira/browse/HBASE-23212
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.3.0, 1.6.0
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Fix For: 3.0.0, 2.3.0, 1.6.0
>
>
> We should provide flexibility to tune max storeFile Ref Count threshold that 
> is considered for auto region reopen as it represents leak on store file. 
> While running some perf tests, user can bring ref count very high if 
> required, but this config change should be dynamic and should not require 
> HMaster restart.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)