[jira] [Commented] (HBASE-21707) TestRSGroupsKillRS is not stable enough

2019-01-11 Thread Duo Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741125#comment-16741125
 ] 

Duo Zhang commented on HBASE-21707:
---

OK, I think this is a test issue. We only have 1 RS in the group, and we killed 
it, so the region can not be assigned, thus we should not wait for no RIT after 
killing the server, we need to add new servers to the group...

Let me fix the test...

> TestRSGroupsKillRS is not stable enough
> ---
>
> Key: HBASE-21707
> URL: https://issues.apache.org/jira/browse/HBASE-21707
> Project: HBase
>  Issue Type: Bug
>  Components: Region Assignment, rsgroup
>Reporter: Duo Zhang
>Priority: Major
> Attachments: HBASE-21707-UT.patch
>
>
> By adding a sleep after the stopServer call, the test will hang there 
> forever, need to dig more, maybe something wrong with the TRSP related stuffs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21707) TestRSGroupsKillRS is not stable enough

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21707:
--
Attachment: HBASE-21707-UT.patch

> TestRSGroupsKillRS is not stable enough
> ---
>
> Key: HBASE-21707
> URL: https://issues.apache.org/jira/browse/HBASE-21707
> Project: HBase
>  Issue Type: Bug
>  Components: Region Assignment, rsgroup
>Reporter: Duo Zhang
>Priority: Major
> Attachments: HBASE-21707-UT.patch
>
>
> By adding a sleep after the stopServer call, the test will hang there 
> forever, need to dig more, maybe something wrong with the TRSP related stuffs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HBASE-21707) TestRSGroupsKillRS is not stable enough

2019-01-11 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-21707:
-

 Summary: TestRSGroupsKillRS is not stable enough
 Key: HBASE-21707
 URL: https://issues.apache.org/jira/browse/HBASE-21707
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, rsgroup
Reporter: Duo Zhang


By adding a sleep after the stopServer call, the test will hang there forever, 
need to dig more, maybe something wrong with the TRSP related stuffs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21705:
--
Attachment: HBASE-21705-v1.patch

> Should treat meta table specially for some methods in AsyncAdmin
> 
>
> Key: HBASE-21705
> URL: https://issues.apache.org/jira/browse/HBASE-21705
> Project: HBase
>  Issue Type: Sub-task
>  Components: Admin, asyncclient, Client
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21705-v1.patch, HBASE-21705.patch
>
>
> For example, tableExists, isTableEnabled, isTableDisabled...
> For now, we will go to the meta table directly but obviously, meta table does 
> not contain the record for itself...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Duo Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741016#comment-16741016
 ] 

Duo Zhang commented on HBASE-21705:
---

I think we'd better remove the check in AsyncMetaTableAccessor? As its name is 
for accessing meta table...

> Should treat meta table specially for some methods in AsyncAdmin
> 
>
> Key: HBASE-21705
> URL: https://issues.apache.org/jira/browse/HBASE-21705
> Project: HBase
>  Issue Type: Sub-task
>  Components: Admin, asyncclient, Client
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21705.patch
>
>
> For example, tableExists, isTableEnabled, isTableDisabled...
> For now, we will go to the meta table directly but obviously, meta table does 
> not contain the record for itself...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21679) Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741009#comment-16741009
 ] 

Hadoop QA commented on HBASE-21679:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
17s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue}  0m  
1s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 3 new or modified test 
files. {color} |
|| || || || {color:brown} branch-1 Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
56s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  2m 
 8s{color} | {color:green} branch-1 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m 
55s{color} | {color:green} branch-1 passed with JDK v1.8.0_192 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m 
43s{color} | {color:green} branch-1 passed with JDK v1.7.0_201 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 14m 
29s{color} | {color:green} branch-1 passed {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue}  3m 
56s{color} | {color:blue} branch has no errors when building the reference 
guide. See footer for rendered docs, which you should manually inspect. {color} 
|
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  3m 
59s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  8m 
35s{color} | {color:green} branch-1 passed with JDK v1.8.0_192 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  7m 
28s{color} | {color:green} branch-1 passed with JDK v1.7.0_201 {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
27s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  2m 
35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
26s{color} | {color:green} the patch passed with JDK v1.8.0_192 {color} |
| {color:green}+1{color} | {color:green} cc {color} | {color:green}  2m 
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  2m 
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m  
0s{color} | {color:green} the patch passed with JDK v1.7.0_201 {color} |
| {color:green}+1{color} | {color:green} cc {color} | {color:green}  2m  
0s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red}  2m  0s{color} 
| {color:red} root-jdk1.7.0_201 with JDK v1.7.0_201 generated 2 new + 36 
unchanged - 2 fixed = 38 total (was 38) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red}  1m 
54s{color} | {color:red} hbase-server: The patch generated 3 new + 561 
unchanged - 11 fixed = 564 total (was 572) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red}  5m 
29s{color} | {color:red} root: The patch generated 3 new + 773 unchanged - 11 
fixed = 776 total (was 784) {color} |
| {color:red}-1{color} | {color:red} rubocop {color} | {color:red}  0m 
15s{color} | {color:red} The patch generated 15 new + 912 unchanged - 12 fixed 
= 927 total (was 924) {color} |
| {color:orange}-0{color} | {color:orange} ruby-lint {color} | {color:orange}  
0m  5s{color} | {color:orange} The patch generated 10 new + 665 unchanged - 2 
fixed = 675 total (was 667) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} xml {color} | {color:red}  0m  0s{color} | 
{color:red} The patch has 1 ill-formed XML file(s). {color} |
| {color:blue}0{color} | {color:blue} refguide 

[jira] [Commented] (HBASE-20716) Unsafe access cleanup

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-20716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740999#comment-16740999
 ] 

Hudson commented on HBASE-20716:


Results for branch branch-1
[build #629 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(x) {color:red}-1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//General_Nightly_Build_Report/]


(x) {color:red}-1 jdk7 checks{color}
-- For more information [see jdk7 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK7_Nightly_Build_Report/]


(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK8_Nightly_Build_Report_(Hadoop2)/]




(x) {color:red}-1 source release artifact{color}
-- See build output for details.


> Unsafe access cleanup
> -
>
> Key: HBASE-20716
> URL: https://issues.apache.org/jira/browse/HBASE-20716
> Project: HBase
>  Issue Type: Sub-task
>  Components: Performance
>Reporter: stack
>Assignee: Sahil Aggarwal
>Priority: Critical
>  Labels: beginner
> Fix For: 3.0.0, 1.5.0, 2.2.0, 2.1.1
>
> Attachments: HBASE-20716.master.001.patch, 
> HBASE-20716.master.002.patch, HBASE-20716.master.003.patch, 
> HBASE-20716.master.004.patch, HBASE-20716.master.005.patch, 
> HBASE-20716.master.006.patch, HBASE-20716.master.007.patch, 
> HBASE-20716.master.008.patch, Screen Shot 2018-06-26 at 11.37.49 AM.png
>
>
> We have two means of getting at unsafe; UnsafeAccess and then internal to the 
> Bytes class. They are effectively doing the same thing. We should have one 
> avenue to Unsafe only.
> Many of our paths to Unsafe via UnsafeAccess traverse flags to check if 
> access is available, if it is aligned and the order in which words are 
> written on the machine. Each check costs -- especially if done millions of 
> times a second -- and on occasion adds bloat in hot code paths. The unsafe 
> access inside Bytes checks on startup what the machine is capable off and 
> then does a static assign of the appropriate class-to-use from there on out. 
> UnsafeAccess does not do this running the checks everytime. Would be good to 
> have the Bytes behavior pervasive.
> The benefit of one access to Unsafe only is plain. The benefits we gain 
> removing checks will be harder to measure though should be plain when you 
> disassemble a hot-path; in a (very) rare case, the saved byte codes could be 
> the difference between inlining or not.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-20928) Rewrite calculation of midpoint in binarySearch functions to prevent overflow

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741001#comment-16741001
 ] 

Hudson commented on HBASE-20928:


Results for branch branch-1
[build #629 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(x) {color:red}-1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//General_Nightly_Build_Report/]


(x) {color:red}-1 jdk7 checks{color}
-- For more information [see jdk7 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK7_Nightly_Build_Report/]


(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK8_Nightly_Build_Report_(Hadoop2)/]




(x) {color:red}-1 source release artifact{color}
-- See build output for details.


> Rewrite calculation of midpoint in binarySearch functions to prevent overflow
> -
>
> Key: HBASE-20928
> URL: https://issues.apache.org/jira/browse/HBASE-20928
> Project: HBase
>  Issue Type: Bug
>  Components: io
>Reporter: saurabh singh
>Assignee: saurabh singh
>Priority: Minor
> Fix For: 1.5.0, 2.2.0
>
> Attachments: HBASE-20928-addendum.patch, 
> HBASE-20928-fix-binarySearch-v5.patch, HBASE-20928-fix-binarySearch-v5.patch
>
>
> There are couple of issues in the function:
>  * {{>>>}} operator would mess the values if {{low}} + {{high}} end up being 
> negative. This shouldn't happen but I don't see anything to prevent this from 
> happening.
>  * The code fails around boundary values of {{low}} and {{high}}. This is a 
> well known binary search catch. 
> [https://ai.googleblog.com/2006/06/extra-extra-read-all-about-it-nearly.html]
>  
> Most of the code should already be covered by tests. I would have liked to 
> add a test that actually fails without the fix but given these are private 
> methods I am not sure on the best place to add the test. Suggestions?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21208) Bytes#toShort doesn't work without unsafe

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741000#comment-16741000
 ] 

Hudson commented on HBASE-21208:


Results for branch branch-1
[build #629 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(x) {color:red}-1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//General_Nightly_Build_Report/]


(x) {color:red}-1 jdk7 checks{color}
-- For more information [see jdk7 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK7_Nightly_Build_Report/]


(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK8_Nightly_Build_Report_(Hadoop2)/]




(x) {color:red}-1 source release artifact{color}
-- See build output for details.


> Bytes#toShort doesn't work without unsafe
> -
>
> Key: HBASE-21208
> URL: https://issues.apache.org/jira/browse/HBASE-21208
> Project: HBase
>  Issue Type: Bug
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
>Priority: Critical
> Fix For: 1.5.0, 2.2.0, 2.1.1, 2.0.3
>
> Attachments: HBASE-21208.v0.patch, HBASE-21208.v1.patch, 
> HBASE-21208.v2.patch
>
>
> seems we put the brackets in the wrong place.
> {code}
>   short n = 0;
>   n = (short) ((n ^ bytes[offset]) & 0xFF);
>   n = (short) (n << 8);
>   n = (short) ((n ^ bytes[offset+1]) & 0xFF);   // this one
>   return n;
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21164) reportForDuty to spew less log if master is initializing

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741002#comment-16741002
 ] 

Hudson commented on HBASE-21164:


Results for branch branch-1
[build #629 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(x) {color:red}-1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//General_Nightly_Build_Report/]


(x) {color:red}-1 jdk7 checks{color}
-- For more information [see jdk7 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK7_Nightly_Build_Report/]


(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK8_Nightly_Build_Report_(Hadoop2)/]




(x) {color:red}-1 source release artifact{color}
-- See build output for details.


> reportForDuty to spew less log if master is initializing
> 
>
> Key: HBASE-21164
> URL: https://issues.apache.org/jira/browse/HBASE-21164
> Project: HBase
>  Issue Type: Improvement
>  Components: regionserver
>Reporter: stack
>Assignee: Mingliang Liu
>Priority: Minor
> Fix For: 3.0.0, 1.5.0, 2.2.0, 2.1.1
>
> Attachments: HBASE-21164.005.patch, HBASE-21164.006.patch, 
> HBASE-21164.007.patch, HBASE-21164.008.patch, HBASE-21164.009.patch, 
> HBASE-21164.branch-2.1.001.patch, HBASE-21164.branch-2.1.002.patch, 
> HBASE-21164.branch-2.1.003.patch, HBASE-21164.branch-2.1.004.patch
>
>
> RegionServers do reportForDuty on startup to tell Master they are available. 
> If Master is initializing, and especially on a big cluster when it can take a 
> while particularly if something is amiss, the log every three seconds is 
> annoying and doesn't do anything of use. We should spew less those logs. Here 
> is example:
> {code:java}
> 2018-09-06 14:01:39,312 INFO 
> org.apache.hadoop.hbase.regionserver.HRegionServer: reportForDuty to 
> master=vc0207.halxg.cloudera.com,22001,1536266763109 with port=22001, 
> startcode=1536266763109
> 2018-09-06 14:01:39,312 WARN 
> org.apache.hadoop.hbase.regionserver.HRegionServer: reportForDuty failed; 
> sleeping and then retrying.
> 
> {code}
> For example, I am looking at a large cluster now that had a backlog of 
> procedure WALs. It is taking a couple of hours recreating the procedure-state 
> because there are millions of procedures outstanding. Meantime, the Master 
> log is just full of the above message – every three seconds...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21325) Force to terminate regionserver when abort hang in somewhere

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741003#comment-16741003
 ] 

Hudson commented on HBASE-21325:


Results for branch branch-1
[build #629 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(x) {color:red}-1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//General_Nightly_Build_Report/]


(x) {color:red}-1 jdk7 checks{color}
-- For more information [see jdk7 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK7_Nightly_Build_Report/]


(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/629//JDK8_Nightly_Build_Report_(Hadoop2)/]




(x) {color:red}-1 source release artifact{color}
-- See build output for details.


> Force to terminate regionserver when abort hang in somewhere
> 
>
> Key: HBASE-21325
> URL: https://issues.apache.org/jira/browse/HBASE-21325
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.2.0, 2.1.1, 2.0.2
>Reporter: Duo Zhang
>Assignee: Guanghao Zhang
>Priority: Major
> Fix For: 3.0.0, 1.5.0, 2.2.0
>
> Attachments: HBASE-21325.master.001.patch, 
> HBASE-21325.master.001.patch, HBASE-21325.master.002.patch, 
> HBASE-21325.master.003.patch, HBASE-21325.master.004.patch, 
> HBASE-21325.master.005.patch
>
>
> When testing sync replication, I found that, if I transit the remote cluster 
> to DA, while the local cluster is still in A, the region server will hang 
> when shutdown. As the fsOk flag only test the local cluster(which is 
> reasonable), we will enter the waitOnAllRegionsToClose, and since the WAL is 
> broken(the remote wal directory is gone)  so we will never succeed. And this 
> lead to an infinite wait inside waitOnAllRegionsToClose.
> So I think here we should have an upper bound for the wait time in 
> waitOnAllRegionsToClose method.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21679) Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1

2019-01-11 Thread Andrew Purtell (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-21679:
---
  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

> Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
> ---
>
> Key: HBASE-21679
> URL: https://issues.apache.org/jira/browse/HBASE-21679
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Major
> Fix For: 1.5.0
>
> Attachments: HBASE-21679-branch-1.patch, HBASE-21679-branch-1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21693) [rsgroup] Do not attempt to move tables that do not exist

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740979#comment-16740979
 ] 

Hadoop QA commented on HBASE-21693:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
13s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
 9s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
32s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
12s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
12s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  0m 
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
17s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  0m 
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
11s{color} | {color:green} patch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}  
8m 43s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  0m 
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
16s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}  6m 33s{color} 
| {color:red} hbase-rsgroup in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
11s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 36m 13s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.rsgroup.TestRSGroupsAdmin2 |
|   | hadoop.hbase.rsgroup.TestRSGroupsBalance |
|   | hadoop.hbase.rsgroup.TestRSGroupsWithACL |
|   | hadoop.hbase.rsgroup.TestRSGroupsBasics |
|   | hadoop.hbase.rsgroup.TestRSGroupsKillRS |
|   | hadoop.hbase.rsgroup.TestRSGroupsOfflineMode |
|   | hadoop.hbase.rsgroup.TestRSGroupsAdmin1 |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21693 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954665/HBASE-21693.master.0002.patch
 |
| Optional Tests |  dupname  asflicense  javac  javadoc  unit  findbugs  
shadedjars  hadoopcheck  hbaseanti  checkstyle  compile  |
| uname | Linux 734016c442bb 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 
17:16:02 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
 |
| git revision | master / 3d2580cd6d |
| maven | version: Apache Maven 3.5.4 
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_181 |
| findbugs | v3.1.0-RC3 |
| unit | 

[jira] [Commented] (HBASE-21679) Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1

2019-01-11 Thread Andrew Purtell (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740963#comment-16740963
 ] 

Andrew Purtell commented on HBASE-21679:


Got a +1 on RB, thanks [~abhishek.chouhan]. Rebased again. Will commit if local 
checks pass.

> Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
> ---
>
> Key: HBASE-21679
> URL: https://issues.apache.org/jira/browse/HBASE-21679
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Major
> Fix For: 1.5.0
>
> Attachments: HBASE-21679-branch-1.patch, HBASE-21679-branch-1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21325) Force to terminate regionserver when abort hang in somewhere

2019-01-11 Thread Andrew Purtell (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-21325:
---
Fix Version/s: 1.5.0

> Force to terminate regionserver when abort hang in somewhere
> 
>
> Key: HBASE-21325
> URL: https://issues.apache.org/jira/browse/HBASE-21325
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.2.0, 2.1.1, 2.0.2
>Reporter: Duo Zhang
>Assignee: Guanghao Zhang
>Priority: Major
> Fix For: 3.0.0, 1.5.0, 2.2.0
>
> Attachments: HBASE-21325.master.001.patch, 
> HBASE-21325.master.001.patch, HBASE-21325.master.002.patch, 
> HBASE-21325.master.003.patch, HBASE-21325.master.004.patch, 
> HBASE-21325.master.005.patch
>
>
> When testing sync replication, I found that, if I transit the remote cluster 
> to DA, while the local cluster is still in A, the region server will hang 
> when shutdown. As the fsOk flag only test the local cluster(which is 
> reasonable), we will enter the waitOnAllRegionsToClose, and since the WAL is 
> broken(the remote wal directory is gone)  so we will never succeed. And this 
> lead to an infinite wait inside waitOnAllRegionsToClose.
> So I think here we should have an upper bound for the wait time in 
> waitOnAllRegionsToClose method.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21693) [rsgroup] Do not attempt to move tables that do not exist

2019-01-11 Thread xuqinya (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

xuqinya updated HBASE-21693:

Attachment: HBASE-21693.master.0002.patch
Status: Patch Available  (was: Open)

> [rsgroup] Do not attempt to move tables that do not exist
> -
>
> Key: HBASE-21693
> URL: https://issues.apache.org/jira/browse/HBASE-21693
> Project: HBase
>  Issue Type: Bug
>  Components: rsgroup
>Reporter: xuqinya
>Assignee: xuqinya
>Priority: Major
> Attachments: HBASE-21693.master.0001.patch, 
> HBASE-21693.master.0002.patch
>
>
> In rsgroup, allow to move tables that do not exist. This can cause dirty data.
> {code:java}
> base(main):004:0* move_rsgroup_tables 'rs1',['ttt']
> hbase(main):005:0> get_rsgroup 'rs1'
> GROUP INFORMATION 
> Servers: 
> 192.168.12.65:16020  
> Tables: 
> ttt 
> {code}
>  
> I think it should be like this. As follows: 
> {code:java}
> hbase(main):001:0> move_rsgroup_tables 'rs1',['ttt']
> ERROR: org.apache.hadoop.hbase.constraint.ConstraintException: Source group 
> is null for table ttt ,table must exist.
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveTables(RSGroupAdminServer.java:265)
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint.moveTables(RSGroupAdminEndpoint.java:174)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:11141)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:675)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:52454)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2135)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>   at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
>   at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
>   at java.lang.Thread.run(Thread.java:745)
> Here is some help for this command:
> Reassign tables from one group to another.
>   hbase> move_rsgroup_tables 'dest',['table1','table2']
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Comment Edited] (HBASE-21673) Final sweep of branch-2+ commits for new branch-1 minor (1.5)

2019-01-11 Thread Andrew Purtell (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740962#comment-16740962
 ] 

Andrew Purtell edited comment on HBASE-21673 at 1/12/19 2:03 AM:
-

Cherry picked and pushed  HBASE-20716, HBASE-20928, HBASE-21164, HBASE-21208, 
and HBASE-21325.


was (Author: apurtell):
Backported and pushed  HBASE-20716, HBASE-20928, HBASE-21164, HBASE-21208, and 
HBASE-21325.

> Final sweep of branch-2+ commits for new branch-1 minor (1.5)
> -
>
> Key: HBASE-21673
> URL: https://issues.apache.org/jira/browse/HBASE-21673
> Project: HBase
>  Issue Type: Umbrella
>Affects Versions: 1.5.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Major
>
> Umbrella for backports to branch-1 of suitable changes for a new minor (1.5). 
> See subtasks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21673) Final sweep of branch-2+ commits for new branch-1 minor (1.5)

2019-01-11 Thread Andrew Purtell (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740962#comment-16740962
 ] 

Andrew Purtell commented on HBASE-21673:


Backported and pushed  HBASE-20716, HBASE-20928, HBASE-21164, HBASE-21208, and 
HBASE-21325.

> Final sweep of branch-2+ commits for new branch-1 minor (1.5)
> -
>
> Key: HBASE-21673
> URL: https://issues.apache.org/jira/browse/HBASE-21673
> Project: HBase
>  Issue Type: Umbrella
>Affects Versions: 1.5.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Major
>
> Umbrella for backports to branch-1 of suitable changes for a new minor (1.5). 
> See subtasks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work stopped] (HBASE-21693) [rsgroup] Do not attempt to move tables that do not exist

2019-01-11 Thread xuqinya (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on HBASE-21693 stopped by xuqinya.
---
> [rsgroup] Do not attempt to move tables that do not exist
> -
>
> Key: HBASE-21693
> URL: https://issues.apache.org/jira/browse/HBASE-21693
> Project: HBase
>  Issue Type: Bug
>  Components: rsgroup
>Reporter: xuqinya
>Assignee: xuqinya
>Priority: Major
> Attachments: HBASE-21693.master.0001.patch, 
> HBASE-21693.master.0002.patch
>
>
> In rsgroup, allow to move tables that do not exist. This can cause dirty data.
> {code:java}
> base(main):004:0* move_rsgroup_tables 'rs1',['ttt']
> hbase(main):005:0> get_rsgroup 'rs1'
> GROUP INFORMATION 
> Servers: 
> 192.168.12.65:16020  
> Tables: 
> ttt 
> {code}
>  
> I think it should be like this. As follows: 
> {code:java}
> hbase(main):001:0> move_rsgroup_tables 'rs1',['ttt']
> ERROR: org.apache.hadoop.hbase.constraint.ConstraintException: Source group 
> is null for table ttt ,table must exist.
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveTables(RSGroupAdminServer.java:265)
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint.moveTables(RSGroupAdminEndpoint.java:174)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:11141)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:675)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:52454)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2135)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>   at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
>   at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
>   at java.lang.Thread.run(Thread.java:745)
> Here is some help for this command:
> Reassign tables from one group to another.
>   hbase> move_rsgroup_tables 'dest',['table1','table2']
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21693) [rsgroup] Do not attempt to move tables that do not exist

2019-01-11 Thread Andrew Purtell (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740953#comment-16740953
 ] 

Andrew Purtell commented on HBASE-21693:


The idea behind this change is good and it looks reasonable but the patch needs 
more work because it causes existing unit tests to fail. Please set this issue 
to 'Patch Available', wait for precommit, check the unit test failures, and 
work on it until the latest patch finally passes all unit tests. 

I see these failures:

[ERROR]   TestRSGroupsAdmin1.testDisabledTableMove:391 » Constraint 
org.apache.hadoop.hb...
[ERROR] 
org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.testFailRemoveGroup(org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1)
[ERROR]   TestRSGroupsAdmin1.testFailRemoveGroup:241 » Constraint 
org.apache.hadoop.hbas...
[ERROR]   TestRSGroupsAdmin1.testMultiTableMove:278 » Constraint 
org.apache.hadoop.hbase...
[ERROR]   
TestRSGroupsAdmin1.testRSGroupListDoesNotContainFailedTableCreation:463 » 
Constraint
[ERROR]   TestRSGroupsAdmin1.testTableMoveTruncateAndDrop:330 » Constraint 
org.apache.ha...
[ERROR] Tests run: 14, Failures: 0, Errors: 5, Skipped: 0

> [rsgroup] Do not attempt to move tables that do not exist
> -
>
> Key: HBASE-21693
> URL: https://issues.apache.org/jira/browse/HBASE-21693
> Project: HBase
>  Issue Type: Bug
>  Components: rsgroup
>Reporter: xuqinya
>Assignee: xuqinya
>Priority: Major
> Attachments: HBASE-21693.master.0001.patch
>
>
> In rsgroup, allow to move tables that do not exist. This can cause dirty data.
> {code:java}
> base(main):004:0* move_rsgroup_tables 'rs1',['ttt']
> hbase(main):005:0> get_rsgroup 'rs1'
> GROUP INFORMATION 
> Servers: 
> 192.168.12.65:16020  
> Tables: 
> ttt 
> {code}
>  
> I think it should be like this. As follows: 
> {code:java}
> hbase(main):001:0> move_rsgroup_tables 'rs1',['ttt']
> ERROR: org.apache.hadoop.hbase.constraint.ConstraintException: Source group 
> is null for table ttt ,table must exist.
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveTables(RSGroupAdminServer.java:265)
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint.moveTables(RSGroupAdminEndpoint.java:174)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:11141)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:675)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:52454)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2135)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>   at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
>   at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
>   at java.lang.Thread.run(Thread.java:745)
> Here is some help for this command:
> Reassign tables from one group to another.
>   hbase> move_rsgroup_tables 'dest',['table1','table2']
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21693) [rsgroup] Do not attempt to move tables that do not exist

2019-01-11 Thread xuqinya (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740950#comment-16740950
 ] 

xuqinya commented on HBASE-21693:
-

[~apurtell] , Thank you for your review.

> [rsgroup] Do not attempt to move tables that do not exist
> -
>
> Key: HBASE-21693
> URL: https://issues.apache.org/jira/browse/HBASE-21693
> Project: HBase
>  Issue Type: Bug
>  Components: rsgroup
>Reporter: xuqinya
>Assignee: xuqinya
>Priority: Major
> Attachments: HBASE-21693.master.0001.patch
>
>
> In rsgroup, allow to move tables that do not exist. This can cause dirty data.
> {code:java}
> base(main):004:0* move_rsgroup_tables 'rs1',['ttt']
> hbase(main):005:0> get_rsgroup 'rs1'
> GROUP INFORMATION 
> Servers: 
> 192.168.12.65:16020  
> Tables: 
> ttt 
> {code}
>  
> I think it should be like this. As follows: 
> {code:java}
> hbase(main):001:0> move_rsgroup_tables 'rs1',['ttt']
> ERROR: org.apache.hadoop.hbase.constraint.ConstraintException: Source group 
> is null for table ttt ,table must exist.
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveTables(RSGroupAdminServer.java:265)
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint.moveTables(RSGroupAdminEndpoint.java:174)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:11141)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:675)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:52454)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2135)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>   at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
>   at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
>   at java.lang.Thread.run(Thread.java:745)
> Here is some help for this command:
> Reassign tables from one group to another.
>   hbase> move_rsgroup_tables 'dest',['table1','table2']
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21693) [rsgroup] Do not attempt to move tables that do not exist

2019-01-11 Thread Andrew Purtell (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-21693:
---
Summary: [rsgroup] Do not attempt to move tables that do not exist  (was: 
rsgroup's bug when moving bogus tables)

> [rsgroup] Do not attempt to move tables that do not exist
> -
>
> Key: HBASE-21693
> URL: https://issues.apache.org/jira/browse/HBASE-21693
> Project: HBase
>  Issue Type: Bug
>  Components: rsgroup
>Reporter: xuqinya
>Assignee: xuqinya
>Priority: Major
> Attachments: HBASE-21693.master.0001.patch
>
>
> In rsgroup, allow to move tables that do not exist. This can cause dirty data.
> {code:java}
> base(main):004:0* move_rsgroup_tables 'rs1',['ttt']
> hbase(main):005:0> get_rsgroup 'rs1'
> GROUP INFORMATION 
> Servers: 
> 192.168.12.65:16020  
> Tables: 
> ttt 
> {code}
>  
> I think it should be like this. As follows: 
> {code:java}
> hbase(main):001:0> move_rsgroup_tables 'rs1',['ttt']
> ERROR: org.apache.hadoop.hbase.constraint.ConstraintException: Source group 
> is null for table ttt ,table must exist.
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveTables(RSGroupAdminServer.java:265)
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint.moveTables(RSGroupAdminEndpoint.java:174)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:11141)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:675)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:52454)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2135)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>   at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
>   at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
>   at java.lang.Thread.run(Thread.java:745)
> Here is some help for this command:
> Reassign tables from one group to another.
>   hbase> move_rsgroup_tables 'dest',['table1','table2']
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21679) Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1

2019-01-11 Thread Andrew Purtell (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-21679:
---
Attachment: HBASE-21679-branch-1.patch

> Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
> ---
>
> Key: HBASE-21679
> URL: https://issues.apache.org/jira/browse/HBASE-21679
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Major
> Fix For: 1.5.0
>
> Attachments: HBASE-21679-branch-1.patch, HBASE-21679-branch-1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21679) Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1

2019-01-11 Thread Andrew Purtell (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740943#comment-16740943
 ] 

Andrew Purtell commented on HBASE-21679:


Updated patch. Rebased on latest branch-1. Warnings in RSRpcServices cannot be 
fixed, they are deprecated API warnings for Signal. Addressed HRegion warnings. 
Unrelated to this change, but still. Addressed what rubocop warnings I could. 
Unit test failures are not locally reproducible and appear unrelated, probably 
environmental. ruby-lint warnings are invalid. Fixed whitespace. XML warning is 
invalid. It's the "script engine for language js can not be found" issue.

> Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
> ---
>
> Key: HBASE-21679
> URL: https://issues.apache.org/jira/browse/HBASE-21679
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Major
> Fix For: 1.5.0
>
> Attachments: HBASE-21679-branch-1.patch, HBASE-21679-branch-1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work started] (HBASE-21693) rsgroup's bug when moving bogus tables

2019-01-11 Thread xuqinya (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on HBASE-21693 started by xuqinya.
---
> rsgroup's bug when moving bogus tables
> --
>
> Key: HBASE-21693
> URL: https://issues.apache.org/jira/browse/HBASE-21693
> Project: HBase
>  Issue Type: Bug
>  Components: rsgroup
>Reporter: xuqinya
>Assignee: xuqinya
>Priority: Major
> Attachments: HBASE-21693.master.0001.patch
>
>
> In rsgroup, allow to move tables that do not exist. This can cause dirty data.
> {code:java}
> base(main):004:0* move_rsgroup_tables 'rs1',['ttt']
> hbase(main):005:0> get_rsgroup 'rs1'
> GROUP INFORMATION 
> Servers: 
> 192.168.12.65:16020  
> Tables: 
> ttt 
> {code}
>  
> I think it should be like this. As follows: 
> {code:java}
> hbase(main):001:0> move_rsgroup_tables 'rs1',['ttt']
> ERROR: org.apache.hadoop.hbase.constraint.ConstraintException: Source group 
> is null for table ttt ,table must exist.
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveTables(RSGroupAdminServer.java:265)
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint.moveTables(RSGroupAdminEndpoint.java:174)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:11141)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:675)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:52454)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2135)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>   at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
>   at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
>   at java.lang.Thread.run(Thread.java:745)
> Here is some help for this command:
> Reassign tables from one group to another.
>   hbase> move_rsgroup_tables 'dest',['table1','table2']
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21164) reportForDuty to spew less log if master is initializing

2019-01-11 Thread Andrew Purtell (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-21164:
---
Fix Version/s: 1.5.0

> reportForDuty to spew less log if master is initializing
> 
>
> Key: HBASE-21164
> URL: https://issues.apache.org/jira/browse/HBASE-21164
> Project: HBase
>  Issue Type: Improvement
>  Components: regionserver
>Reporter: stack
>Assignee: Mingliang Liu
>Priority: Minor
> Fix For: 3.0.0, 1.5.0, 2.2.0, 2.1.1
>
> Attachments: HBASE-21164.005.patch, HBASE-21164.006.patch, 
> HBASE-21164.007.patch, HBASE-21164.008.patch, HBASE-21164.009.patch, 
> HBASE-21164.branch-2.1.001.patch, HBASE-21164.branch-2.1.002.patch, 
> HBASE-21164.branch-2.1.003.patch, HBASE-21164.branch-2.1.004.patch
>
>
> RegionServers do reportForDuty on startup to tell Master they are available. 
> If Master is initializing, and especially on a big cluster when it can take a 
> while particularly if something is amiss, the log every three seconds is 
> annoying and doesn't do anything of use. We should spew less those logs. Here 
> is example:
> {code:java}
> 2018-09-06 14:01:39,312 INFO 
> org.apache.hadoop.hbase.regionserver.HRegionServer: reportForDuty to 
> master=vc0207.halxg.cloudera.com,22001,1536266763109 with port=22001, 
> startcode=1536266763109
> 2018-09-06 14:01:39,312 WARN 
> org.apache.hadoop.hbase.regionserver.HRegionServer: reportForDuty failed; 
> sleeping and then retrying.
> 
> {code}
> For example, I am looking at a large cluster now that had a backlog of 
> procedure WALs. It is taking a couple of hours recreating the procedure-state 
> because there are millions of procedures outstanding. Meantime, the Master 
> log is just full of the above message – every three seconds...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Comment Edited] (HBASE-21679) Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1

2019-01-11 Thread Andrew Purtell (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740926#comment-16740926
 ] 

Andrew Purtell edited comment on HBASE-21679 at 1/12/19 12:58 AM:
--

To make forward progress on umbrella I'm going to commit this as lazy 
consensus. First, will fix the precommit warnings


was (Author: apurtell):
To make forward progress on umbrella I'm going to commit this as lazy consensus

> Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
> ---
>
> Key: HBASE-21679
> URL: https://issues.apache.org/jira/browse/HBASE-21679
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Major
> Fix For: 1.5.0
>
> Attachments: HBASE-21679-branch-1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21679) Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1

2019-01-11 Thread Andrew Purtell (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740926#comment-16740926
 ] 

Andrew Purtell commented on HBASE-21679:


To make forward progress on umbrella I'm going to commit this as lazy consensus

> Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
> ---
>
> Key: HBASE-21679
> URL: https://issues.apache.org/jira/browse/HBASE-21679
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Major
> Fix For: 1.5.0
>
> Attachments: HBASE-21679-branch-1.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21634) Print error message when user uses unacceptable values for LIMIT while setting quotas.

2019-01-11 Thread Sakthi (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740925#comment-16740925
 ] 

Sakthi commented on HBASE-21634:


[~zghaobac] / [~elserj] Mind taking a look at the patch? Thanks.

> Print error message when user uses unacceptable values for LIMIT while 
> setting quotas.
> --
>
> Key: HBASE-21634
> URL: https://issues.apache.org/jira/browse/HBASE-21634
> Project: HBase
>  Issue Type: Improvement
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Minor
> Attachments: hbase-21634.master.001.patch, 
> hbase-21634.master.002.patch, hbase-21634.master.003.patch, 
> hbase-21634.master.004.patch
>
>
> When unacceptable value(like 2.3G or 70H) to LIMIT are passed while setting 
> quotas, we currently do not print any error message (informing the user about 
> the erroneous input). Like below:
> {noformat}
> hbase(main):002:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '2.3G', 
> POLICY => NO_WRITES
> Took 0.0792 seconds
> hbase(main):003:0> list_quotas
> OWNERQUOTAS
>  TABLE => t2 TYPE => SPACE, 
> TABLE => t2, LIMIT => 2B, VIOLATION_POLICY => NO_WRITES
> 1 row(s)
> Took 0.0512 seconds
> hbase(main):006:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '70H', 
> POLICY => NO_WRITES
> Took 0.0088 seconds
> hbase(main):007:0> list_quotas
> OWNERQUOTAS
>  TABLE => t2 TYPE => SPACE, 
> TABLE => t2, LIMIT => 70B, VIOLATION_POLICY => NO_WRITES
> 1 row(s)
> Took 0.0448 seconds
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21693) rsgroup's bug when moving bogus tables

2019-01-11 Thread Andrew Purtell (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740924#comment-16740924
 ] 

Andrew Purtell commented on HBASE-21693:


+1
Committing after some local checks

> rsgroup's bug when moving bogus tables
> --
>
> Key: HBASE-21693
> URL: https://issues.apache.org/jira/browse/HBASE-21693
> Project: HBase
>  Issue Type: Bug
>  Components: rsgroup
>Reporter: xuqinya
>Assignee: xuqinya
>Priority: Major
> Attachments: HBASE-21693.master.0001.patch
>
>
> In rsgroup, allow to move tables that do not exist. This can cause dirty data.
> {code:java}
> base(main):004:0* move_rsgroup_tables 'rs1',['ttt']
> hbase(main):005:0> get_rsgroup 'rs1'
> GROUP INFORMATION 
> Servers: 
> 192.168.12.65:16020  
> Tables: 
> ttt 
> {code}
>  
> I think it should be like this. As follows: 
> {code:java}
> hbase(main):001:0> move_rsgroup_tables 'rs1',['ttt']
> ERROR: org.apache.hadoop.hbase.constraint.ConstraintException: Source group 
> is null for table ttt ,table must exist.
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveTables(RSGroupAdminServer.java:265)
>   at 
> org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint.moveTables(RSGroupAdminEndpoint.java:174)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:11141)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:675)
>   at 
> org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:52454)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2135)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>   at 
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
>   at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
>   at java.lang.Thread.run(Thread.java:745)
> Here is some help for this command:
> Reassign tables from one group to another.
>   hbase> move_rsgroup_tables 'dest',['table1','table2']
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Sakthi (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740922#comment-16740922
 ] 

Sakthi commented on HBASE-21225:


Hey [~elserj], the failed UT looks unrelated. It passed locally. Rest of the QA 
looks fine.

> Having RPC & Space quota on a table/Namespace doesn't allow space quota to be 
> removed using 'NONE'
> --
>
> Key: HBASE-21225
> URL: https://issues.apache.org/jira/browse/HBASE-21225
> Project: HBase
>  Issue Type: Bug
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Major
> Attachments: hbase-21225.master.001.patch, 
> hbase-21225.master.002.patch, hbase-21225.master.003.patch, 
> hbase-21225.master.004.patch, hbase-21225.master.005.patch
>
>
> A part of HBASE-20705 is still unresolved. In that Jira it was assumed that 
> problem is: when table having both rpc & space quotas is dropped (with 
> hbase.quota.remove.on.table.delete set as true), the rpc quota is not set to 
> be dropped along with table-drops, and space quota was not being able to be 
> removed completely because of the "EMPTY" row that rpc quota left even after 
> removing. 
> The proposed solution for that was to make sure that rpc quota didn't leave 
> empty rows after removal of quota. And setting automatic removal of rpc quota 
> with table drops. That made sure that space quotas can be recreated/removed.
> But all this was under the assumption that hbase.quota.remove.on.table.delete 
> is set as true. When it is set as false, the same issue can reproduced. Also 
> the below shown steps can used to reproduce the issue without table-drops.
> {noformat}
> hbase(main):005:0> create 't2','cf'
> Created table t2
> Took 0.7619 seconds
> => Hbase::Table - t2
> hbase(main):006:0> set_quota TYPE => THROTTLE, TABLE => 't2', LIMIT => 
> '10M/sec'
> Took 0.0514 seconds
> hbase(main):007:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0162 seconds
> hbase(main):008:0> list_quotas
> OWNER  QUOTAS
>  TABLE => t2   TYPE => THROTTLE, THROTTLE_TYPE => REQUEST_SIZE, 
> LIMIT => 10M/sec, SCOPE =>
>MACHINE
>  TABLE => t2   TYPE => SPACE, TABLE => t2, LIMIT => 1073741824, 
> VIOLATION_POLICY => NO_WRIT
>ES
> 2 row(s)
> Took 0.0716 seconds
> hbase(main):009:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => NONE
> Took 0.0082 seconds
> hbase(main):010:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0254 seconds
> hbase(main):011:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0082 seconds
> hbase(main):012:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0411 seconds
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740914#comment-16740914
 ] 

Hadoop QA commented on HBASE-21225:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
12s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
27s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  5m 
25s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  3m 
18s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  2m 
 2s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  5m 
15s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m 
52s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m  
2s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
15s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  5m 
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  3m  
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  3m  
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  5m 
 5s{color} | {color:green} patch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 
10m 54s{color} | {color:green} Patch does not cause any errors with Hadoop 
2.7.4 or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  4m 
35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m  
2s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  3m 
28s{color} | {color:green} hbase-client in the patch passed. {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red}148m 23s{color} 
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
45s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}207m  1s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.client.TestHbck |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21225 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954636/hbase-21225.master.005.patch
 |
| Optional Tests |  dupname  asflicense  javac  javadoc  unit  findbugs  
shadedjars  hadoopcheck  hbaseanti  checkstyle  compile  |
| uname | Linux cf63acc3b75c 4.4.0-138-generic #164~14.04.1-Ubuntu SMP Fri Oct 
5 08:56:16 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
 |
| git revision | master / 3d2580cd6d |
| maven | version: Apache Maven 3.5.4 

[jira] [Commented] (HBASE-21456) Make WALFactory only used for creating WALProviders

2019-01-11 Thread Ankit Singhal (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740883#comment-16740883
 ] 

Ankit Singhal commented on HBASE-21456:
---

{quote}Do we reach a consensus, or any info i needed to be synced?
{quote}
{quote}I have similar sort of question: whats wrong w/ WALFactory being the 
place you go to to manufacture anything to do w/ WALs...? Obviously you have 
some larger plan in mind. Is there a pointer? Thanks.
{quote}
Sorry [~reidchan], I thought consensus was reached after your comment, but it 
seems not ,that's my bad.


 [~stack], I think(and this probably was also the same thought when Josh 
created this Jira) that currently there is a confusion in responsibility of 
walFactory vs walProvider. As with new API's added in walProvider, it is better 
to access walProvider directly instead creating a shim for them in the factory 
and on the other hand , we can redefine WalFactory (or WalProviderFactory) to 
just help in initializing the configured WAL provider and let other WAL related 
stuff to provider itself. 
 But that's all said, would like to hear your thought on the need of having 
WalFactory intercepting all the request made to the provider.

> Make WALFactory only used for creating WALProviders
> ---
>
> Key: HBASE-21456
> URL: https://issues.apache.org/jira/browse/HBASE-21456
> Project: HBase
>  Issue Type: Sub-task
>  Components: wal
>Reporter: Josh Elser
>Assignee: Ankit Singhal
>Priority: Major
> Attachments: HBASE-21456.HBASE-20952.001.patch, 
> HBASE-21456.HBASE-20952.wip.patch
>
>
> As a Factory, WALFactory should only have one job: creating instances of 
> WALProvider.
> However, over the years, it has been a landing place for lots of wal-related 
> methods (e.g. constructing readers, WALEntryStream, and more). We want all of 
> this to live in the WALProvider.
> We can do this in two steps: have the WALFactory methods invoke the method on 
> the WALProvider (handled elsewhere), then here we can replace usage of the 
> WALFactory "wrapper methods" with the WALProvider itself.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (HBASE-17384) Consider aborting region server when MVCC#waitForRead() gets stuck

2019-01-11 Thread stack (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack resolved HBASE-17384.
---
Resolution: Won't Fix

No work done on this improvement and better to fix why we are STUCK than do a 
workaround.

> Consider aborting region server when MVCC#waitForRead() gets stuck
> --
>
> Key: HBASE-17384
> URL: https://issues.apache.org/jira/browse/HBASE-17384
> Project: HBase
>  Issue Type: Bug
>Reporter: Ted Yu
>Priority: Major
> Attachments: testHRegionWithInMemoryFlush.out
>
>
> From 
> https://builds.apache.org/job/PreCommit-HBASE-Build/5072/testReport/org.apache.hadoop.hbase.regionserver/TestHRegionWithInMemoryFlush/org_apache_hadoop_hbase_regionserver_TestHRegionWithInMemoryFlush/
>  :
> {code}
> org.junit.runners.model.TestTimedOutException: test timed out after 10 minutes
>   at java.lang.Object.wait(Native Method)
>   at 
> org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl.waitForRead(MultiVersionConcurrencyControl.java:218)
>   at 
> org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl.completeAndWait(MultiVersionConcurrencyControl.java:149)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.getNextSequenceId(HRegion.java:2732)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.internalPrepareFlushCache(HRegion.java:2447)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2343)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2314)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2304)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1601)
>   at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1506)
>   at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1456)
>   at 
> org.apache.hadoop.hbase.HBaseTestingUtility.closeRegionAndWAL(HBaseTestingUtility.java:374)
>   at 
> org.apache.hadoop.hbase.regionserver.TestHRegion.testFlushCacheWhileScanning(TestHRegion.java:3839)
> {code}
> As can be seen from test output:
> {code}
> 2016-12-28 13:43:28,379 INFO  [Time-limited test] regionserver.HStore(1431): 
> Completed major compaction of 1 (all) file(s) in family1 of 
> testWritesWhileScanning,,1482932605883.2e46061b97a54d7f8434c4a705b3c4a2. into 
> 255e7eb61cfc4945ac5887957d39b1fe(size=98.0 K), total size for store is 98.0 K
> ...[truncated 4062267 bytes]...
> TUCK: MultiVersionConcurrencyControl{readPoint=1090, writePoint=1093}
> 2016-12-28 13:48:29,396 WARN  [Time-limited test] 
> regionserver.MultiVersionConcurrencyControl(214): STUCK: 
> MultiVersionConcurrencyControl{readPoint=1090, writePoint=1093}
> 2016-12-28 13:48:30,406 WARN  [Time-limited test] 
> regionserver.MultiVersionConcurrencyControl(214): STUCK: 
> MultiVersionConcurrencyControl{readPoint=1090, writePoint=1093}
> 2016-12-28 13:48:31,416 WARN  [Time-limited test] 
> regionserver.MultiVersionConcurrencyControl(214): STUCK: 
> MultiVersionConcurrencyControl{readPoint=1090, writePoint=1093}
> {code}
> At least 5 minutes passed with the above log showing waitForRead() stuck.
> Since the flush is blocked, we should consider aborting region server when 
> waitForRead() gets stuck for extended period of time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21706) Inconsistency of fs.defaultFS between active and standby masters

2019-01-11 Thread Lei Chen (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Chen updated HBASE-21706:
-
Description: 
I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and 
standby masters have different `fs.defaultFS` on their /conf pages.
 Given `fs.defaultFS` is set to : and `hbase.rootdir` is set 
to :/ in core-site.xml on all the hosts, it looks 
like standby masters has `fs.defaultFS` programatically set to the same value 
as `hbase.rootdir`. 

For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
following line on the /conf page
{code:java}
fs.defaultFShdfs://DEV-CLUSTERprogramatically
{code}
but standby masters has 
{code:java}
fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}
Please correct me if this is not a bug but a feature, however I find this 
behavior surprising plus I cannot locate any related document.

>From a quick looking at the code, the cause seems to be that standby masters 
>got the property set in 
>[HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
> and active master got it set in a different way in 
>[MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].

  was:
I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and 
standby masters have different `fs.defaultFS` on their /conf pages.
 Given `fs.defaultFS` is set to : and `hbase.rootdir` is set 
to :/ in core-site.xml on all the hosts, it looks 
like standby masters has `fs.defaultFS` programatically set to the same value 
as `hbase.rootdir`. 

For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
following line on the /conf page
{code:java}
fs.defaultFShdfs://DEV-CLUSTERprogramatically
{code}
but standby masters has 
{code:java}
fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}
Please correct me if this is not a bug but a feature, but I find this behavior 
surprising plus I cannot locate any related document.

>From a quick looking at the code, the cause seems to be that standby masters 
>got the property set in 
>[HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
> and active master got it set in a different way in 
>[MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].


> Inconsistency of fs.defaultFS between active and standby masters
> 
>
> Key: HBASE-21706
> URL: https://issues.apache.org/jira/browse/HBASE-21706
> Project: HBase
>  Issue Type: Bug
>  Components: conf, master
>Affects Versions: 1.1.2
>Reporter: Lei Chen
>Priority: Minor
>
> I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and 
> standby masters have different `fs.defaultFS` on their /conf pages.
>  Given `fs.defaultFS` is set to : and `hbase.rootdir` is 
> set to :/ in core-site.xml on all the hosts, it 
> looks like standby masters has `fs.defaultFS` programatically set to the same 
> value as `hbase.rootdir`. 
> For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
> following line on the /conf page
> {code:java}
> fs.defaultFShdfs://DEV-CLUSTERprogramatically
> {code}
> but standby masters has 
> {code:java}
> fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}
> Please correct me if this is not a bug but a feature, however I find this 
> behavior surprising plus I cannot locate any related document.
> From a quick looking at the code, the cause seems to be that standby masters 
> got the property set in 
> [HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
>  and active master got it set in a different way in 
> [MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21706) Inconsistency of fs.defaultFS between active and standby masters

2019-01-11 Thread Lei Chen (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Chen updated HBASE-21706:
-
Description: 
I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and 
standby masters have different `fs.defaultFS` on their /conf pages.
 Given `fs.defaultFS` is set to : and `hbase.rootdir` is set 
to :/ in core-site.xml on all the hosts, it looks 
like standby masters has `fs.defaultFS` programatically set to the same value 
as `hbase.rootdir`. 

For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
following line on the /conf page
{code:java}
fs.defaultFShdfs://DEV-CLUSTERprogramatically
{code}
but standby masters has 
{code:java}
fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}
Please correct me if this is not a bug but a feature, however I find this 
behavior surprising plus I cannot locate any related document.

>From a quick look at the code, the cause seems to be that standby masters got 
>the property set in 
>[HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
> and active master got it set in a different way in 
>[MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].

  was:
I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and 
standby masters have different `fs.defaultFS` on their /conf pages.
 Given `fs.defaultFS` is set to : and `hbase.rootdir` is set 
to :/ in core-site.xml on all the hosts, it looks 
like standby masters has `fs.defaultFS` programatically set to the same value 
as `hbase.rootdir`. 

For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
following line on the /conf page
{code:java}
fs.defaultFShdfs://DEV-CLUSTERprogramatically
{code}
but standby masters has 
{code:java}
fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}
Please correct me if this is not a bug but a feature, however I find this 
behavior surprising plus I cannot locate any related document.

>From a quick looking at the code, the cause seems to be that standby masters 
>got the property set in 
>[HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
> and active master got it set in a different way in 
>[MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].


> Inconsistency of fs.defaultFS between active and standby masters
> 
>
> Key: HBASE-21706
> URL: https://issues.apache.org/jira/browse/HBASE-21706
> Project: HBase
>  Issue Type: Bug
>  Components: conf, master
>Affects Versions: 1.1.2
>Reporter: Lei Chen
>Priority: Minor
>
> I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and 
> standby masters have different `fs.defaultFS` on their /conf pages.
>  Given `fs.defaultFS` is set to : and `hbase.rootdir` is 
> set to :/ in core-site.xml on all the hosts, it 
> looks like standby masters has `fs.defaultFS` programatically set to the same 
> value as `hbase.rootdir`. 
> For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
> following line on the /conf page
> {code:java}
> fs.defaultFShdfs://DEV-CLUSTERprogramatically
> {code}
> but standby masters has 
> {code:java}
> fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}
> Please correct me if this is not a bug but a feature, however I find this 
> behavior surprising plus I cannot locate any related document.
> From a quick look at the code, the cause seems to be that standby masters got 
> the property set in 
> [HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
>  and active master got it set in a different way in 
> [MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740814#comment-16740814
 ] 

Josh Elser commented on HBASE-21225:


Looks OK. Let's see what QA says.

> Having RPC & Space quota on a table/Namespace doesn't allow space quota to be 
> removed using 'NONE'
> --
>
> Key: HBASE-21225
> URL: https://issues.apache.org/jira/browse/HBASE-21225
> Project: HBase
>  Issue Type: Bug
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Major
> Attachments: hbase-21225.master.001.patch, 
> hbase-21225.master.002.patch, hbase-21225.master.003.patch, 
> hbase-21225.master.004.patch, hbase-21225.master.005.patch
>
>
> A part of HBASE-20705 is still unresolved. In that Jira it was assumed that 
> problem is: when table having both rpc & space quotas is dropped (with 
> hbase.quota.remove.on.table.delete set as true), the rpc quota is not set to 
> be dropped along with table-drops, and space quota was not being able to be 
> removed completely because of the "EMPTY" row that rpc quota left even after 
> removing. 
> The proposed solution for that was to make sure that rpc quota didn't leave 
> empty rows after removal of quota. And setting automatic removal of rpc quota 
> with table drops. That made sure that space quotas can be recreated/removed.
> But all this was under the assumption that hbase.quota.remove.on.table.delete 
> is set as true. When it is set as false, the same issue can reproduced. Also 
> the below shown steps can used to reproduce the issue without table-drops.
> {noformat}
> hbase(main):005:0> create 't2','cf'
> Created table t2
> Took 0.7619 seconds
> => Hbase::Table - t2
> hbase(main):006:0> set_quota TYPE => THROTTLE, TABLE => 't2', LIMIT => 
> '10M/sec'
> Took 0.0514 seconds
> hbase(main):007:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0162 seconds
> hbase(main):008:0> list_quotas
> OWNER  QUOTAS
>  TABLE => t2   TYPE => THROTTLE, THROTTLE_TYPE => REQUEST_SIZE, 
> LIMIT => 10M/sec, SCOPE =>
>MACHINE
>  TABLE => t2   TYPE => SPACE, TABLE => t2, LIMIT => 1073741824, 
> VIOLATION_POLICY => NO_WRIT
>ES
> 2 row(s)
> Took 0.0716 seconds
> hbase(main):009:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => NONE
> Took 0.0082 seconds
> hbase(main):010:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0254 seconds
> hbase(main):011:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0082 seconds
> hbase(main):012:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0411 seconds
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-20662) Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-20662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740805#comment-16740805
 ] 

Josh Elser commented on HBASE-20662:


{quote}
Both scenarios fail with current logic with/without patch. 

I have provided a fix and test for these scenarios t
{quote}

What was the change that you made? I'm diff'ing your previous patch to try to 
figure this out.

{code}
> -LOG.trace(currentSnapshots.size() + " table quota snapshots are 
> collected, "
> -+ "read " + newSnapshots.size() + " from the quota table.");
> +LOG.trace("{} table quota snapshots are collected, read {} from the 
> quota table.",
> +  currentSnapshots.size(), newSnapshots.size());
{code}

Please undo these logger changes in this patch. If you want to switch over to 
the slf4j marker API, you should also be removing the {{ifTraceEnabled()}} 
wrapping conditional blocks too. Best to focus on one thing for a patch as this 
makes your change much easier for everyone else to follow.

> Increasing space quota on a violated table does not remove 
> SpaceViolationPolicy.DISABLE enforcement
> ---
>
> Key: HBASE-20662
> URL: https://issues.apache.org/jira/browse/HBASE-20662
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 3.0.0, 2.0.0
>Reporter: Nihal Jain
>Assignee: Nihal Jain
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: HBASE-20662.master.001.patch, 
> HBASE-20662.master.002.patch, HBASE-20662.master.003.patch, 
> HBASE-20662.master.004.patch, HBASE-20662.master.004.patch, 
> HBASE-20662.master.005.patch, HBASE-20662.master.006.patch
>
>
> *Steps to reproduce*
>  * Create a table and set quota with {{SpaceViolationPolicy.DISABLE}} having 
> limit say 2MB
>  * Now put rows until space quota is violated and table gets disabled
>  * Next, increase space quota with limit say 4MB on the table
>  * Now try putting a row into the table
> {code:java}
>  private void testSetQuotaThenViolateAndFinallyIncreaseQuota() throws 
> Exception {
> SpaceViolationPolicy policy = SpaceViolationPolicy.DISABLE;
> Put put = new Put(Bytes.toBytes("to_reject"));
> put.addColumn(Bytes.toBytes(SpaceQuotaHelperForTests.F1), 
> Bytes.toBytes("to"),
>   Bytes.toBytes("reject"));
> // Do puts until we violate space policy
> final TableName tn = writeUntilViolationAndVerifyViolation(policy, put);
> // Now, increase limit
> setQuotaLimit(tn, policy, 4L);
> // Put some row now: should not violate as quota limit increased
> verifyNoViolation(policy, tn, put);
>   }
> {code}
> *Expected*
> We should be able to put data as long as newly set quota limit is not reached
> *Actual*
> We fail to put any new row even after increasing limit
> *Root cause*
> Increasing quota on a violated table triggers the table to be enabled, but 
> since the table is already in violation, the system does not allow it to be 
> enabled (may be thinking that a user is trying to enable it)
> *Relevant exception trace*
> {noformat}
> 2018-05-31 00:34:27,563 INFO  [regionserver/root1-ThinkPad-T440p:0.Chore.1] 
> client.HBaseAdmin$14(844): Started enable of 
> testSetQuotaAndThenIncreaseQuotaWithDisable0
> 2018-05-31 00:34:27,571 DEBUG 
> [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=42525] 
> ipc.CallRunner(142): callId: 11 service: MasterService methodName: 
> EnableTable size: 104 connection: 127.0.0.1:38030 deadline: 1527707127568, 
> exception=org.apache.hadoop.hbase.security.AccessDeniedException: Enabling 
> the table 'testSetQuotaAndThenIncreaseQuotaWithDisable0' is disallowed due to 
> a violated space quota.
> 2018-05-31 00:34:27,571 ERROR [regionserver/root1-ThinkPad-T440p:0.Chore.1] 
> quotas.RegionServerSpaceQuotaManager(210): Failed to disable space violation 
> policy for testSetQuotaAndThenIncreaseQuotaWithDisable0. This table will 
> remain in violation.
> org.apache.hadoop.hbase.security.AccessDeniedException: 
> org.apache.hadoop.hbase.security.AccessDeniedException: Enabling the table 
> 'testSetQuotaAndThenIncreaseQuotaWithDisable0' is disallowed due to a 
> violated space quota.
>   at org.apache.hadoop.hbase.master.HMaster$6.run(HMaster.java:2275)
>   at 
> org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:131)
>   at org.apache.hadoop.hbase.master.HMaster.enableTable(HMaster.java:2258)
>   at 
> org.apache.hadoop.hbase.master.MasterRpcServices.enableTable(MasterRpcServices.java:725)
>   at 
> org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
>   at 

[jira] [Commented] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Sakthi (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740799#comment-16740799
 ] 

Sakthi commented on HBASE-21225:


Oh yes. It would be wise to have the previous tests. I have restored the tests 
and have modified testTableSpaceAndRPCQuotaRemoved, 
testNamespaceSpaceAndRPCQuotaRemoved. Have uploaded the new patch, [~elserj]. 
Let me know :)

 

> Having RPC & Space quota on a table/Namespace doesn't allow space quota to be 
> removed using 'NONE'
> --
>
> Key: HBASE-21225
> URL: https://issues.apache.org/jira/browse/HBASE-21225
> Project: HBase
>  Issue Type: Bug
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Major
> Attachments: hbase-21225.master.001.patch, 
> hbase-21225.master.002.patch, hbase-21225.master.003.patch, 
> hbase-21225.master.004.patch, hbase-21225.master.005.patch
>
>
> A part of HBASE-20705 is still unresolved. In that Jira it was assumed that 
> problem is: when table having both rpc & space quotas is dropped (with 
> hbase.quota.remove.on.table.delete set as true), the rpc quota is not set to 
> be dropped along with table-drops, and space quota was not being able to be 
> removed completely because of the "EMPTY" row that rpc quota left even after 
> removing. 
> The proposed solution for that was to make sure that rpc quota didn't leave 
> empty rows after removal of quota. And setting automatic removal of rpc quota 
> with table drops. That made sure that space quotas can be recreated/removed.
> But all this was under the assumption that hbase.quota.remove.on.table.delete 
> is set as true. When it is set as false, the same issue can reproduced. Also 
> the below shown steps can used to reproduce the issue without table-drops.
> {noformat}
> hbase(main):005:0> create 't2','cf'
> Created table t2
> Took 0.7619 seconds
> => Hbase::Table - t2
> hbase(main):006:0> set_quota TYPE => THROTTLE, TABLE => 't2', LIMIT => 
> '10M/sec'
> Took 0.0514 seconds
> hbase(main):007:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0162 seconds
> hbase(main):008:0> list_quotas
> OWNER  QUOTAS
>  TABLE => t2   TYPE => THROTTLE, THROTTLE_TYPE => REQUEST_SIZE, 
> LIMIT => 10M/sec, SCOPE =>
>MACHINE
>  TABLE => t2   TYPE => SPACE, TABLE => t2, LIMIT => 1073741824, 
> VIOLATION_POLICY => NO_WRIT
>ES
> 2 row(s)
> Took 0.0716 seconds
> hbase(main):009:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => NONE
> Took 0.0082 seconds
> hbase(main):010:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0254 seconds
> hbase(main):011:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0082 seconds
> hbase(main):012:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0411 seconds
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21500) Jetty aliases parameter need to change as per jetty 9.x version

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740798#comment-16740798
 ] 

Josh Elser commented on HBASE-21500:


[~nihaljain.cs], what does this property do? We have no test coverage for 
whatever is being exposed?

> Jetty aliases parameter need to change as per jetty 9.x version
> ---
>
> Key: HBASE-21500
> URL: https://issues.apache.org/jira/browse/HBASE-21500
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 3.0.0, 2.1.0, 2.0.0, 2.0.1, 2.1.1
>Reporter: Bhupendra Kumar Jain
>Assignee: Nihal Jain
>Priority: Minor
> Fix For: 3.0.0
>
> Attachments: HBASE-21500.master.001.patch
>
>
> Noticed that Jetty aliases parameter in HttpServer.java  
> "*org.mortbay.jetty.servlet.Default.aliases*" is as per old jetty version and 
>  need to change as per jetty 9.x new version after the HBASE-12894
> Refer 
> https://github.com/apache/hbase/blob/405bf5e6383a09f435baadbac6c389e9f6c43ac6/hbase-http/src/main/java/org/apache/hadoop/hbase/http/HttpServer.java#L647
> It should be *"org.eclipse.jetty.servlet.Default.aliases"* 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Sakthi (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sakthi updated HBASE-21225:
---
Attachment: hbase-21225.master.005.patch

> Having RPC & Space quota on a table/Namespace doesn't allow space quota to be 
> removed using 'NONE'
> --
>
> Key: HBASE-21225
> URL: https://issues.apache.org/jira/browse/HBASE-21225
> Project: HBase
>  Issue Type: Bug
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Major
> Attachments: hbase-21225.master.001.patch, 
> hbase-21225.master.002.patch, hbase-21225.master.003.patch, 
> hbase-21225.master.004.patch, hbase-21225.master.005.patch
>
>
> A part of HBASE-20705 is still unresolved. In that Jira it was assumed that 
> problem is: when table having both rpc & space quotas is dropped (with 
> hbase.quota.remove.on.table.delete set as true), the rpc quota is not set to 
> be dropped along with table-drops, and space quota was not being able to be 
> removed completely because of the "EMPTY" row that rpc quota left even after 
> removing. 
> The proposed solution for that was to make sure that rpc quota didn't leave 
> empty rows after removal of quota. And setting automatic removal of rpc quota 
> with table drops. That made sure that space quotas can be recreated/removed.
> But all this was under the assumption that hbase.quota.remove.on.table.delete 
> is set as true. When it is set as false, the same issue can reproduced. Also 
> the below shown steps can used to reproduce the issue without table-drops.
> {noformat}
> hbase(main):005:0> create 't2','cf'
> Created table t2
> Took 0.7619 seconds
> => Hbase::Table - t2
> hbase(main):006:0> set_quota TYPE => THROTTLE, TABLE => 't2', LIMIT => 
> '10M/sec'
> Took 0.0514 seconds
> hbase(main):007:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0162 seconds
> hbase(main):008:0> list_quotas
> OWNER  QUOTAS
>  TABLE => t2   TYPE => THROTTLE, THROTTLE_TYPE => REQUEST_SIZE, 
> LIMIT => 10M/sec, SCOPE =>
>MACHINE
>  TABLE => t2   TYPE => SPACE, TABLE => t2, LIMIT => 1073741824, 
> VIOLATION_POLICY => NO_WRIT
>ES
> 2 row(s)
> Took 0.0716 seconds
> hbase(main):009:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => NONE
> Took 0.0082 seconds
> hbase(main):010:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0254 seconds
> hbase(main):011:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0082 seconds
> hbase(main):012:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0411 seconds
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21706) Inconsistency of fs.defaultFS between active and standby masters

2019-01-11 Thread Lei Chen (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Chen updated HBASE-21706:
-
Description: 
I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and 
standby masters have different `fs.defaultFS` on their /conf pages.
 Given `fs.defaultFS` is set to : and `hbase.rootdir` is set 
to :/ in core-site.xml on all the hosts, it looks 
like standby masters has `fs.defaultFS` programatically set to the same value 
as `hbase.rootdir`. 

For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
following line on the /conf page
{code:java}
fs.defaultFShdfs://DEV-CLUSTERprogramatically
{code}
but standby masters has 
{code:java}
fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}
Please correct me if this is not a bug but a feature, but I find this behavior 
surprising plus I cannot locate any related document.

>From a quick looking at the code, the cause seems to be that standby masters 
>got the property set in 
>[HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
> and active master got it set in a different way in 
>[MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].

  was:
I'm using HDP-2.3.6.22-1 with HBase HA configured. I noticed that active and 
standby masters have different `fs.defaultFS` on their /conf pages.
Given `fs.defaultFS` is set to : and `hbase.rootdir` is set 
to :/ in core-site.xml on all the hosts, it looks 
like standby masters has `fs.defaultFS` programatically set to the same value 
as `hbase.rootdir`. 

For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
following line on the /conf page
{code:java}
fs.defaultFShdfs://DEV-CLUSTERprogramatically
{code}
but standby masters has 
{code:java}
fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}

Please correct me if this is not a bug but a feature, but I find this behavior 
surprising plus I cannot locate any related document.

>From a quick looking at the code, the cause seems to be that standby masters 
>got the property set in 
>[HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
> and active master got it set in a different way in 
>[MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].


> Inconsistency of fs.defaultFS between active and standby masters
> 
>
> Key: HBASE-21706
> URL: https://issues.apache.org/jira/browse/HBASE-21706
> Project: HBase
>  Issue Type: Bug
>  Components: conf, master
>Affects Versions: 1.1.2
>Reporter: Lei Chen
>Priority: Minor
>
> I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and 
> standby masters have different `fs.defaultFS` on their /conf pages.
>  Given `fs.defaultFS` is set to : and `hbase.rootdir` is 
> set to :/ in core-site.xml on all the hosts, it 
> looks like standby masters has `fs.defaultFS` programatically set to the same 
> value as `hbase.rootdir`. 
> For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
> following line on the /conf page
> {code:java}
> fs.defaultFShdfs://DEV-CLUSTERprogramatically
> {code}
> but standby masters has 
> {code:java}
> fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}
> Please correct me if this is not a bug but a feature, but I find this 
> behavior surprising plus I cannot locate any related document.
> From a quick looking at the code, the cause seems to be that standby masters 
> got the property set in 
> [HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
>  and active master got it set in a different way in 
> [MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HBASE-21706) Inconsistency of fs.defaultFS between active and standby masters

2019-01-11 Thread Lei Chen (JIRA)
Lei Chen created HBASE-21706:


 Summary: Inconsistency of fs.defaultFS between active and standby 
masters
 Key: HBASE-21706
 URL: https://issues.apache.org/jira/browse/HBASE-21706
 Project: HBase
  Issue Type: Bug
  Components: conf, master
Affects Versions: 1.1.2
Reporter: Lei Chen


I'm using HDP-2.3.6.22-1 with HBase HA configured. I noticed that active and 
standby masters have different `fs.defaultFS` on their /conf pages.
Given `fs.defaultFS` is set to : and `hbase.rootdir` is set 
to :/ in core-site.xml on all the hosts, it looks 
like standby masters has `fs.defaultFS` programatically set to the same value 
as `hbase.rootdir`. 

For example, on a 3 heads cluster DEV-CLUSTER, my active master has the 
following line on the /conf page
{code:java}
fs.defaultFShdfs://DEV-CLUSTERprogramatically
{code}
but standby masters has 
{code:java}
fs.defaultFShdfs://DEV-CLUSTER/hbase-rootprogramatically{code}

Please correct me if this is not a bug but a feature, but I find this behavior 
surprising plus I cannot locate any related document.

>From a quick looking at the code, the cause seems to be that standby masters 
>got the property set in 
>[HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
> and active master got it set in a different way in 
>[MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740766#comment-16740766
 ] 

Josh Elser commented on HBASE-21225:


[~jatsakthi], the current patch looks OK, but I can't help but feel like you 
have removed test coverage for just a space quota and just a throttle quota. 
Normally I wouldn't care too much because deleting a space/throttle in the case 
where there are also other quotas is more complicated, but we've had "broken" 
logic around this once already.

Can we restore {{testTableSpaceQuotaRemoved}} and {{testTableRPCQuotaRemoved}}?

> Having RPC & Space quota on a table/Namespace doesn't allow space quota to be 
> removed using 'NONE'
> --
>
> Key: HBASE-21225
> URL: https://issues.apache.org/jira/browse/HBASE-21225
> Project: HBase
>  Issue Type: Bug
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Major
> Attachments: hbase-21225.master.001.patch, 
> hbase-21225.master.002.patch, hbase-21225.master.003.patch, 
> hbase-21225.master.004.patch
>
>
> A part of HBASE-20705 is still unresolved. In that Jira it was assumed that 
> problem is: when table having both rpc & space quotas is dropped (with 
> hbase.quota.remove.on.table.delete set as true), the rpc quota is not set to 
> be dropped along with table-drops, and space quota was not being able to be 
> removed completely because of the "EMPTY" row that rpc quota left even after 
> removing. 
> The proposed solution for that was to make sure that rpc quota didn't leave 
> empty rows after removal of quota. And setting automatic removal of rpc quota 
> with table drops. That made sure that space quotas can be recreated/removed.
> But all this was under the assumption that hbase.quota.remove.on.table.delete 
> is set as true. When it is set as false, the same issue can reproduced. Also 
> the below shown steps can used to reproduce the issue without table-drops.
> {noformat}
> hbase(main):005:0> create 't2','cf'
> Created table t2
> Took 0.7619 seconds
> => Hbase::Table - t2
> hbase(main):006:0> set_quota TYPE => THROTTLE, TABLE => 't2', LIMIT => 
> '10M/sec'
> Took 0.0514 seconds
> hbase(main):007:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0162 seconds
> hbase(main):008:0> list_quotas
> OWNER  QUOTAS
>  TABLE => t2   TYPE => THROTTLE, THROTTLE_TYPE => REQUEST_SIZE, 
> LIMIT => 10M/sec, SCOPE =>
>MACHINE
>  TABLE => t2   TYPE => SPACE, TABLE => t2, LIMIT => 1073741824, 
> VIOLATION_POLICY => NO_WRIT
>ES
> 2 row(s)
> Took 0.0716 seconds
> hbase(main):009:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => NONE
> Took 0.0082 seconds
> hbase(main):010:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0254 seconds
> hbase(main):011:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0082 seconds
> hbase(main):012:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0411 seconds
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Sakthi (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740761#comment-16740761
 ] 

Sakthi commented on HBASE-21225:


How does the patch look [~elserj]? Any further scope for improvements?

> Having RPC & Space quota on a table/Namespace doesn't allow space quota to be 
> removed using 'NONE'
> --
>
> Key: HBASE-21225
> URL: https://issues.apache.org/jira/browse/HBASE-21225
> Project: HBase
>  Issue Type: Bug
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Major
> Attachments: hbase-21225.master.001.patch, 
> hbase-21225.master.002.patch, hbase-21225.master.003.patch, 
> hbase-21225.master.004.patch
>
>
> A part of HBASE-20705 is still unresolved. In that Jira it was assumed that 
> problem is: when table having both rpc & space quotas is dropped (with 
> hbase.quota.remove.on.table.delete set as true), the rpc quota is not set to 
> be dropped along with table-drops, and space quota was not being able to be 
> removed completely because of the "EMPTY" row that rpc quota left even after 
> removing. 
> The proposed solution for that was to make sure that rpc quota didn't leave 
> empty rows after removal of quota. And setting automatic removal of rpc quota 
> with table drops. That made sure that space quotas can be recreated/removed.
> But all this was under the assumption that hbase.quota.remove.on.table.delete 
> is set as true. When it is set as false, the same issue can reproduced. Also 
> the below shown steps can used to reproduce the issue without table-drops.
> {noformat}
> hbase(main):005:0> create 't2','cf'
> Created table t2
> Took 0.7619 seconds
> => Hbase::Table - t2
> hbase(main):006:0> set_quota TYPE => THROTTLE, TABLE => 't2', LIMIT => 
> '10M/sec'
> Took 0.0514 seconds
> hbase(main):007:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0162 seconds
> hbase(main):008:0> list_quotas
> OWNER  QUOTAS
>  TABLE => t2   TYPE => THROTTLE, THROTTLE_TYPE => REQUEST_SIZE, 
> LIMIT => 10M/sec, SCOPE =>
>MACHINE
>  TABLE => t2   TYPE => SPACE, TABLE => t2, LIMIT => 1073741824, 
> VIOLATION_POLICY => NO_WRIT
>ES
> 2 row(s)
> Took 0.0716 seconds
> hbase(main):009:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => NONE
> Took 0.0082 seconds
> hbase(main):010:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0254 seconds
> hbase(main):011:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0082 seconds
> hbase(main):012:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0411 seconds
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740756#comment-16740756
 ] 

Josh Elser commented on HBASE-21702:


{quote}On the current website I don't even see how to get to the hbasecon 
archive landing page.
{quote}
Yeah, ClayB contributed some HTML direct to us that bypasses the normal site 
build (didn't want to look that gift horse in the mouth)

Will take some more time to slice and dice what we have to be a bit more 
"normal".

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21208) Bytes#toShort doesn't work without unsafe

2019-01-11 Thread Andrew Purtell (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-21208:
---
Fix Version/s: 1.5.0

> Bytes#toShort doesn't work without unsafe
> -
>
> Key: HBASE-21208
> URL: https://issues.apache.org/jira/browse/HBASE-21208
> Project: HBase
>  Issue Type: Bug
>Reporter: Chia-Ping Tsai
>Assignee: Chia-Ping Tsai
>Priority: Critical
> Fix For: 1.5.0, 2.2.0, 2.1.1, 2.0.3
>
> Attachments: HBASE-21208.v0.patch, HBASE-21208.v1.patch, 
> HBASE-21208.v2.patch
>
>
> seems we put the brackets in the wrong place.
> {code}
>   short n = 0;
>   n = (short) ((n ^ bytes[offset]) & 0xFF);
>   n = (short) (n << 8);
>   n = (short) ((n ^ bytes[offset+1]) & 0xFF);   // this one
>   return n;
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20928) Rewrite calculation of midpoint in binarySearch functions to prevent overflow

2019-01-11 Thread Andrew Purtell (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-20928:
---
Fix Version/s: 1.5.0

> Rewrite calculation of midpoint in binarySearch functions to prevent overflow
> -
>
> Key: HBASE-20928
> URL: https://issues.apache.org/jira/browse/HBASE-20928
> Project: HBase
>  Issue Type: Bug
>  Components: io
>Reporter: saurabh singh
>Assignee: saurabh singh
>Priority: Minor
> Fix For: 1.5.0, 2.2.0
>
> Attachments: HBASE-20928-addendum.patch, 
> HBASE-20928-fix-binarySearch-v5.patch, HBASE-20928-fix-binarySearch-v5.patch
>
>
> There are couple of issues in the function:
>  * {{>>>}} operator would mess the values if {{low}} + {{high}} end up being 
> negative. This shouldn't happen but I don't see anything to prevent this from 
> happening.
>  * The code fails around boundary values of {{low}} and {{high}}. This is a 
> well known binary search catch. 
> [https://ai.googleblog.com/2006/06/extra-extra-read-all-about-it-nearly.html]
>  
> Most of the code should already be covered by tests. I would have liked to 
> add a test that actually fails without the fix but given these are private 
> methods I am not sure on the best place to add the test. Suggestions?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread Sean Busbey (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740726#comment-16740726
 ] 

Sean Busbey commented on HBASE-21702:
-

wouldn't updating the website still require a patch? On the current website I 
don't even see how to get to the hbasecon archive landing page.

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-20716) Unsafe access cleanup

2019-01-11 Thread Andrew Purtell (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-20716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Purtell updated HBASE-20716:
---
Fix Version/s: 1.5.0

> Unsafe access cleanup
> -
>
> Key: HBASE-20716
> URL: https://issues.apache.org/jira/browse/HBASE-20716
> Project: HBase
>  Issue Type: Sub-task
>  Components: Performance
>Reporter: stack
>Assignee: Sahil Aggarwal
>Priority: Critical
>  Labels: beginner
> Fix For: 3.0.0, 1.5.0, 2.2.0, 2.1.1
>
> Attachments: HBASE-20716.master.001.patch, 
> HBASE-20716.master.002.patch, HBASE-20716.master.003.patch, 
> HBASE-20716.master.004.patch, HBASE-20716.master.005.patch, 
> HBASE-20716.master.006.patch, HBASE-20716.master.007.patch, 
> HBASE-20716.master.008.patch, Screen Shot 2018-06-26 at 11.37.49 AM.png
>
>
> We have two means of getting at unsafe; UnsafeAccess and then internal to the 
> Bytes class. They are effectively doing the same thing. We should have one 
> avenue to Unsafe only.
> Many of our paths to Unsafe via UnsafeAccess traverse flags to check if 
> access is available, if it is aligned and the order in which words are 
> written on the machine. Each check costs -- especially if done millions of 
> times a second -- and on occasion adds bloat in hot code paths. The unsafe 
> access inside Bytes checks on startup what the machine is capable off and 
> then does a static assign of the appropriate class-to-use from there on out. 
> UnsafeAccess does not do this running the checks everytime. Would be good to 
> have the Bytes behavior pervasive.
> The benefit of one access to Unsafe only is plain. The benefits we gain 
> removing checks will be harder to measure though should be plain when you 
> disassemble a hot-path; in a (very) rare case, the saved byte codes could be 
> the difference between inlining or not.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread stack (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740739#comment-16740739
 ] 

stack commented on HBASE-21702:
---

Content is great.

Yeah, updating hbasecon pages requires patch?

Our poor old hbasecon archive/pages need love too

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740709#comment-16740709
 ] 

Josh Elser commented on HBASE-21225:


{quote}the reason I was trying to remove the "remove" attribute was, I saw that 
throttle quota's implementation didn't seem to have a "remove" attribute and 
wanted to keep both the implementations as similar as possible
{quote}
IMO, the implementation of the ThrottleQuota is strange. It's really 
complicated for no apparent reason to me :). It's not a gold-standard to hold 
other code to for me.

> Having RPC & Space quota on a table/Namespace doesn't allow space quota to be 
> removed using 'NONE'
> --
>
> Key: HBASE-21225
> URL: https://issues.apache.org/jira/browse/HBASE-21225
> Project: HBase
>  Issue Type: Bug
>Reporter: Sakthi
>Assignee: Sakthi
>Priority: Major
> Attachments: hbase-21225.master.001.patch, 
> hbase-21225.master.002.patch, hbase-21225.master.003.patch, 
> hbase-21225.master.004.patch
>
>
> A part of HBASE-20705 is still unresolved. In that Jira it was assumed that 
> problem is: when table having both rpc & space quotas is dropped (with 
> hbase.quota.remove.on.table.delete set as true), the rpc quota is not set to 
> be dropped along with table-drops, and space quota was not being able to be 
> removed completely because of the "EMPTY" row that rpc quota left even after 
> removing. 
> The proposed solution for that was to make sure that rpc quota didn't leave 
> empty rows after removal of quota. And setting automatic removal of rpc quota 
> with table drops. That made sure that space quotas can be recreated/removed.
> But all this was under the assumption that hbase.quota.remove.on.table.delete 
> is set as true. When it is set as false, the same issue can reproduced. Also 
> the below shown steps can used to reproduce the issue without table-drops.
> {noformat}
> hbase(main):005:0> create 't2','cf'
> Created table t2
> Took 0.7619 seconds
> => Hbase::Table - t2
> hbase(main):006:0> set_quota TYPE => THROTTLE, TABLE => 't2', LIMIT => 
> '10M/sec'
> Took 0.0514 seconds
> hbase(main):007:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0162 seconds
> hbase(main):008:0> list_quotas
> OWNER  QUOTAS
>  TABLE => t2   TYPE => THROTTLE, THROTTLE_TYPE => REQUEST_SIZE, 
> LIMIT => 10M/sec, SCOPE =>
>MACHINE
>  TABLE => t2   TYPE => SPACE, TABLE => t2, LIMIT => 1073741824, 
> VIOLATION_POLICY => NO_WRIT
>ES
> 2 row(s)
> Took 0.0716 seconds
> hbase(main):009:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => NONE
> Took 0.0082 seconds
> hbase(main):010:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0254 seconds
> hbase(main):011:0> set_quota TYPE => SPACE, TABLE => 't2', LIMIT => '1G', 
> POLICY => NO_WRITES
> Took 0.0082 seconds
> hbase(main):012:0> list_quotas
> OWNER   QUOTAS
>  TABLE => t2TYPE => THROTTLE, THROTTLE_TYPE => 
> REQUEST_SIZE, LIMIT => 10M/sec, SCOPE => MACHINE
>  TABLE => t2TYPE => SPACE, TABLE => t2, REMOVE => true
> 2 row(s)
> Took 0.0411 seconds
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740707#comment-16740707
 ] 

Josh Elser commented on HBASE-21702:


You happy with the content as presented, [~stack]?

Assuming no further chatter, I'll just close this out and update the website.

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread stack (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740701#comment-16740701
 ] 

stack commented on HBASE-21702:
---

bq. Where you thinking instead of the book Stack? Maybe on the HBaseCon archive 
part of the website?

I think this a good idea.

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740652#comment-16740652
 ] 

Hudson commented on HBASE-21704:


Results for branch branch-2.1
[build #762 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/762/]: 
(/) *{color:green}+1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/762//General_Nightly_Build_Report/]




(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/762//JDK8_Nightly_Build_Report_(Hadoop2)/]


(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/762//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> The implementation of DistributedHBaseCluster.getServerHoldingRegion is 
> incorrect
> -
>
> Key: HBASE-21704
> URL: https://issues.apache.org/jira/browse/HBASE-21704
> Project: HBase
>  Issue Type: Bug
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21704.patch
>
>
> The parameter is a regionName, but in the method, it will get a region 
> locator for the table, and pass the use the regionName to locate the region, 
> but actually, the parameter of the getRegionLocation method is row, not 
> regionName...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21663) Add replica scan support

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740644#comment-16740644
 ] 

Hudson commented on HBASE-21663:


Results for branch branch-2
[build #1604 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//JDK8_Nightly_Build_Report_(Hadoop2)/]


(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Add replica scan support
> 
>
> Key: HBASE-21663
> URL: https://issues.apache.org/jira/browse/HBASE-21663
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, read replicas
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21663-v1.patch, HBASE-21663.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740645#comment-16740645
 ] 

Hudson commented on HBASE-21704:


Results for branch branch-2
[build #1604 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//JDK8_Nightly_Build_Report_(Hadoop2)/]


(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> The implementation of DistributedHBaseCluster.getServerHoldingRegion is 
> incorrect
> -
>
> Key: HBASE-21704
> URL: https://issues.apache.org/jira/browse/HBASE-21704
> Project: HBase
>  Issue Type: Bug
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21704.patch
>
>
> The parameter is a regionName, but in the method, it will get a region 
> locator for the table, and pass the use the regionName to locate the region, 
> but actually, the parameter of the getRegionLocation method is row, not 
> regionName...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21580) Support getting Hbck instance from AsyncConnection

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740643#comment-16740643
 ] 

Hudson commented on HBASE-21580:


Results for branch branch-2
[build #1604 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//JDK8_Nightly_Build_Report_(Hadoop2)/]


(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1604//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Support getting Hbck instance from AsyncConnection
> --
>
> Key: HBASE-21580
> URL: https://issues.apache.org/jira/browse/HBASE-21580
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, hbck2
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21580.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21295) Update compatibility matrices

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740633#comment-16740633
 ] 

Hudson commented on HBASE-21295:


Results for branch master
[build #714 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/714/]: (x) 
*{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/714//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/714//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/714//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Update compatibility matrices
> -
>
> Key: HBASE-21295
> URL: https://issues.apache.org/jira/browse/HBASE-21295
> Project: HBase
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 3.0.0
>Reporter: Peter Somogyi
>Assignee: Peter Somogyi
>Priority: Minor
> Attachments: HBASE-21295-v1.patch, HBASE-21295-v2.patch, 
> HBASE-21295.master.001.patch
>
>
> JDK and Hadoop compatibility matrices does not cover all of the current 
> releases and available JDKs. These should be added to both tables.
> [https://hbase.apache.org/book.html#hadoop]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740634#comment-16740634
 ] 

Hudson commented on HBASE-21704:


Results for branch master
[build #714 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/714/]: (x) 
*{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/714//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/714//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/714//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> The implementation of DistributedHBaseCluster.getServerHoldingRegion is 
> incorrect
> -
>
> Key: HBASE-21704
> URL: https://issues.apache.org/jira/browse/HBASE-21704
> Project: HBase
>  Issue Type: Bug
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21704.patch
>
>
> The parameter is a regionName, but in the method, it will get a region 
> locator for the table, and pass the use the regionName to locate the region, 
> but actually, the parameter of the getRegionLocation method is row, not 
> regionName...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21512) Introduce an AsyncClusterConnection and replace the usage of ClusterConnection

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740623#comment-16740623
 ] 

Hudson commented on HBASE-21512:


Results for branch HBASE-21512
[build #50 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-21512/50/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-21512/50//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-21512/50//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-21512/50//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Introduce an AsyncClusterConnection and replace the usage of ClusterConnection
> --
>
> Key: HBASE-21512
> URL: https://issues.apache.org/jira/browse/HBASE-21512
> Project: HBase
>  Issue Type: Umbrella
>Reporter: Duo Zhang
>Priority: Major
> Fix For: 3.0.0
>
>
> At least for the RSProcedureDispatcher, with CompletableFuture we do not need 
> to set a delay and use a thread pool any more, which could reduce the 
> resource usage and also the latency.
> Once this is done, I think we can remove the ClusterConnection completely, 
> and start to rewrite the old sync client based on the async client, which 
> could reduce the code base a lot for our client.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21596) HBase Shell "delete" command can cause older versions to be shown even if VERSIONS is configured as 1

2019-01-11 Thread Sean Busbey (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740611#comment-16740611
 ] 

Sean Busbey commented on HBASE-21596:
-

is this fall out from the changes in HBASE-18142?

> HBase Shell "delete" command can cause older versions to be shown even if 
> VERSIONS is configured as 1
> -
>
> Key: HBASE-21596
> URL: https://issues.apache.org/jira/browse/HBASE-21596
> Project: HBase
>  Issue Type: Bug
>Reporter: Wellington Chevreuil
>Assignee: Wellington Chevreuil
>Priority: Minor
> Attachments: HBASE-21596-master.001.patch, initial-patch.txt
>
>
> HBase Shell delete command is supposed to operate over an specific TS. If no 
> TS is informed, it will assume the latest TS for the cell and put delete 
> marker for it. 
> However, for a CF with VERSIONS => 1, if multiple puts were performed for 
> same cell, there may be multiple cell versions on the memstore, so delete 
> would only be "delete marking" one of those, and causing the most recent no 
> marked one to be shown on gets/scans, which then contradicts the CF "VERSIONS 
> => 1" configuration.
> This issue is not seen with deleteall command or using Delete operation from 
> Java API.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740615#comment-16740615
 ] 

Hudson commented on HBASE-21704:


Results for branch branch-2.0
[build #1246 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1246/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1246//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1246//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1246//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


> The implementation of DistributedHBaseCluster.getServerHoldingRegion is 
> incorrect
> -
>
> Key: HBASE-21704
> URL: https://issues.apache.org/jira/browse/HBASE-21704
> Project: HBase
>  Issue Type: Bug
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21704.patch
>
>
> The parameter is a regionName, but in the method, it will get a region 
> locator for the table, and pass the use the regionName to locate the region, 
> but actually, the parameter of the getRegionLocation method is row, not 
> regionName...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread Sean Busbey (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740606#comment-16740606
 ] 

Sean Busbey commented on HBASE-21702:
-

I like the additional text.

Where you thinking instead of the book Stack? Maybe on the HBaseCon archive 
part of the website?


> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740601#comment-16740601
 ] 

Hadoop QA commented on HBASE-21702:
---

| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
12s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
44s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue}  5m 
38s{color} | {color:blue} branch has no errors when building the reference 
guide. See footer for rendered docs, which you should manually inspect. {color} 
|
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue}  6m  
8s{color} | {color:blue} patch has no errors when building the reference guide. 
See footer for rendered docs, which you should manually inspect. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
13s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 22m  8s{color} | 
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21702 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954611/HBASE-21702.002.patch 
|
| Optional Tests |  dupname  asflicense  refguide  |
| uname | Linux 34c6e78ab662 4.4.0-139-generic #165~14.04.1-Ubuntu SMP Wed Oct 
31 10:55:11 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
 |
| git revision | master / 3d2580cd6d |
| maven | version: Apache Maven 3.5.4 
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| refguide | 
https://builds.apache.org/job/PreCommit-HBASE-Build/15545/artifact/patchprocess/branch-site/book.html
 |
| refguide | 
https://builds.apache.org/job/PreCommit-HBASE-Build/15545/artifact/patchprocess/patch-site/book.html
 |
| Max. process+thread count | 87 (vs. ulimit of 1) |
| modules | C: . U: . |
| Console output | 
https://builds.apache.org/job/PreCommit-HBASE-Build/15545/console |
| Powered by | Apache Yetus 0.8.0   http://yetus.apache.org |


This message was automatically generated.



> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740584#comment-16740584
 ] 

Josh Elser commented on HBASE-21702:


My thought was that book is easier to maintain than the website itself. Putting 
it on the website instead of book is fine – I don't carry much distinction 
between the two.

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread Josh Elser (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Josh Elser updated HBASE-21702:
---
Attachment: HBASE-21702.002.patch

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread stack (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740581#comment-16740581
 ] 

stack commented on HBASE-21702:
---

Should this be in the book? The audience for this is minuscule?

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch, HBASE-21702.002.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21580) Support getting Hbck instance from AsyncConnection

2019-01-11 Thread stack (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740580#comment-16740580
 ] 

stack commented on HBASE-21580:
---

+1

Do we have to make change in hbase-operator-tools to make use of this or is 
that just later?

> Support getting Hbck instance from AsyncConnection
> --
>
> Key: HBASE-21580
> URL: https://issues.apache.org/jira/browse/HBASE-21580
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, hbck2
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21580.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21663) Add replica scan support

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740540#comment-16740540
 ] 

Hudson commented on HBASE-21663:


Results for branch branch-2.1
[build #761 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/761/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/761//General_Nightly_Build_Report/]




(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/761//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/761//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Add replica scan support
> 
>
> Key: HBASE-21663
> URL: https://issues.apache.org/jira/browse/HBASE-21663
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, read replicas
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21663-v1.patch, HBASE-21663.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21580) Support getting Hbck instance from AsyncConnection

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740539#comment-16740539
 ] 

Hudson commented on HBASE-21580:


Results for branch branch-2.1
[build #761 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/761/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/761//General_Nightly_Build_Report/]




(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/761//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/761//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Support getting Hbck instance from AsyncConnection
> --
>
> Key: HBASE-21580
> URL: https://issues.apache.org/jira/browse/HBASE-21580
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, hbck2
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21580.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21663) Add replica scan support

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740537#comment-16740537
 ] 

Hudson commented on HBASE-21663:


Results for branch branch-2.0
[build #1245 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1245/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1245//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1245//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1245//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


> Add replica scan support
> 
>
> Key: HBASE-21663
> URL: https://issues.apache.org/jira/browse/HBASE-21663
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, read replicas
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21663-v1.patch, HBASE-21663.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21580) Support getting Hbck instance from AsyncConnection

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740536#comment-16740536
 ] 

Hudson commented on HBASE-21580:


Results for branch branch-2.0
[build #1245 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1245/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1245//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1245//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1245//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


> Support getting Hbck instance from AsyncConnection
> --
>
> Key: HBASE-21580
> URL: https://issues.apache.org/jira/browse/HBASE-21580
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, hbck2
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21580.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21702) Transcribe "what is HBaseCon" into book

2019-01-11 Thread Josh Elser (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740532#comment-16740532
 ] 

Josh Elser commented on HBASE-21702:


{quote}I think it would really benefit from adding a sentence to the intro that 
essentially says "folks who are interested in hosting a future HBaseCon event 
should keep the following guidelines in mind and email the PMC via the mailing 
list priv...@hbase.apache.org, which allows anyone to send messages, but 
restricts who can read them"
{quote}
Just meant this to be a starting-point. Thanks for the suggestion. Let me try 
to edit.

> Transcribe "what is HBaseCon" into book
> ---
>
> Key: HBASE-21702
> URL: https://issues.apache.org/jira/browse/HBASE-21702
> Project: HBase
>  Issue Type: Task
>  Components: documentation
>Reporter: Josh Elser
>Assignee: Josh Elser
>Priority: Major
> Attachments: HBASE-21702.001.patch
>
>
> Take the document I wrote on google docs 
> (https://docs.google.com/document/d/15ZmgNKSzyR_UCzOmHEACnGZp-vuh-QlCYfr6bCmQ-4w/edit)
>  and get it into the HBase book.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740502#comment-16740502
 ] 

Hadoop QA commented on HBASE-21705:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
11s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
13s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
 6s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
32s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
37s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
12s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m  
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
51s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
16s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
11s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
30s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red}  1m 52s{color} 
| {color:red} hbase-server generated 1 new + 187 unchanged - 1 fixed = 188 
total (was 188) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red}  1m  
4s{color} | {color:red} hbase-server: The patch generated 4 new + 3 unchanged - 
0 fixed = 7 total (was 3) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
13s{color} | {color:green} patch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}  
8m 37s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m 
14s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
50s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  3m 
18s{color} | {color:green} hbase-client in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green}130m  
8s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
52s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}177m 16s{color} | 
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21705 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954584/HBASE-21705.patch |
| Optional Tests |  dupname  asflicense  javac  javadoc  unit  findbugs  
shadedjars  hadoopcheck  hbaseanti  checkstyle  compile  |
| uname | Linux be2d499d8580 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 
17:16:02 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
 |
| git revision | master / fbf79373e6 |
| maven | version: Apache Maven 3.5.4 

[jira] [Commented] (HBASE-21537) Rewrite ServerManager.closeRegionSilentlyAndWait to use AsyncClusterConnection

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740470#comment-16740470
 ] 

Hadoop QA commented on HBASE-21537:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
11s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange}  
0m  0s{color} | {color:orange} The patch doesn't appear to include any new or 
modified tests. Please justify why no new tests are needed for this patch. Also 
please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} HBASE-21512 Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
51s{color} | {color:green} HBASE-21512 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m  
2s{color} | {color:green} HBASE-21512 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
13s{color} | {color:green} HBASE-21512 passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
36s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  2m 
19s{color} | {color:green} HBASE-21512 passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
31s{color} | {color:green} HBASE-21512 passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m 
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  1m 
59s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red}  1m 
15s{color} | {color:red} hbase-server: The patch generated 3 new + 20 unchanged 
- 2 fixed = 23 total (was 22) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
34s{color} | {color:green} patch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}  
9m 40s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  2m 
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
31s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}136m 35s{color} 
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
23s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}178m  9s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.replication.TestSyncReplicationActive |
|   | hadoop.hbase.master.TestRestartCluster |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21537 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954579/HBASE-21537-HBASE-21512.patch
 |
| Optional Tests |  dupname  asflicense  javac  javadoc  unit  findbugs  
shadedjars  hadoopcheck  hbaseanti  checkstyle  compile  |
| uname | Linux 590dcf7f2bee 4.4.0-139-generic #165~14.04.1-Ubuntu SMP Wed Oct 
31 10:55:11 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
 |
| git revision | HBASE-21512 / d6fbe51363 |
| maven | version: Apache Maven 3.5.4 
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_181 |
| findbugs | v3.1.0-RC3 |
| checkstyle | 

[jira] [Commented] (HBASE-21019) Use StealJobQueue to better utilize handlers in MasterFifoRpcScheduler

2019-01-11 Thread Guanghao Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740401#comment-16740401
 ] 

Guanghao Zhang commented on HBASE-21019:


Ping [~Apache9] [~stack] for reviewing.

> Use StealJobQueue to better utilize handlers in MasterFifoRpcScheduler
> --
>
> Key: HBASE-21019
> URL: https://issues.apache.org/jira/browse/HBASE-21019
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 3.0.0, 2.2.0
>Reporter: Yi Mei
>Assignee: Guanghao Zhang
>Priority: Major
> Attachments: HBASE-21019.master.001.patch, 
> HBASE-21019.master.001.patch, HBASE-21019.master.001.patch
>
>
> In HBASE-20965, we propose MasterFifoRpcScheduler to handle RSReport requests 
> in independent handlers, other requests are handled in other handlers.
> To better utilize handlers, we can use StealJobQueue to allow other handlers 
> to steal jobs from RSReport handlers when there is a few RSReport handlers.
> And it's the same for SimpleRpcScheduler.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Guanghao Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740391#comment-16740391
 ] 

Guanghao Zhang commented on HBASE-21705:


+1 for others.

> Should treat meta table specially for some methods in AsyncAdmin
> 
>
> Key: HBASE-21705
> URL: https://issues.apache.org/jira/browse/HBASE-21705
> Project: HBase
>  Issue Type: Sub-task
>  Components: Admin, asyncclient, Client
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21705.patch
>
>
> For example, tableExists, isTableEnabled, isTableDisabled...
> For now, we will go to the meta table directly but obviously, meta table does 
> not contain the record for itself...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Guanghao Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740390#comment-16740390
 ] 

Guanghao Zhang commented on HBASE-21705:


There is a check for META Table in AsyncMetaTableAccessor#tableExists

> Should treat meta table specially for some methods in AsyncAdmin
> 
>
> Key: HBASE-21705
> URL: https://issues.apache.org/jira/browse/HBASE-21705
> Project: HBase
>  Issue Type: Sub-task
>  Components: Admin, asyncclient, Client
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21705.patch
>
>
> For example, tableExists, isTableEnabled, isTableDisabled...
> For now, we will go to the meta table directly but obviously, meta table does 
> not contain the record for itself...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21512) Introduce an AsyncClusterConnection and replace the usage of ClusterConnection

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740389#comment-16740389
 ] 

Hudson commented on HBASE-21512:


Results for branch HBASE-21512
[build #49 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-21512/49/]: 
(x) *{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-21512/49//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-21512/49//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/HBASE-21512/49//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Introduce an AsyncClusterConnection and replace the usage of ClusterConnection
> --
>
> Key: HBASE-21512
> URL: https://issues.apache.org/jira/browse/HBASE-21512
> Project: HBase
>  Issue Type: Umbrella
>Reporter: Duo Zhang
>Priority: Major
> Fix For: 3.0.0
>
>
> At least for the RSProcedureDispatcher, with CompletableFuture we do not need 
> to set a delay and use a thread pool any more, which could reduce the 
> resource usage and also the latency.
> Once this is done, I think we can remove the ClusterConnection completely, 
> and start to rewrite the old sync client based on the async client, which 
> could reduce the code base a lot for our client.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (HBASE-21685) Change repository urls to Gitbox

2019-01-11 Thread Peter Somogyi (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Somogyi resolved HBASE-21685.
---
Resolution: Fixed

Repositories are in sync now.

> Change repository urls to Gitbox
> 
>
> Key: HBASE-21685
> URL: https://issues.apache.org/jira/browse/HBASE-21685
> Project: HBase
>  Issue Type: Task
>Reporter: Peter Somogyi
>Assignee: Peter Somogyi
>Priority: Critical
> Fix For: 3.0.0
>
> Attachments: HBASE-21685.master.001.patch, 
> HBASE-21685.master.001.patch
>
>
> Moving to Gitbox is approaching and references to git-wip-us need to be 
> changed to gitbox.
> Some of the Jenkins jobs are referring to git-wip-us which if going to be 
> locked after the migration. We could move them to github so the build flow 
> will remain intact.
> Previous discussion on dev@: 
> [https://lists.apache.org/thread.html/3496568d6cc002f74f5c3bcce46ed44b7ee9e90d7d53af2c65b6f785@%3Cdev.hbase.apache.org%3E]
>  After this notify INFRA to make the change



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Duo Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740373#comment-16740373
 ] 

Duo Zhang commented on HBASE-21704:
---

I do not think the failed UT is related to the changes here, but maybe it is 
introduced by HBASE-21580, where we double the execution time for TestHbck. 
Will keep an eye on it.

> The implementation of DistributedHBaseCluster.getServerHoldingRegion is 
> incorrect
> -
>
> Key: HBASE-21704
> URL: https://issues.apache.org/jira/browse/HBASE-21704
> Project: HBase
>  Issue Type: Bug
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21704.patch
>
>
> The parameter is a regionName, but in the method, it will get a region 
> locator for the table, and pass the use the regionName to locate the region, 
> but actually, the parameter of the getRegionLocation method is row, not 
> regionName...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21705:
--
 Assignee: Duo Zhang
Fix Version/s: 2.0.5
   2.1.3
   2.2.0
   3.0.0
   Status: Patch Available  (was: Open)

> Should treat meta table specially for some methods in AsyncAdmin
> 
>
> Key: HBASE-21705
> URL: https://issues.apache.org/jira/browse/HBASE-21705
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21705.patch
>
>
> For example, tableExists, isTableEnabled, isTableDisabled...
> For now, we will go to the meta table directly but obviously, meta table does 
> not contain the record for itself...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21580) Support getting Hbck instance from AsyncConnection

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740354#comment-16740354
 ] 

Hudson commented on HBASE-21580:


Results for branch master
[build #713 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/713/]: (x) 
*{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/713//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/713//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/713//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Support getting Hbck instance from AsyncConnection
> --
>
> Key: HBASE-21580
> URL: https://issues.apache.org/jira/browse/HBASE-21580
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, hbck2
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21580.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21663) Add replica scan support

2019-01-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740355#comment-16740355
 ] 

Hudson commented on HBASE-21663:


Results for branch master
[build #713 on 
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/713/]: (x) 
*{color:red}-1 overall{color}*

details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/713//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/713//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) 
report|https://builds.apache.org/job/HBase%20Nightly/job/master/713//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Add replica scan support
> 
>
> Key: HBASE-21663
> URL: https://issues.apache.org/jira/browse/HBASE-21663
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client, read replicas
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21663-v1.patch, HBASE-21663.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21705:
--
Component/s: Client
 asyncclient
 Admin

> Should treat meta table specially for some methods in AsyncAdmin
> 
>
> Key: HBASE-21705
> URL: https://issues.apache.org/jira/browse/HBASE-21705
> Project: HBase
>  Issue Type: Sub-task
>  Components: Admin, asyncclient, Client
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21705.patch
>
>
> For example, tableExists, isTableEnabled, isTableDisabled...
> For now, we will go to the meta table directly but obviously, meta table does 
> not contain the record for itself...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21705:
--
Attachment: HBASE-21705.patch

> Should treat meta table specially for some methods in AsyncAdmin
> 
>
> Key: HBASE-21705
> URL: https://issues.apache.org/jira/browse/HBASE-21705
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Priority: Major
> Attachments: HBASE-21705.patch
>
>
> For example, tableExists, isTableEnabled, isTableDisabled...
> For now, we will go to the meta table directly but obviously, meta table does 
> not contain the record for itself...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740352#comment-16740352
 ] 

Hadoop QA commented on HBASE-21704:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
11s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 2 new or modified test 
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
13s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
 8s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
22s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
20s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
16s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  2m  
6s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
40s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
16s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
 9s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  2m 
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
 7s{color} | {color:green} hbase-server: The patch generated 0 new + 5 
unchanged - 1 fixed = 5 total (was 6) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
15s{color} | {color:green} The patch passed checkstyle in hbase-it {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
 8s{color} | {color:green} patch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}  
8m 49s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  2m 
16s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
40s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}132m 43s{color} 
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  1m  
1s{color} | {color:green} hbase-it in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
51s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}174m 34s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.client.TestHbck |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21704 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954565/HBASE-21704.patch |
| Optional Tests |  dupname  asflicense  javac  javadoc  unit  findbugs  
shadedjars  hadoopcheck  hbaseanti  checkstyle  compile  |
| uname | Linux 273f640fccbb 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 
17:16:02 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | 

[jira] [Created] (HBASE-21705) Should treat meta table specially for some methods in AsyncAdmin

2019-01-11 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-21705:
-

 Summary: Should treat meta table specially for some methods in 
AsyncAdmin
 Key: HBASE-21705
 URL: https://issues.apache.org/jira/browse/HBASE-21705
 Project: HBase
  Issue Type: Sub-task
Reporter: Duo Zhang


For example, tableExists, isTableEnabled, isTableDisabled...

For now, we will go to the meta table directly but obviously, meta table does 
not contain the record for itself...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21537) Rewrite ServerManager.closeRegionSilentlyAndWait to use AsyncClusterConnection

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21537:
--
Assignee: Duo Zhang
  Status: Patch Available  (was: Open)

> Rewrite ServerManager.closeRegionSilentlyAndWait to use AsyncClusterConnection
> --
>
> Key: HBASE-21537
> URL: https://issues.apache.org/jira/browse/HBASE-21537
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Attachments: HBASE-21537-HBASE-21512.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21537) Rewrite ServerManager.closeRegionSilentlyAndWait to use AsyncClusterConnection

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21537:
--
Attachment: HBASE-21537-HBASE-21512.patch

> Rewrite ServerManager.closeRegionSilentlyAndWait to use AsyncClusterConnection
> --
>
> Key: HBASE-21537
> URL: https://issues.apache.org/jira/browse/HBASE-21537
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Priority: Major
> Attachments: HBASE-21537-HBASE-21512.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21671) Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21671:
--
  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

Pushed to branch HBASE-21512. Thanks [~tianjingyun] for reviewing.

> Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection
> --
>
> Key: HBASE-21671
> URL: https://issues.apache.org/jira/browse/HBASE-21671
> Project: HBase
>  Issue Type: Sub-task
>  Components: read replicas
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Attachments: HBASE-21671-HBASE-21512-v1.patch, 
> HBASE-21671-HBASE-21512-v2.patch, HBASE-21671-HBASE-21512-v3.patch, 
> HBASE-21671-HBASE-21512.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21671) Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21671:
--
Fix Version/s: HBASE-21512

> Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection
> --
>
> Key: HBASE-21671
> URL: https://issues.apache.org/jira/browse/HBASE-21671
> Project: HBase
>  Issue Type: Sub-task
>  Components: read replicas
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: HBASE-21512
>
> Attachments: HBASE-21671-HBASE-21512-v1.patch, 
> HBASE-21671-HBASE-21512-v2.patch, HBASE-21671-HBASE-21512-v3.patch, 
> HBASE-21671-HBASE-21512.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-19695) Handle disabled table for async client

2019-01-11 Thread Duo Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-19695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740318#comment-16740318
 ] 

Duo Zhang commented on HBASE-19695:
---

OK, seems the isTableDisabled method in AsyncAdmin does not handle meta table 
correctly. Let me fix.

> Handle disabled table for async client
> --
>
> Key: HBASE-19695
> URL: https://issues.apache.org/jira/browse/HBASE-19695
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-19695-v1.patch, HBASE-19695.master.001.patch, 
> HBASE-19695.master.002.patch, HBASE-19695.patch
>
>
> Now for async client we will not check if a table is disabled when retrying, 
> so we will retry until the time or count limit is reached, and will not throw 
> a TableNotEnabledException.
> We should have the same behavior as sync client, but the implementation 
> should be carefully designed. For sync client, we will also check if a table 
> is disabled if it is a retry, no matter what the exception is. This will 
> double the pressure on meta table. We should try our best to eliminate 
> unnecessary access to meta table.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21671) Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740306#comment-16740306
 ] 

Hadoop QA commented on HBASE-21671:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
13s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 3 new or modified test 
files. {color} |
|| || || || {color:brown} HBASE-21512 Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
24s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
39s{color} | {color:green} HBASE-21512 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
43s{color} | {color:green} HBASE-21512 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
48s{color} | {color:green} HBASE-21512 passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
32s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m 
12s{color} | {color:green} HBASE-21512 passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
50s{color} | {color:green} HBASE-21512 passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
14s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
40s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red}  0m 40s{color} 
| {color:red} hbase-client generated 1 new + 99 unchanged - 1 fixed = 100 total 
(was 100) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
31s{color} | {color:green} The patch passed checkstyle in hbase-client {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
16s{color} | {color:green} hbase-server: The patch generated 0 new + 7 
unchanged - 6 fixed = 7 total (was 13) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
34s{color} | {color:green} patch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}  
9m 35s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m 
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
50s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  3m  
8s{color} | {color:green} hbase-client in the patch passed. {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red}136m 12s{color} 
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
44s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}187m  5s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.replication.TestSyncReplicationActive |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21671 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954550/HBASE-21671-HBASE-21512-v3.patch
 |
| Optional Tests |  dupname  asflicense  javac  javadoc  unit  findbugs  
shadedjars  hadoopcheck  hbaseanti  checkstyle  compile  |
| uname | Linux 108fd5b2f7d0 

[jira] [Commented] (HBASE-19695) Handle disabled table for async client

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-19695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740302#comment-16740302
 ] 

Hadoop QA commented on HBASE-19695:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
13s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
22s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
54s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
49s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
48s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
37s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m 
43s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
57s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
14s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  2m 
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
33s{color} | {color:green} hbase-client: The patch generated 0 new + 0 
unchanged - 1 fixed = 0 total (was 1) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red}  1m 
13s{color} | {color:red} hbase-server: The patch generated 2 new + 1 unchanged 
- 0 fixed = 3 total (was 1) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
32s{color} | {color:green} patch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}  
9m 47s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  4m  
2s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m  
0s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  3m 
16s{color} | {color:green} hbase-client in the patch passed. {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red}156m 39s{color} 
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
51s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}209m 48s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.client.TestAsyncTableGetMultiThreaded |
|   | hadoop.hbase.replication.TestReplicationDroppedTables |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-19695 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954546/HBASE-19695-v1.patch |
| Optional Tests |  dupname  asflicense  javac  javadoc  unit  findbugs  
shadedjars  hadoopcheck  hbaseanti  checkstyle  compile  |
| uname | Linux 80e36a932377 

[jira] [Commented] (HBASE-21225) Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'

2019-01-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740300#comment-16740300
 ] 

Hadoop QA commented on HBASE-21225:
---

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
11s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green}  0m  
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
29s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
55s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
50s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
48s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
39s{color} | {color:green} branch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  3m 
37s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
56s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
15s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  4m 
39s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m 
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  2m 
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  1m 
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green}  4m 
39s{color} | {color:green} patch has no errors when building our shaded 
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}  
9m 47s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  4m  
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  1m  
1s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}  3m 
18s{color} | {color:green} hbase-client in the patch passed. {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red}155m  9s{color} 
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
43s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}208m 20s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | 
hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL
 |
|   | 
hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleAsyncWAL
 |
|   | hadoop.hbase.replication.TestReplicationDroppedTables |
|   | hadoop.hbase.client.TestHbck |
|   | hadoop.hbase.replication.TestReplicationKillMasterRSCompressed |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21225 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12954547/hbase-21225.master.004.patch
 |
| Optional Tests |  dupname  asflicense  javac  javadoc  unit  findbugs  
shadedjars  hadoopcheck  hbaseanti  checkstyle  compile  |
| uname | Linux d1607e0b9375 

[jira] [Commented] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Guanghao Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740236#comment-16740236
 ] 

Guanghao Zhang commented on HBASE-21704:


+1

> The implementation of DistributedHBaseCluster.getServerHoldingRegion is 
> incorrect
> -
>
> Key: HBASE-21704
> URL: https://issues.apache.org/jira/browse/HBASE-21704
> Project: HBase
>  Issue Type: Bug
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21704.patch
>
>
> The parameter is a regionName, but in the method, it will get a region 
> locator for the table, and pass the use the regionName to locate the region, 
> but actually, the parameter of the getRegionLocation method is row, not 
> regionName...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Duo Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang updated HBASE-21704:
--
Fix Version/s: 2.0.5
   2.1.3
   2.2.0
   3.0.0

> The implementation of DistributedHBaseCluster.getServerHoldingRegion is 
> incorrect
> -
>
> Key: HBASE-21704
> URL: https://issues.apache.org/jira/browse/HBASE-21704
> Project: HBase
>  Issue Type: Bug
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.3, 2.0.5
>
> Attachments: HBASE-21704.patch
>
>
> The parameter is a regionName, but in the method, it will get a region 
> locator for the table, and pass the use the regionName to locate the region, 
> but actually, the parameter of the getRegionLocation method is row, not 
> regionName...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HBASE-21704) The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect

2019-01-11 Thread Duo Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/HBASE-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740226#comment-16740226
 ] 

Duo Zhang commented on HBASE-21704:
---

Pass start key instead of regionName when calling 
RegionLocator.getRegionLocation.

> The implementation of DistributedHBaseCluster.getServerHoldingRegion is 
> incorrect
> -
>
> Key: HBASE-21704
> URL: https://issues.apache.org/jira/browse/HBASE-21704
> Project: HBase
>  Issue Type: Bug
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Attachments: HBASE-21704.patch
>
>
> The parameter is a regionName, but in the method, it will get a region 
> locator for the table, and pass the use the regionName to locate the region, 
> but actually, the parameter of the getRegionLocation method is row, not 
> regionName...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


  1   2   >