[jira] [Commented] (HBASE-21785) master reports open regions as RITs and also messes up rit age metric
[ https://issues.apache.org/jira/browse/HBASE-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854638#comment-17854638 ] Hudson commented on HBASE-21785: Results for branch branch-2 [build #1077 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/General_20Nightly_20Build_20Report/] (x) {color:red}-1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > master reports open regions as RITs and also messes up rit age metric > - > > Key: HBASE-21785 > URL: https://issues.apache.org/jira/browse/HBASE-21785 > Project: HBase > Issue Type: Bug >Affects Versions: 3.0.0-alpha-1, 2.2.0 >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Fix For: 3.0.0-alpha-1, 2.2.0 > > Attachments: HBASE-21785.01.patch, HBASE-21785.patch > > > {noformat} > RegionState RIT time (ms) Retries > dba183f0dadfcc9dc8ae0a6dd59c84e6 dba183f0dadfcc9dc8ae0a6dd59c84e6. > state=OPEN, ts=Wed Dec 31 16:00:00 PST 1969 (1548453918s ago), > server=server,17020,1548452922054 1548453918735 0 > {noformat} > RIT age metric also gets set to a bogus value. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28652) Backport HBASE-21785 master reports open regions as RITs and also messes up rit age metric
[ https://issues.apache.org/jira/browse/HBASE-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854637#comment-17854637 ] Hudson commented on HBASE-28652: Results for branch branch-2 [build #1077 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/General_20Nightly_20Build_20Report/] (x) {color:red}-1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1077/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Backport HBASE-21785 master reports open regions as RITs and also messes up > rit age metric > -- > > Key: HBASE-28652 > URL: https://issues.apache.org/jira/browse/HBASE-28652 > Project: HBase > Issue Type: Sub-task >Reporter: Szucs Villo >Assignee: Szucs Villo >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 2.6.1, 2.5.9 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-21785) master reports open regions as RITs and also messes up rit age metric
[ https://issues.apache.org/jira/browse/HBASE-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854624#comment-17854624 ] Hudson commented on HBASE-21785: Results for branch branch-2.6 [build #139 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > master reports open regions as RITs and also messes up rit age metric > - > > Key: HBASE-21785 > URL: https://issues.apache.org/jira/browse/HBASE-21785 > Project: HBase > Issue Type: Bug >Affects Versions: 3.0.0-alpha-1, 2.2.0 >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Fix For: 3.0.0-alpha-1, 2.2.0 > > Attachments: HBASE-21785.01.patch, HBASE-21785.patch > > > {noformat} > RegionState RIT time (ms) Retries > dba183f0dadfcc9dc8ae0a6dd59c84e6 dba183f0dadfcc9dc8ae0a6dd59c84e6. > state=OPEN, ts=Wed Dec 31 16:00:00 PST 1969 (1548453918s ago), > server=server,17020,1548452922054 1548453918735 0 > {noformat} > RIT age metric also gets set to a bogus value. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28646) Use Streams to unmarshall protobuf REST data
[ https://issues.apache.org/jira/browse/HBASE-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854621#comment-17854621 ] Hudson commented on HBASE-28646: Results for branch branch-2.6 [build #139 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Streams to unmarshall protobuf REST data > > > Key: HBASE-28646 > URL: https://issues.apache.org/jira/browse/HBASE-28646 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > > We've recently optimized REST marshalling by using streams directly. > We should do the same for unmarshalling. > The easy part is the server side, as that affects only a small set files. > However, we should also support streams on the client side, which requires > duplicating each method the returns / expects a byte array to also work with > streams. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28652) Backport HBASE-21785 master reports open regions as RITs and also messes up rit age metric
[ https://issues.apache.org/jira/browse/HBASE-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854623#comment-17854623 ] Hudson commented on HBASE-28652: Results for branch branch-2.6 [build #139 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Backport HBASE-21785 master reports open regions as RITs and also messes up > rit age metric > -- > > Key: HBASE-28652 > URL: https://issues.apache.org/jira/browse/HBASE-28652 > Project: HBase > Issue Type: Sub-task >Reporter: Szucs Villo >Assignee: Szucs Villo >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 2.6.1, 2.5.9 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28049) RSProcedureDispatcher to log the request details during retries
[ https://issues.apache.org/jira/browse/HBASE-28049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854622#comment-17854622 ] Hudson commented on HBASE-28049: Results for branch branch-2.6 [build #139 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/139/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > RSProcedureDispatcher to log the request details during retries > --- > > Key: HBASE-28049 > URL: https://issues.apache.org/jira/browse/HBASE-28049 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Assignee: Khyati Vaghamshi >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > As of today, RSProcedureDispatcher only logs the exception details for the > given RPC request, however it does not log any other details. We should log: > * whether the request is for region open/close > * proc id, proc class names > * region name > > Sample log without any of the above mentioned details: > {code:java} > 2023-08-25 02:21:02,821 WARN [ispatcher-pool-40777] > procedure.RSProcedureDispatcher - request to rs1,61020,1692930044498 failed > due to java.io.IOException: Call to address=rs1:61020 failed on local > exception: java.io.IOException: > org.apache.hbase.thirdparty.io.netty.handler.codec.DecoderException: > org.apache.hadoop.ipc.RemoteException(javax.security.sasl.SaslException): GSS > initiate failed, try=0, retrying... {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28646) Use Streams to unmarshall protobuf REST data
[ https://issues.apache.org/jira/browse/HBASE-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854549#comment-17854549 ] Hudson commented on HBASE-28646: Results for branch branch-3 [build #226 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Streams to unmarshall protobuf REST data > > > Key: HBASE-28646 > URL: https://issues.apache.org/jira/browse/HBASE-28646 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > > We've recently optimized REST marshalling by using streams directly. > We should do the same for unmarshalling. > The easy part is the server side, as that affects only a small set files. > However, we should also support streams on the client side, which requires > duplicating each method the returns / expects a byte array to also work with > streams. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28049) RSProcedureDispatcher to log the request details during retries
[ https://issues.apache.org/jira/browse/HBASE-28049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854550#comment-17854550 ] Hudson commented on HBASE-28049: Results for branch branch-3 [build #226 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > RSProcedureDispatcher to log the request details during retries > --- > > Key: HBASE-28049 > URL: https://issues.apache.org/jira/browse/HBASE-28049 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Assignee: Khyati Vaghamshi >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > As of today, RSProcedureDispatcher only logs the exception details for the > given RPC request, however it does not log any other details. We should log: > * whether the request is for region open/close > * proc id, proc class names > * region name > > Sample log without any of the above mentioned details: > {code:java} > 2023-08-25 02:21:02,821 WARN [ispatcher-pool-40777] > procedure.RSProcedureDispatcher - request to rs1,61020,1692930044498 failed > due to java.io.IOException: Call to address=rs1:61020 failed on local > exception: java.io.IOException: > org.apache.hbase.thirdparty.io.netty.handler.codec.DecoderException: > org.apache.hadoop.ipc.RemoteException(javax.security.sasl.SaslException): GSS > initiate failed, try=0, retrying... {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28651) Reformat the javadoc for CellChunkMap
[ https://issues.apache.org/jira/browse/HBASE-28651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854548#comment-17854548 ] Hudson commented on HBASE-28651: Results for branch branch-3 [build #226 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/226/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Reformat the javadoc for CellChunkMap > - > > Key: HBASE-28651 > URL: https://issues.apache.org/jira/browse/HBASE-28651 > Project: HBase > Issue Type: Improvement > Components: documentation, regionserver >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > It was messed up while introducing spotless, let's restore it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28652) Backport HBASE-21785 master reports open regions as RITs and also messes up rit age metric
[ https://issues.apache.org/jira/browse/HBASE-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854539#comment-17854539 ] Hudson commented on HBASE-28652: Results for branch branch-2.5 [build #547 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Backport HBASE-21785 master reports open regions as RITs and also messes up > rit age metric > -- > > Key: HBASE-28652 > URL: https://issues.apache.org/jira/browse/HBASE-28652 > Project: HBase > Issue Type: Sub-task >Reporter: Szucs Villo >Assignee: Szucs Villo >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 2.6.1, 2.5.9 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28651) Reformat the javadoc for CellChunkMap
[ https://issues.apache.org/jira/browse/HBASE-28651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854535#comment-17854535 ] Hudson commented on HBASE-28651: Results for branch branch-2.5 [build #547 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Reformat the javadoc for CellChunkMap > - > > Key: HBASE-28651 > URL: https://issues.apache.org/jira/browse/HBASE-28651 > Project: HBase > Issue Type: Improvement > Components: documentation, regionserver >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > It was messed up while introducing spotless, let's restore it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28646) Use Streams to unmarshall protobuf REST data
[ https://issues.apache.org/jira/browse/HBASE-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854537#comment-17854537 ] Hudson commented on HBASE-28646: Results for branch branch-2.5 [build #547 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Streams to unmarshall protobuf REST data > > > Key: HBASE-28646 > URL: https://issues.apache.org/jira/browse/HBASE-28646 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > > We've recently optimized REST marshalling by using streams directly. > We should do the same for unmarshalling. > The easy part is the server side, as that affects only a small set files. > However, we should also support streams on the client side, which requires > duplicating each method the returns / expects a byte array to also work with > streams. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28049) RSProcedureDispatcher to log the request details during retries
[ https://issues.apache.org/jira/browse/HBASE-28049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854538#comment-17854538 ] Hudson commented on HBASE-28049: Results for branch branch-2.5 [build #547 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > RSProcedureDispatcher to log the request details during retries > --- > > Key: HBASE-28049 > URL: https://issues.apache.org/jira/browse/HBASE-28049 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Assignee: Khyati Vaghamshi >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > As of today, RSProcedureDispatcher only logs the exception details for the > given RPC request, however it does not log any other details. We should log: > * whether the request is for region open/close > * proc id, proc class names > * region name > > Sample log without any of the above mentioned details: > {code:java} > 2023-08-25 02:21:02,821 WARN [ispatcher-pool-40777] > procedure.RSProcedureDispatcher - request to rs1,61020,1692930044498 failed > due to java.io.IOException: Call to address=rs1:61020 failed on local > exception: java.io.IOException: > org.apache.hbase.thirdparty.io.netty.handler.codec.DecoderException: > org.apache.hadoop.ipc.RemoteException(javax.security.sasl.SaslException): GSS > initiate failed, try=0, retrying... {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-21785) master reports open regions as RITs and also messes up rit age metric
[ https://issues.apache.org/jira/browse/HBASE-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854540#comment-17854540 ] Hudson commented on HBASE-21785: Results for branch branch-2.5 [build #547 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > master reports open regions as RITs and also messes up rit age metric > - > > Key: HBASE-21785 > URL: https://issues.apache.org/jira/browse/HBASE-21785 > Project: HBase > Issue Type: Bug >Affects Versions: 3.0.0-alpha-1, 2.2.0 >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Fix For: 3.0.0-alpha-1, 2.2.0 > > Attachments: HBASE-21785.01.patch, HBASE-21785.patch > > > {noformat} > RegionState RIT time (ms) Retries > dba183f0dadfcc9dc8ae0a6dd59c84e6 dba183f0dadfcc9dc8ae0a6dd59c84e6. > state=OPEN, ts=Wed Dec 31 16:00:00 PST 1969 (1548453918s ago), > server=server,17020,1548452922054 1548453918735 0 > {noformat} > RIT age metric also gets set to a bogus value. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28526) hbase-rest client shading conflict with hbase-shaded-client in HBase 2.x
[ https://issues.apache.org/jira/browse/HBASE-28526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854536#comment-17854536 ] Hudson commented on HBASE-28526: Results for branch branch-2.5 [build #547 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/547/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > hbase-rest client shading conflict with hbase-shaded-client in HBase 2.x > > > Key: HBASE-28526 > URL: https://issues.apache.org/jira/browse/HBASE-28526 > Project: HBase > Issue Type: Bug > Components: REST >Affects Versions: 2.6.0, 2.4.17, 2.7.0, 2.5.8 >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 2.6.1, 2.5.9 > > > When trying to decode a protobuf encoded CellSet, I get > {noformat} > Exception in thread "main" java.lang.NoSuchMethodError: > org.apache.hadoop.hbase.protobuf.ProtobufUtil.mergeFrom(Lcom/google/protobuf/Message$Builder;[B)V > at > org.apache.hadoop.hbase.rest.model.CellSetModel.getObjectFromMessage(CellSetModel.java:129) > at RestClientExample.getMulti(RestClientExample.java:191) > at RestClientExample.start(RestClientExample.java:138) > at RestClientExample.main(RestClientExample.java:124) > {noformat} > Seems to be caused by relocating protobuf 2.5 in hbase-shaded-client. > It works fine with the unrelcoated client i.e. when using the > {noformat} > export CLASSPATH=`hbase --internal-classpath classpath`: > {noformat} > command to set up the classpath for the client. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28049) RSProcedureDispatcher to log the request details during retries
[ https://issues.apache.org/jira/browse/HBASE-28049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854532#comment-17854532 ] Hudson commented on HBASE-28049: Results for branch master [build #1094 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > RSProcedureDispatcher to log the request details during retries > --- > > Key: HBASE-28049 > URL: https://issues.apache.org/jira/browse/HBASE-28049 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Assignee: Khyati Vaghamshi >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > As of today, RSProcedureDispatcher only logs the exception details for the > given RPC request, however it does not log any other details. We should log: > * whether the request is for region open/close > * proc id, proc class names > * region name > > Sample log without any of the above mentioned details: > {code:java} > 2023-08-25 02:21:02,821 WARN [ispatcher-pool-40777] > procedure.RSProcedureDispatcher - request to rs1,61020,1692930044498 failed > due to java.io.IOException: Call to address=rs1:61020 failed on local > exception: java.io.IOException: > org.apache.hbase.thirdparty.io.netty.handler.codec.DecoderException: > org.apache.hadoop.ipc.RemoteException(javax.security.sasl.SaslException): GSS > initiate failed, try=0, retrying... {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28651) Reformat the javadoc for CellChunkMap
[ https://issues.apache.org/jira/browse/HBASE-28651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854530#comment-17854530 ] Hudson commented on HBASE-28651: Results for branch master [build #1094 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Reformat the javadoc for CellChunkMap > - > > Key: HBASE-28651 > URL: https://issues.apache.org/jira/browse/HBASE-28651 > Project: HBase > Issue Type: Improvement > Components: documentation, regionserver >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > It was messed up while introducing spotless, let's restore it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28646) Use Streams to unmarshall protobuf REST data
[ https://issues.apache.org/jira/browse/HBASE-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854531#comment-17854531 ] Hudson commented on HBASE-28646: Results for branch master [build #1094 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1094/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Streams to unmarshall protobuf REST data > > > Key: HBASE-28646 > URL: https://issues.apache.org/jira/browse/HBASE-28646 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > > We've recently optimized REST marshalling by using streams directly. > We should do the same for unmarshalling. > The easy part is the server side, as that affects only a small set files. > However, we should also support streams on the client side, which requires > duplicating each method the returns / expects a byte array to also work with > streams. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28649) Wrong properties are used to set up SSL for REST Client Kerberos authenticator
[ https://issues.apache.org/jira/browse/HBASE-28649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854266#comment-17854266 ] Hudson commented on HBASE-28649: Results for branch branch-2 [build #1076 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Wrong properties are used to set up SSL for REST Client Kerberos authenticator > -- > > Key: HBASE-28649 > URL: https://issues.apache.org/jira/browse/HBASE-28649 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > When setting the ssl keystore properties, when we should be setting the > truststore ones. > This results in SPENGO negotiation failing with custom truststores. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28646) Use Streams to unmarshall protobuf REST data
[ https://issues.apache.org/jira/browse/HBASE-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854268#comment-17854268 ] Hudson commented on HBASE-28646: Results for branch branch-2 [build #1076 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Streams to unmarshall protobuf REST data > > > Key: HBASE-28646 > URL: https://issues.apache.org/jira/browse/HBASE-28646 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > > We've recently optimized REST marshalling by using streams directly. > We should do the same for unmarshalling. > The easy part is the server side, as that affects only a small set files. > However, we should also support streams on the client side, which requires > duplicating each method the returns / expects a byte array to also work with > streams. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28049) RSProcedureDispatcher to log the request details during retries
[ https://issues.apache.org/jira/browse/HBASE-28049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854269#comment-17854269 ] Hudson commented on HBASE-28049: Results for branch branch-2 [build #1076 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > RSProcedureDispatcher to log the request details during retries > --- > > Key: HBASE-28049 > URL: https://issues.apache.org/jira/browse/HBASE-28049 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Assignee: Khyati Vaghamshi >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > As of today, RSProcedureDispatcher only logs the exception details for the > given RPC request, however it does not log any other details. We should log: > * whether the request is for region open/close > * proc id, proc class names > * region name > > Sample log without any of the above mentioned details: > {code:java} > 2023-08-25 02:21:02,821 WARN [ispatcher-pool-40777] > procedure.RSProcedureDispatcher - request to rs1,61020,1692930044498 failed > due to java.io.IOException: Call to address=rs1:61020 failed on local > exception: java.io.IOException: > org.apache.hbase.thirdparty.io.netty.handler.codec.DecoderException: > org.apache.hadoop.ipc.RemoteException(javax.security.sasl.SaslException): GSS > initiate failed, try=0, retrying... {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28651) Reformat the javadoc for CellChunkMap
[ https://issues.apache.org/jira/browse/HBASE-28651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854267#comment-17854267 ] Hudson commented on HBASE-28651: Results for branch branch-2 [build #1076 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1076/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Reformat the javadoc for CellChunkMap > - > > Key: HBASE-28651 > URL: https://issues.apache.org/jira/browse/HBASE-28651 > Project: HBase > Issue Type: Improvement > Components: documentation, regionserver >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > It was messed up while introducing spotless, let's restore it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28651) Reformat the javadoc for CellChunkMap
[ https://issues.apache.org/jira/browse/HBASE-28651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854244#comment-17854244 ] Hudson commented on HBASE-28651: Results for branch branch-2.6 [build #138 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Reformat the javadoc for CellChunkMap > - > > Key: HBASE-28651 > URL: https://issues.apache.org/jira/browse/HBASE-28651 > Project: HBase > Issue Type: Improvement > Components: documentation, regionserver >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > It was messed up while introducing spotless, let's restore it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28649) Wrong properties are used to set up SSL for REST Client Kerberos authenticator
[ https://issues.apache.org/jira/browse/HBASE-28649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854243#comment-17854243 ] Hudson commented on HBASE-28649: Results for branch branch-2.6 [build #138 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/138/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Wrong properties are used to set up SSL for REST Client Kerberos authenticator > -- > > Key: HBASE-28649 > URL: https://issues.apache.org/jira/browse/HBASE-28649 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > When setting the ssl keystore properties, when we should be setting the > truststore ones. > This results in SPENGO negotiation failing with custom truststores. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28649) Wrong properties are used to set up SSL for REST Client Kerberos authenticator
[ https://issues.apache.org/jira/browse/HBASE-28649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854200#comment-17854200 ] Hudson commented on HBASE-28649: Results for branch branch-3 [build #225 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/225/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/225/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/225/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/225/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Wrong properties are used to set up SSL for REST Client Kerberos authenticator > -- > > Key: HBASE-28649 > URL: https://issues.apache.org/jira/browse/HBASE-28649 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > When setting the ssl keystore properties, when we should be setting the > truststore ones. > This results in SPENGO negotiation failing with custom truststores. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28649) Wrong properties are used to set up SSL for REST Client Kerberos authenticator
[ https://issues.apache.org/jira/browse/HBASE-28649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854188#comment-17854188 ] Hudson commented on HBASE-28649: Results for branch branch-2.5 [build #546 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/546/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/546/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/546/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/546/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/546/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Wrong properties are used to set up SSL for REST Client Kerberos authenticator > -- > > Key: HBASE-28649 > URL: https://issues.apache.org/jira/browse/HBASE-28649 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > When setting the ssl keystore properties, when we should be setting the > truststore ones. > This results in SPENGO negotiation failing with custom truststores. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28649) Wrong properties are used to set up SSL for REST Client Kerberos authenticator
[ https://issues.apache.org/jira/browse/HBASE-28649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854187#comment-17854187 ] Hudson commented on HBASE-28649: Results for branch master [build #1093 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1093/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1093/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1093/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1093/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Wrong properties are used to set up SSL for REST Client Kerberos authenticator > -- > > Key: HBASE-28649 > URL: https://issues.apache.org/jira/browse/HBASE-28649 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > When setting the ssl keystore properties, when we should be setting the > truststore ones. > This results in SPENGO negotiation failing with custom truststores. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28549) Make shell commands support column qualifiers with colons
[ https://issues.apache.org/jira/browse/HBASE-28549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853464#comment-17853464 ] Hudson commented on HBASE-28549: Results for branch branch-2 [build #1075 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1075/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1075/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1075/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1075/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1075/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make shell commands support column qualifiers with colons > - > > Key: HBASE-28549 > URL: https://issues.apache.org/jira/browse/HBASE-28549 > Project: HBase > Issue Type: Bug > Components: shell >Reporter: Junegunn Choi >Assignee: Junegunn Choi >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Revisiting abandonded HBASE-13788. > h2. Problem > Shell commands do not support column qualifiers with colons (which are > actually quite common in practice) because the part after the first colon is > always treated as a converter expression. > This can be too restrictive because: > # Converters are only used for {{get}} and {{scan}} commands. They are not > supported anyway for other mutating commands such as {{put}}, {{delete}}, > {{incr}}, etc. > # Converter expression should follow a specific pattern. It should either be > a method name of the {{Bytes}} class, or should be in {{c(CLASS).METHOD}} > format. We ignore the part after the first colon even if it does not follow > the pattern. > h2. Suggested solution > I suggest applying two approaches to make the commands support column > qualifiers with colons. > # Do not interpret column qualifiers when using commands that don't support > converters. > # If the part after the first colon does not follow the pattern, treat it as > a part of the column qualifier > h2. Counterargument > Depending on how you see it, this makes the commands inconsistent in how they > handle column qualifiers. For example, a user may want to use the same column > expression throughout the commands. > {code} > create 't1', 'cf' > col = 'cf:cq:toLong' > # Expecting incr command to automatically ignore :toLong part > incr 't1', 'r1', col, 1 > get 't1', 'r1', COLUMNS => [col] > {code} > However, if we see the converter as an option that is supported by only a few > commands, passing it to a command that doesn't support it can be considered > to be a user error. {{help 'put'}} or {{help 'delete'}} don't mention > anything about converters. > h2. Alternative solution > An alternative solution would be to add a global switch that disables the > converter interpretation altogether. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28549) Make shell commands support column qualifiers with colons
[ https://issues.apache.org/jira/browse/HBASE-28549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853460#comment-17853460 ] Hudson commented on HBASE-28549: Results for branch branch-2.6 [build #137 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/137/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/137/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/137/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/137/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/137/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make shell commands support column qualifiers with colons > - > > Key: HBASE-28549 > URL: https://issues.apache.org/jira/browse/HBASE-28549 > Project: HBase > Issue Type: Bug > Components: shell >Reporter: Junegunn Choi >Assignee: Junegunn Choi >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Revisiting abandonded HBASE-13788. > h2. Problem > Shell commands do not support column qualifiers with colons (which are > actually quite common in practice) because the part after the first colon is > always treated as a converter expression. > This can be too restrictive because: > # Converters are only used for {{get}} and {{scan}} commands. They are not > supported anyway for other mutating commands such as {{put}}, {{delete}}, > {{incr}}, etc. > # Converter expression should follow a specific pattern. It should either be > a method name of the {{Bytes}} class, or should be in {{c(CLASS).METHOD}} > format. We ignore the part after the first colon even if it does not follow > the pattern. > h2. Suggested solution > I suggest applying two approaches to make the commands support column > qualifiers with colons. > # Do not interpret column qualifiers when using commands that don't support > converters. > # If the part after the first colon does not follow the pattern, treat it as > a part of the column qualifier > h2. Counterargument > Depending on how you see it, this makes the commands inconsistent in how they > handle column qualifiers. For example, a user may want to use the same column > expression throughout the commands. > {code} > create 't1', 'cf' > col = 'cf:cq:toLong' > # Expecting incr command to automatically ignore :toLong part > incr 't1', 'r1', col, 1 > get 't1', 'r1', COLUMNS => [col] > {code} > However, if we see the converter as an option that is supported by only a few > commands, passing it to a command that doesn't support it can be considered > to be a user error. {{help 'put'}} or {{help 'delete'}} don't mention > anything about converters. > h2. Alternative solution > An alternative solution would be to add a global switch that disables the > converter interpretation altogether. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28549) Make shell commands support column qualifiers with colons
[ https://issues.apache.org/jira/browse/HBASE-28549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853449#comment-17853449 ] Hudson commented on HBASE-28549: Results for branch branch-3 [build #224 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/224/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/224/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/224/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/224/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make shell commands support column qualifiers with colons > - > > Key: HBASE-28549 > URL: https://issues.apache.org/jira/browse/HBASE-28549 > Project: HBase > Issue Type: Bug > Components: shell >Reporter: Junegunn Choi >Assignee: Junegunn Choi >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Revisiting abandonded HBASE-13788. > h2. Problem > Shell commands do not support column qualifiers with colons (which are > actually quite common in practice) because the part after the first colon is > always treated as a converter expression. > This can be too restrictive because: > # Converters are only used for {{get}} and {{scan}} commands. They are not > supported anyway for other mutating commands such as {{put}}, {{delete}}, > {{incr}}, etc. > # Converter expression should follow a specific pattern. It should either be > a method name of the {{Bytes}} class, or should be in {{c(CLASS).METHOD}} > format. We ignore the part after the first colon even if it does not follow > the pattern. > h2. Suggested solution > I suggest applying two approaches to make the commands support column > qualifiers with colons. > # Do not interpret column qualifiers when using commands that don't support > converters. > # If the part after the first colon does not follow the pattern, treat it as > a part of the column qualifier > h2. Counterargument > Depending on how you see it, this makes the commands inconsistent in how they > handle column qualifiers. For example, a user may want to use the same column > expression throughout the commands. > {code} > create 't1', 'cf' > col = 'cf:cq:toLong' > # Expecting incr command to automatically ignore :toLong part > incr 't1', 'r1', col, 1 > get 't1', 'r1', COLUMNS => [col] > {code} > However, if we see the converter as an option that is supported by only a few > commands, passing it to a command that doesn't support it can be considered > to be a user error. {{help 'put'}} or {{help 'delete'}} don't mention > anything about converters. > h2. Alternative solution > An alternative solution would be to add a global switch that disables the > converter interpretation altogether. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28549) Make shell commands support column qualifiers with colons
[ https://issues.apache.org/jira/browse/HBASE-28549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853426#comment-17853426 ] Hudson commented on HBASE-28549: Results for branch master [build #1092 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1092/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1092/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1092/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1092/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make shell commands support column qualifiers with colons > - > > Key: HBASE-28549 > URL: https://issues.apache.org/jira/browse/HBASE-28549 > Project: HBase > Issue Type: Bug > Components: shell >Reporter: Junegunn Choi >Assignee: Junegunn Choi >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Revisiting abandonded HBASE-13788. > h2. Problem > Shell commands do not support column qualifiers with colons (which are > actually quite common in practice) because the part after the first colon is > always treated as a converter expression. > This can be too restrictive because: > # Converters are only used for {{get}} and {{scan}} commands. They are not > supported anyway for other mutating commands such as {{put}}, {{delete}}, > {{incr}}, etc. > # Converter expression should follow a specific pattern. It should either be > a method name of the {{Bytes}} class, or should be in {{c(CLASS).METHOD}} > format. We ignore the part after the first colon even if it does not follow > the pattern. > h2. Suggested solution > I suggest applying two approaches to make the commands support column > qualifiers with colons. > # Do not interpret column qualifiers when using commands that don't support > converters. > # If the part after the first colon does not follow the pattern, treat it as > a part of the column qualifier > h2. Counterargument > Depending on how you see it, this makes the commands inconsistent in how they > handle column qualifiers. For example, a user may want to use the same column > expression throughout the commands. > {code} > create 't1', 'cf' > col = 'cf:cq:toLong' > # Expecting incr command to automatically ignore :toLong part > incr 't1', 'r1', col, 1 > get 't1', 'r1', COLUMNS => [col] > {code} > However, if we see the converter as an option that is supported by only a few > commands, passing it to a command that doesn't support it can be considered > to be a user error. {{help 'put'}} or {{help 'delete'}} don't mention > anything about converters. > h2. Alternative solution > An alternative solution would be to add a global switch that disables the > converter interpretation altogether. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28549) Make shell commands support column qualifiers with colons
[ https://issues.apache.org/jira/browse/HBASE-28549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853420#comment-17853420 ] Hudson commented on HBASE-28549: Results for branch branch-2.5 [build #545 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/545/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/545/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/545/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/545/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/545/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make shell commands support column qualifiers with colons > - > > Key: HBASE-28549 > URL: https://issues.apache.org/jira/browse/HBASE-28549 > Project: HBase > Issue Type: Bug > Components: shell >Reporter: Junegunn Choi >Assignee: Junegunn Choi >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Revisiting abandonded HBASE-13788. > h2. Problem > Shell commands do not support column qualifiers with colons (which are > actually quite common in practice) because the part after the first colon is > always treated as a converter expression. > This can be too restrictive because: > # Converters are only used for {{get}} and {{scan}} commands. They are not > supported anyway for other mutating commands such as {{put}}, {{delete}}, > {{incr}}, etc. > # Converter expression should follow a specific pattern. It should either be > a method name of the {{Bytes}} class, or should be in {{c(CLASS).METHOD}} > format. We ignore the part after the first colon even if it does not follow > the pattern. > h2. Suggested solution > I suggest applying two approaches to make the commands support column > qualifiers with colons. > # Do not interpret column qualifiers when using commands that don't support > converters. > # If the part after the first colon does not follow the pattern, treat it as > a part of the column qualifier > h2. Counterargument > Depending on how you see it, this makes the commands inconsistent in how they > handle column qualifiers. For example, a user may want to use the same column > expression throughout the commands. > {code} > create 't1', 'cf' > col = 'cf:cq:toLong' > # Expecting incr command to automatically ignore :toLong part > incr 't1', 'r1', col, 1 > get 't1', 'r1', COLUMNS => [col] > {code} > However, if we see the converter as an option that is supported by only a few > commands, passing it to a command that doesn't support it can be considered > to be a user error. {{help 'put'}} or {{help 'delete'}} don't mention > anything about converters. > h2. Alternative solution > An alternative solution would be to add a global switch that disables the > converter interpretation altogether. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28539) Merge of incremental backups fails if backups are on a separate FileSystem
[ https://issues.apache.org/jira/browse/HBASE-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853335#comment-17853335 ] Hudson commented on HBASE-28539: Results for branch branch-2 [build #1074 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Merge of incremental backups fails if backups are on a separate FileSystem > -- > > Key: HBASE-28539 > URL: https://issues.apache.org/jira/browse/HBASE-28539 > Project: HBase > Issue Type: Bug > Components: backuprestore >Affects Versions: 2.6.0, 4.0.0-alpha-1 >Reporter: Benny Colyn >Assignee: Benny Colyn >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0-alpha-1, 2.7.0, 3.0.0-beta-2, 2.6.1 > > Attachments: > HBASE-28539_Fix_merging_of_incremental_backups_when_the_backup_filesystem_is_not_the_same_-1.patch > > > When the backups are stored on a location that is not the > DistributedFilesystem underpinning HBase itself merging of incremental > backups fails. Detected with backups stored on S3A, but can be reproduced > with any other (like LocalFilesystem). > Attached is a patch with a proposed fix and a unit test that reproduces the > issue. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28636) Add UTs for testing copy/sync table between clusters
[ https://issues.apache.org/jira/browse/HBASE-28636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853334#comment-17853334 ] Hudson commented on HBASE-28636: Results for branch branch-2 [build #1074 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Add UTs for testing copy/sync table between clusters > > > Key: HBASE-28636 > URL: https://issues.apache.org/jira/browse/HBASE-28636 > Project: HBase > Issue Type: Improvement > Components: mapreduce, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > While implementing HBASE-28565, I found out that there is no test for testing > these two tools between clusters. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28540) Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner
[ https://issues.apache.org/jira/browse/HBASE-28540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1785#comment-1785 ] Hudson commented on HBASE-28540: Results for branch branch-2 [build #1074 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1074/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > - > > Key: HBASE-28540 > URL: https://issues.apache.org/jira/browse/HBASE-28540 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The implementation of org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > is very inefficient, as the standard next() methods makes separate a http > request for each row. > Performance can be improved by not specifying the row count in the REST call > and caching the returned Results. > Chunk size can still be influenced by scan.setBatch(); -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28539) Merge of incremental backups fails if backups are on a separate FileSystem
[ https://issues.apache.org/jira/browse/HBASE-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853321#comment-17853321 ] Hudson commented on HBASE-28539: Results for branch branch-2.6 [build #136 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Merge of incremental backups fails if backups are on a separate FileSystem > -- > > Key: HBASE-28539 > URL: https://issues.apache.org/jira/browse/HBASE-28539 > Project: HBase > Issue Type: Bug > Components: backuprestore >Affects Versions: 2.6.0, 4.0.0-alpha-1 >Reporter: Benny Colyn >Assignee: Benny Colyn >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0-alpha-1, 2.7.0, 3.0.0-beta-2, 2.6.1 > > Attachments: > HBASE-28539_Fix_merging_of_incremental_backups_when_the_backup_filesystem_is_not_the_same_-1.patch > > > When the backups are stored on a location that is not the > DistributedFilesystem underpinning HBase itself merging of incremental > backups fails. Detected with backups stored on S3A, but can be reproduced > with any other (like LocalFilesystem). > Attached is a patch with a proposed fix and a unit test that reproduces the > issue. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28540) Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner
[ https://issues.apache.org/jira/browse/HBASE-28540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853320#comment-17853320 ] Hudson commented on HBASE-28540: Results for branch branch-2.6 [build #136 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > - > > Key: HBASE-28540 > URL: https://issues.apache.org/jira/browse/HBASE-28540 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The implementation of org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > is very inefficient, as the standard next() methods makes separate a http > request for each row. > Performance can be improved by not specifying the row count in the REST call > and caching the returned Results. > Chunk size can still be influenced by scan.setBatch(); -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28636) Add UTs for testing copy/sync table between clusters
[ https://issues.apache.org/jira/browse/HBASE-28636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853322#comment-17853322 ] Hudson commented on HBASE-28636: Results for branch branch-2.6 [build #136 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/136/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Add UTs for testing copy/sync table between clusters > > > Key: HBASE-28636 > URL: https://issues.apache.org/jira/browse/HBASE-28636 > Project: HBase > Issue Type: Improvement > Components: mapreduce, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > While implementing HBASE-28565, I found out that there is no test for testing > these two tools between clusters. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28625) ExportSnapshot should verify checksums for the source file and the target file
[ https://issues.apache.org/jira/browse/HBASE-28625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853273#comment-17853273 ] Hudson commented on HBASE-28625: Results for branch branch-2.5 [build #544 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > ExportSnapshot should verify checksums for the source file and the target file > -- > > Key: HBASE-28625 > URL: https://issues.apache.org/jira/browse/HBASE-28625 > Project: HBase > Issue Type: Improvement >Reporter: Liangjun He >Assignee: Liangjun He >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > In our cluster, we encountered cases where the target hfile was corrupted > after executing ExportSnapshot. [HBASE-13588 > |https://issues.apache.org/jira/browse/HBASE-13588] can only checksum data > transferred, but cannot solve our problem. Therefore, we believe it is > necessary to verify checksums on the files exported by ExportSnapshot. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28636) Add UTs for testing copy/sync table between clusters
[ https://issues.apache.org/jira/browse/HBASE-28636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853276#comment-17853276 ] Hudson commented on HBASE-28636: Results for branch branch-2.5 [build #544 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Add UTs for testing copy/sync table between clusters > > > Key: HBASE-28636 > URL: https://issues.apache.org/jira/browse/HBASE-28636 > Project: HBase > Issue Type: Improvement > Components: mapreduce, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > While implementing HBASE-28565, I found out that there is no test for testing > these two tools between clusters. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28618) The hadolint check in nightly build is broken
[ https://issues.apache.org/jira/browse/HBASE-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853274#comment-17853274 ] Hudson commented on HBASE-28618: Results for branch branch-2.5 [build #544 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > The hadolint check in nightly build is broken > - > > Key: HBASE-28618 > URL: https://issues.apache.org/jira/browse/HBASE-28618 > Project: HBase > Issue Type: Bug > Components: scripts >Reporter: Duo Zhang >Assignee: Subrat Mishra >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1080/General_20Nightly_20Build_20Report/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28540) Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner
[ https://issues.apache.org/jira/browse/HBASE-28540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853275#comment-17853275 ] Hudson commented on HBASE-28540: Results for branch branch-2.5 [build #544 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/544/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > - > > Key: HBASE-28540 > URL: https://issues.apache.org/jira/browse/HBASE-28540 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The implementation of org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > is very inefficient, as the standard next() methods makes separate a http > request for each row. > Performance can be improved by not specifying the row count in the REST call > and caching the returned Results. > Chunk size can still be influenced by scan.setBatch(); -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28618) The hadolint check in nightly build is broken
[ https://issues.apache.org/jira/browse/HBASE-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853267#comment-17853267 ] Hudson commented on HBASE-28618: Results for branch branch-3 [build #223 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > The hadolint check in nightly build is broken > - > > Key: HBASE-28618 > URL: https://issues.apache.org/jira/browse/HBASE-28618 > Project: HBase > Issue Type: Bug > Components: scripts >Reporter: Duo Zhang >Assignee: Subrat Mishra >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1080/General_20Nightly_20Build_20Report/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28539) Merge of incremental backups fails if backups are on a separate FileSystem
[ https://issues.apache.org/jira/browse/HBASE-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853271#comment-17853271 ] Hudson commented on HBASE-28539: Results for branch branch-3 [build #223 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Merge of incremental backups fails if backups are on a separate FileSystem > -- > > Key: HBASE-28539 > URL: https://issues.apache.org/jira/browse/HBASE-28539 > Project: HBase > Issue Type: Bug > Components: backuprestore >Affects Versions: 2.6.0, 4.0.0-alpha-1 >Reporter: Benny Colyn >Assignee: Benny Colyn >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0-alpha-1, 2.7.0, 3.0.0-beta-2, 2.6.1 > > Attachments: > HBASE-28539_Fix_merging_of_incremental_backups_when_the_backup_filesystem_is_not_the_same_-1.patch > > > When the backups are stored on a location that is not the > DistributedFilesystem underpinning HBase itself merging of incremental > backups fails. Detected with backups stored on S3A, but can be reproduced > with any other (like LocalFilesystem). > Attached is a patch with a proposed fix and a unit test that reproduces the > issue. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28636) Add UTs for testing copy/sync table between clusters
[ https://issues.apache.org/jira/browse/HBASE-28636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853269#comment-17853269 ] Hudson commented on HBASE-28636: Results for branch branch-3 [build #223 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Add UTs for testing copy/sync table between clusters > > > Key: HBASE-28636 > URL: https://issues.apache.org/jira/browse/HBASE-28636 > Project: HBase > Issue Type: Improvement > Components: mapreduce, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > While implementing HBASE-28565, I found out that there is no test for testing > these two tools between clusters. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28562) Correct backup ancestor calculation
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853268#comment-17853268 ] Hudson commented on HBASE-28562: Results for branch branch-3 [build #223 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Correct backup ancestor calculation > --- > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backuprestore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Assignee: Dieter De Paepe >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1 > > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:331) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > at >
[jira] [Commented] (HBASE-28540) Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner
[ https://issues.apache.org/jira/browse/HBASE-28540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853270#comment-17853270 ] Hudson commented on HBASE-28540: Results for branch branch-3 [build #223 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > - > > Key: HBASE-28540 > URL: https://issues.apache.org/jira/browse/HBASE-28540 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The implementation of org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > is very inefficient, as the standard next() methods makes separate a http > request for each row. > Performance can be improved by not specifying the row count in the REST call > and caching the returned Results. > Chunk size can still be influenced by scan.setBatch(); -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28625) ExportSnapshot should verify checksums for the source file and the target file
[ https://issues.apache.org/jira/browse/HBASE-28625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853266#comment-17853266 ] Hudson commented on HBASE-28625: Results for branch branch-3 [build #223 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/223/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > ExportSnapshot should verify checksums for the source file and the target file > -- > > Key: HBASE-28625 > URL: https://issues.apache.org/jira/browse/HBASE-28625 > Project: HBase > Issue Type: Improvement >Reporter: Liangjun He >Assignee: Liangjun He >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > In our cluster, we encountered cases where the target hfile was corrupted > after executing ExportSnapshot. [HBASE-13588 > |https://issues.apache.org/jira/browse/HBASE-13588] can only checksum data > transferred, but cannot solve our problem. Therefore, we believe it is > necessary to verify checksums on the files exported by ExportSnapshot. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28540) Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner
[ https://issues.apache.org/jira/browse/HBASE-28540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853265#comment-17853265 ] Hudson commented on HBASE-28540: Results for branch master [build #1091 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Cache Results in org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > - > > Key: HBASE-28540 > URL: https://issues.apache.org/jira/browse/HBASE-28540 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The implementation of org.apache.hadoop.hbase.rest.client.RemoteHTable.Scanner > is very inefficient, as the standard next() methods makes separate a http > request for each row. > Performance can be improved by not specifying the row count in the REST call > and caching the returned Results. > Chunk size can still be influenced by scan.setBatch(); -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28618) The hadolint check in nightly build is broken
[ https://issues.apache.org/jira/browse/HBASE-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853262#comment-17853262 ] Hudson commented on HBASE-28618: Results for branch master [build #1091 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > The hadolint check in nightly build is broken > - > > Key: HBASE-28618 > URL: https://issues.apache.org/jira/browse/HBASE-28618 > Project: HBase > Issue Type: Bug > Components: scripts >Reporter: Duo Zhang >Assignee: Subrat Mishra >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1080/General_20Nightly_20Build_20Report/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28539) Merge of incremental backups fails if backups are on a separate FileSystem
[ https://issues.apache.org/jira/browse/HBASE-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853263#comment-17853263 ] Hudson commented on HBASE-28539: Results for branch master [build #1091 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Merge of incremental backups fails if backups are on a separate FileSystem > -- > > Key: HBASE-28539 > URL: https://issues.apache.org/jira/browse/HBASE-28539 > Project: HBase > Issue Type: Bug > Components: backuprestore >Affects Versions: 2.6.0, 4.0.0-alpha-1 >Reporter: Benny Colyn >Assignee: Benny Colyn >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0-alpha-1, 2.7.0, 3.0.0-beta-2, 2.6.1 > > Attachments: > HBASE-28539_Fix_merging_of_incremental_backups_when_the_backup_filesystem_is_not_the_same_-1.patch > > > When the backups are stored on a location that is not the > DistributedFilesystem underpinning HBase itself merging of incremental > backups fails. Detected with backups stored on S3A, but can be reproduced > with any other (like LocalFilesystem). > Attached is a patch with a proposed fix and a unit test that reproduces the > issue. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28636) Add UTs for testing copy/sync table between clusters
[ https://issues.apache.org/jira/browse/HBASE-28636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853264#comment-17853264 ] Hudson commented on HBASE-28636: Results for branch master [build #1091 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Add UTs for testing copy/sync table between clusters > > > Key: HBASE-28636 > URL: https://issues.apache.org/jira/browse/HBASE-28636 > Project: HBase > Issue Type: Improvement > Components: mapreduce, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > While implementing HBASE-28565, I found out that there is no test for testing > these two tools between clusters. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28562) Correct backup ancestor calculation
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853261#comment-17853261 ] Hudson commented on HBASE-28562: Results for branch master [build #1091 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1091/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Correct backup ancestor calculation > --- > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backuprestore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Assignee: Dieter De Paepe >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1 > > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:331) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > at >
[jira] [Commented] (HBASE-28618) The hadolint check in nightly build is broken
[ https://issues.apache.org/jira/browse/HBASE-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853047#comment-17853047 ] Hudson commented on HBASE-28618: Results for branch branch-2 [build #1073 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > The hadolint check in nightly build is broken > - > > Key: HBASE-28618 > URL: https://issues.apache.org/jira/browse/HBASE-28618 > Project: HBase > Issue Type: Bug > Components: scripts >Reporter: Duo Zhang >Assignee: Subrat Mishra >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1080/General_20Nightly_20Build_20Report/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28625) ExportSnapshot should verify checksums for the source file and the target file
[ https://issues.apache.org/jira/browse/HBASE-28625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853046#comment-17853046 ] Hudson commented on HBASE-28625: Results for branch branch-2 [build #1073 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > ExportSnapshot should verify checksums for the source file and the target file > -- > > Key: HBASE-28625 > URL: https://issues.apache.org/jira/browse/HBASE-28625 > Project: HBase > Issue Type: Improvement >Reporter: Liangjun He >Assignee: Liangjun He >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > In our cluster, we encountered cases where the target hfile was corrupted > after executing ExportSnapshot. [HBASE-13588 > |https://issues.apache.org/jira/browse/HBASE-13588] can only checksum data > transferred, but cannot solve our problem. Therefore, we believe it is > necessary to verify checksums on the files exported by ExportSnapshot. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28562) Correct backup ancestor calculation
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853048#comment-17853048 ] Hudson commented on HBASE-28562: Results for branch branch-2 [build #1073 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1073/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Correct backup ancestor calculation > --- > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backuprestore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Assignee: Dieter De Paepe >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1 > > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) >
[jira] [Commented] (HBASE-28625) ExportSnapshot should verify checksums for the source file and the target file
[ https://issues.apache.org/jira/browse/HBASE-28625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853037#comment-17853037 ] Hudson commented on HBASE-28625: Results for branch branch-2.6 [build #135 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > ExportSnapshot should verify checksums for the source file and the target file > -- > > Key: HBASE-28625 > URL: https://issues.apache.org/jira/browse/HBASE-28625 > Project: HBase > Issue Type: Improvement >Reporter: Liangjun He >Assignee: Liangjun He >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > In our cluster, we encountered cases where the target hfile was corrupted > after executing ExportSnapshot. [HBASE-13588 > |https://issues.apache.org/jira/browse/HBASE-13588] can only checksum data > transferred, but cannot solve our problem. Therefore, we believe it is > necessary to verify checksums on the files exported by ExportSnapshot. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28618) The hadolint check in nightly build is broken
[ https://issues.apache.org/jira/browse/HBASE-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853038#comment-17853038 ] Hudson commented on HBASE-28618: Results for branch branch-2.6 [build #135 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > The hadolint check in nightly build is broken > - > > Key: HBASE-28618 > URL: https://issues.apache.org/jira/browse/HBASE-28618 > Project: HBase > Issue Type: Bug > Components: scripts >Reporter: Duo Zhang >Assignee: Subrat Mishra >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1080/General_20Nightly_20Build_20Report/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28562) Correct backup ancestor calculation
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853039#comment-17853039 ] Hudson commented on HBASE-28562: Results for branch branch-2.6 [build #135 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/135/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Correct backup ancestor calculation > --- > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backuprestore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Assignee: Dieter De Paepe >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1 > > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) >
[jira] [Commented] (HBASE-28618) The hadolint check in nightly build is broken
[ https://issues.apache.org/jira/browse/HBASE-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853011#comment-17853011 ] Hudson commented on HBASE-28618: Results for branch branch-2.4 [build #744 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/744/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/744/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/744/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/744/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/744/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > The hadolint check in nightly build is broken > - > > Key: HBASE-28618 > URL: https://issues.apache.org/jira/browse/HBASE-28618 > Project: HBase > Issue Type: Bug > Components: scripts >Reporter: Duo Zhang >Assignee: Subrat Mishra >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1080/General_20Nightly_20Build_20Report/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28625) ExportSnapshot should verify checksums for the source file and the target file
[ https://issues.apache.org/jira/browse/HBASE-28625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852946#comment-17852946 ] Hudson commented on HBASE-28625: Results for branch master [build #1090 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1090/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1090/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1090/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1090/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > ExportSnapshot should verify checksums for the source file and the target file > -- > > Key: HBASE-28625 > URL: https://issues.apache.org/jira/browse/HBASE-28625 > Project: HBase > Issue Type: Improvement >Reporter: Liangjun He >Assignee: Liangjun He >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > In our cluster, we encountered cases where the target hfile was corrupted > after executing ExportSnapshot. [HBASE-13588 > |https://issues.apache.org/jira/browse/HBASE-13588] can only checksum data > transferred, but cannot solve our problem. Therefore, we believe it is > necessary to verify checksums on the files exported by ExportSnapshot. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28614) Introduce a field to display whether the snapshot is expired
[ https://issues.apache.org/jira/browse/HBASE-28614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852945#comment-17852945 ] Hudson commented on HBASE-28614: Results for branch master [build #1090 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1090/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1090/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1090/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1090/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Introduce a field to display whether the snapshot is expired > > > Key: HBASE-28614 > URL: https://issues.apache.org/jira/browse/HBASE-28614 > Project: HBase > Issue Type: Improvement > Components: shell, snapshots, UI > Environment: hbase master >Reporter: guluo >Assignee: guluo >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > HBase supports to create snapshot with TTL, and expired snapshots will be > periodically deleted. > This period is 30 min by default, as follow. > {code:java} > private static final String SNAPSHOT_CLEANER_INTERVAL = > "hbase.master.cleaner.snapshot.interval"; > private static final int SNAPSHOT_CLEANER_DEFAULT_INTERVAL = 1800 * 1000; // > Default 30 min {code} > > Therefore, the following situation may occur: > The expired snapshot would still exist for a period of time on hbase cluster, > and would not be deleted until the next operation of the periodic thread. > So, Sometimes, we may use the expired snapshot because we donot know whether > the snapshot is expired. > > So, I think we can introduce a expired field for this situation in HBase UI. > And on hbase shell ,adding snapshot TTL info and displaying expired if the > snaphost has already expired. > Or any better suggestions? Thanks a lot! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28614) Introduce a field to display whether the snapshot is expired
[ https://issues.apache.org/jira/browse/HBASE-28614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852940#comment-17852940 ] Hudson commented on HBASE-28614: Results for branch branch-3 [build #222 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/222/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/222/General_20Nightly_20Build_20Report/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/222/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/222/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Introduce a field to display whether the snapshot is expired > > > Key: HBASE-28614 > URL: https://issues.apache.org/jira/browse/HBASE-28614 > Project: HBase > Issue Type: Improvement > Components: shell, snapshots, UI > Environment: hbase master >Reporter: guluo >Assignee: guluo >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > HBase supports to create snapshot with TTL, and expired snapshots will be > periodically deleted. > This period is 30 min by default, as follow. > {code:java} > private static final String SNAPSHOT_CLEANER_INTERVAL = > "hbase.master.cleaner.snapshot.interval"; > private static final int SNAPSHOT_CLEANER_DEFAULT_INTERVAL = 1800 * 1000; // > Default 30 min {code} > > Therefore, the following situation may occur: > The expired snapshot would still exist for a period of time on hbase cluster, > and would not be deleted until the next operation of the periodic thread. > So, Sometimes, we may use the expired snapshot because we donot know whether > the snapshot is expired. > > So, I think we can introduce a expired field for this situation in HBase UI. > And on hbase shell ,adding snapshot TTL info and displaying expired if the > snaphost has already expired. > Or any better suggestions? Thanks a lot! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28420) Aborting Active HMaster is not rejecting remote Procedure Reports
[ https://issues.apache.org/jira/browse/HBASE-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852889#comment-17852889 ] Hudson commented on HBASE-28420: Results for branch branch-2.5 [build #543 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Aborting Active HMaster is not rejecting remote Procedure Reports > - > > Key: HBASE-28420 > URL: https://issues.apache.org/jira/browse/HBASE-28420 > Project: HBase > Issue Type: Bug > Components: master, proc-v2 >Affects Versions: 2.4.17, 2.5.8 >Reporter: Umesh Kumar Kumawat >Assignee: Umesh Kumar Kumawat >Priority: Critical > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > When the Active Hmaster is in the process of abortion and another HMaster is > becoming Active HMaster,at the same time if any region server reports the > completion of the remote procedure, it generally goes to the old active > HMaster because of the cached value of rssStub -> > [code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L2829] > ([caller > method|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L3941]). > On the Master side > ([code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java#L2381]), > It did check if the service is started but that returns true if the master > is in the process of abortion(I didn't see when we are setting this flag > false while abortion). > This issue becomes *critical* when *ServerCrash of meta hosting RS and master > failover* happens at the same time and hbase:meta got stuck in the offline > state. > Logs for abortion start of HMaster > {noformat} > 2024-02-02 07:33:11,581 ERROR [PEWorker-6] master.HMaster - * ABORTING > master server4-1xxx,61000,1705169084562: > FAILED persisting region=52d36581218e00a2668776cfea897132 state=CLOSING > *{noformat} > {noformat} > 2024-02-02 07:33:40,999 INFO [master/server4-1xxx:61000] > regionserver.HRegionServer - Exiting; > stopping=hbase2b-mnds4-1-ia2.ops.sfdc.net,61000,1705169084562; zookeeper > connection closed.{noformat} > it took almost 30 seconds to abort the HMaster. > > Logs of starting SCP for meta carrying host. (This SCP is started by the new > active HMaster) > {noformat} > 2024-02-02 07:33:32,622 INFO [aster/server3-1xxx61000:becomeActiveMaster] > assignment.AssignmentManager - Scheduled > ServerCrashProcedure pid=3305546 for server5-1xxx61020,1706857451955 > (carryingMeta=true) server5-1- > xxx61020,1706857451955/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@1b0a5293[Write > > locks = 1, Read locks = 0], oldState=ONLINE.{noformat} > initialization of remote procedure > {noformat} > 2024-02-02 07:33:33,178 INFO [PEWorker-4] procedure2.ProcedureExecutor - > Initialized subprocedures=[{pid=3305548, > ppid=3305547, state=RUNNABLE; SplitWALRemoteProcedure server5-1- > t%2C61020%2C1706857451955.meta.1706858156058.meta, > worker=server4-1-,61020,1705169180881}]{noformat} > Logs of remote procedure handling on Old Active Hmaster(server4-1xxx,61000) > (in the process of abortion) > {noformat} > 2024-02-02 07:33:37,990 DEBUG > [r.default.FPBQ.Fifo.handler=243,queue=9,port=61000] master.HMaster - Remote > procedure > done, pid=3305548{noformat} > This should be handled by the new active HMaster so that it can wake up the > suspended Procedure on the new Active Hmaster. As the new ActiveHMaster was > not able to wake that up, SCP
[jira] [Commented] (HBASE-28614) Introduce a field to display whether the snapshot is expired
[ https://issues.apache.org/jira/browse/HBASE-28614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852890#comment-17852890 ] Hudson commented on HBASE-28614: Results for branch branch-2.5 [build #543 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/543/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Introduce a field to display whether the snapshot is expired > > > Key: HBASE-28614 > URL: https://issues.apache.org/jira/browse/HBASE-28614 > Project: HBase > Issue Type: Improvement > Components: shell, snapshots, UI > Environment: hbase master >Reporter: guluo >Assignee: guluo >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > HBase supports to create snapshot with TTL, and expired snapshots will be > periodically deleted. > This period is 30 min by default, as follow. > {code:java} > private static final String SNAPSHOT_CLEANER_INTERVAL = > "hbase.master.cleaner.snapshot.interval"; > private static final int SNAPSHOT_CLEANER_DEFAULT_INTERVAL = 1800 * 1000; // > Default 30 min {code} > > Therefore, the following situation may occur: > The expired snapshot would still exist for a period of time on hbase cluster, > and would not be deleted until the next operation of the periodic thread. > So, Sometimes, we may use the expired snapshot because we donot know whether > the snapshot is expired. > > So, I think we can introduce a expired field for this situation in HBase UI. > And on hbase shell ,adding snapshot TTL info and displaying expired if the > snaphost has already expired. > Or any better suggestions? Thanks a lot! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28526) hbase-rest client shading conflict with hbase-shaded-client in HBase 2.x
[ https://issues.apache.org/jira/browse/HBASE-28526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852646#comment-17852646 ] Hudson commented on HBASE-28526: Results for branch branch-2 [build #1071 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > hbase-rest client shading conflict with hbase-shaded-client in HBase 2.x > > > Key: HBASE-28526 > URL: https://issues.apache.org/jira/browse/HBASE-28526 > Project: HBase > Issue Type: Bug > Components: REST >Affects Versions: 2.6.0, 2.4.17, 2.7.0, 2.5.8 >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 2.6.1, 2.5.9 > > > When trying to decode a protobuf encoded CellSet, I get > {noformat} > Exception in thread "main" java.lang.NoSuchMethodError: > org.apache.hadoop.hbase.protobuf.ProtobufUtil.mergeFrom(Lcom/google/protobuf/Message$Builder;[B)V > at > org.apache.hadoop.hbase.rest.model.CellSetModel.getObjectFromMessage(CellSetModel.java:129) > at RestClientExample.getMulti(RestClientExample.java:191) > at RestClientExample.start(RestClientExample.java:138) > at RestClientExample.main(RestClientExample.java:124) > {noformat} > Seems to be caused by relocating protobuf 2.5 in hbase-shaded-client. > It works fine with the unrelcoated client i.e. when using the > {noformat} > export CLASSPATH=`hbase --internal-classpath classpath`: > {noformat} > command to set up the classpath for the client. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28420) Aborting Active HMaster is not rejecting remote Procedure Reports
[ https://issues.apache.org/jira/browse/HBASE-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852647#comment-17852647 ] Hudson commented on HBASE-28420: Results for branch branch-2 [build #1071 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Aborting Active HMaster is not rejecting remote Procedure Reports > - > > Key: HBASE-28420 > URL: https://issues.apache.org/jira/browse/HBASE-28420 > Project: HBase > Issue Type: Bug > Components: master, proc-v2 >Affects Versions: 2.4.17, 2.5.8 >Reporter: Umesh Kumar Kumawat >Assignee: Umesh Kumar Kumawat >Priority: Critical > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > When the Active Hmaster is in the process of abortion and another HMaster is > becoming Active HMaster,at the same time if any region server reports the > completion of the remote procedure, it generally goes to the old active > HMaster because of the cached value of rssStub -> > [code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L2829] > ([caller > method|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L3941]). > On the Master side > ([code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java#L2381]), > It did check if the service is started but that returns true if the master > is in the process of abortion(I didn't see when we are setting this flag > false while abortion). > This issue becomes *critical* when *ServerCrash of meta hosting RS and master > failover* happens at the same time and hbase:meta got stuck in the offline > state. > Logs for abortion start of HMaster > {noformat} > 2024-02-02 07:33:11,581 ERROR [PEWorker-6] master.HMaster - * ABORTING > master server4-1xxx,61000,1705169084562: > FAILED persisting region=52d36581218e00a2668776cfea897132 state=CLOSING > *{noformat} > {noformat} > 2024-02-02 07:33:40,999 INFO [master/server4-1xxx:61000] > regionserver.HRegionServer - Exiting; > stopping=hbase2b-mnds4-1-ia2.ops.sfdc.net,61000,1705169084562; zookeeper > connection closed.{noformat} > it took almost 30 seconds to abort the HMaster. > > Logs of starting SCP for meta carrying host. (This SCP is started by the new > active HMaster) > {noformat} > 2024-02-02 07:33:32,622 INFO [aster/server3-1xxx61000:becomeActiveMaster] > assignment.AssignmentManager - Scheduled > ServerCrashProcedure pid=3305546 for server5-1xxx61020,1706857451955 > (carryingMeta=true) server5-1- > xxx61020,1706857451955/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@1b0a5293[Write > > locks = 1, Read locks = 0], oldState=ONLINE.{noformat} > initialization of remote procedure > {noformat} > 2024-02-02 07:33:33,178 INFO [PEWorker-4] procedure2.ProcedureExecutor - > Initialized subprocedures=[{pid=3305548, > ppid=3305547, state=RUNNABLE; SplitWALRemoteProcedure server5-1- > t%2C61020%2C1706857451955.meta.1706858156058.meta, > worker=server4-1-,61020,1705169180881}]{noformat} > Logs of remote procedure handling on Old Active Hmaster(server4-1xxx,61000) > (in the process of abortion) > {noformat} > 2024-02-02 07:33:37,990 DEBUG > [r.default.FPBQ.Fifo.handler=243,queue=9,port=61000] master.HMaster - Remote > procedure > done, pid=3305548{noformat} > This should be handled by the new active HMaster so that it can wake up the > suspended Procedure on the new Active Hmaster. As the new ActiveHMaster was > not able to wake that up, SCP procedure got
[jira] [Commented] (HBASE-28614) Introduce a field to display whether the snapshot is expired
[ https://issues.apache.org/jira/browse/HBASE-28614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852648#comment-17852648 ] Hudson commented on HBASE-28614: Results for branch branch-2 [build #1071 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1071/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Introduce a field to display whether the snapshot is expired > > > Key: HBASE-28614 > URL: https://issues.apache.org/jira/browse/HBASE-28614 > Project: HBase > Issue Type: Improvement > Components: shell, snapshots, UI > Environment: hbase master >Reporter: guluo >Assignee: guluo >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > HBase supports to create snapshot with TTL, and expired snapshots will be > periodically deleted. > This period is 30 min by default, as follow. > {code:java} > private static final String SNAPSHOT_CLEANER_INTERVAL = > "hbase.master.cleaner.snapshot.interval"; > private static final int SNAPSHOT_CLEANER_DEFAULT_INTERVAL = 1800 * 1000; // > Default 30 min {code} > > Therefore, the following situation may occur: > The expired snapshot would still exist for a period of time on hbase cluster, > and would not be deleted until the next operation of the periodic thread. > So, Sometimes, we may use the expired snapshot because we donot know whether > the snapshot is expired. > > So, I think we can introduce a expired field for this situation in HBase UI. > And on hbase shell ,adding snapshot TTL info and displaying expired if the > snaphost has already expired. > Or any better suggestions? Thanks a lot! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28420) Aborting Active HMaster is not rejecting remote Procedure Reports
[ https://issues.apache.org/jira/browse/HBASE-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852630#comment-17852630 ] Hudson commented on HBASE-28420: Results for branch branch-2.6 [build #133 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Aborting Active HMaster is not rejecting remote Procedure Reports > - > > Key: HBASE-28420 > URL: https://issues.apache.org/jira/browse/HBASE-28420 > Project: HBase > Issue Type: Bug > Components: master, proc-v2 >Affects Versions: 2.4.17, 2.5.8 >Reporter: Umesh Kumar Kumawat >Assignee: Umesh Kumar Kumawat >Priority: Critical > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > When the Active Hmaster is in the process of abortion and another HMaster is > becoming Active HMaster,at the same time if any region server reports the > completion of the remote procedure, it generally goes to the old active > HMaster because of the cached value of rssStub -> > [code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L2829] > ([caller > method|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L3941]). > On the Master side > ([code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java#L2381]), > It did check if the service is started but that returns true if the master > is in the process of abortion(I didn't see when we are setting this flag > false while abortion). > This issue becomes *critical* when *ServerCrash of meta hosting RS and master > failover* happens at the same time and hbase:meta got stuck in the offline > state. > Logs for abortion start of HMaster > {noformat} > 2024-02-02 07:33:11,581 ERROR [PEWorker-6] master.HMaster - * ABORTING > master server4-1xxx,61000,1705169084562: > FAILED persisting region=52d36581218e00a2668776cfea897132 state=CLOSING > *{noformat} > {noformat} > 2024-02-02 07:33:40,999 INFO [master/server4-1xxx:61000] > regionserver.HRegionServer - Exiting; > stopping=hbase2b-mnds4-1-ia2.ops.sfdc.net,61000,1705169084562; zookeeper > connection closed.{noformat} > it took almost 30 seconds to abort the HMaster. > > Logs of starting SCP for meta carrying host. (This SCP is started by the new > active HMaster) > {noformat} > 2024-02-02 07:33:32,622 INFO [aster/server3-1xxx61000:becomeActiveMaster] > assignment.AssignmentManager - Scheduled > ServerCrashProcedure pid=3305546 for server5-1xxx61020,1706857451955 > (carryingMeta=true) server5-1- > xxx61020,1706857451955/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@1b0a5293[Write > > locks = 1, Read locks = 0], oldState=ONLINE.{noformat} > initialization of remote procedure > {noformat} > 2024-02-02 07:33:33,178 INFO [PEWorker-4] procedure2.ProcedureExecutor - > Initialized subprocedures=[{pid=3305548, > ppid=3305547, state=RUNNABLE; SplitWALRemoteProcedure server5-1- > t%2C61020%2C1706857451955.meta.1706858156058.meta, > worker=server4-1-,61020,1705169180881}]{noformat} > Logs of remote procedure handling on Old Active Hmaster(server4-1xxx,61000) > (in the process of abortion) > {noformat} > 2024-02-02 07:33:37,990 DEBUG > [r.default.FPBQ.Fifo.handler=243,queue=9,port=61000] master.HMaster - Remote > procedure > done, pid=3305548{noformat} > This should be handled by the new active HMaster so that it can wake up the > suspended Procedure on the new Active Hmaster. As the new ActiveHMaster was > not able to wake that up, SCP
[jira] [Commented] (HBASE-28614) Introduce a field to display whether the snapshot is expired
[ https://issues.apache.org/jira/browse/HBASE-28614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852631#comment-17852631 ] Hudson commented on HBASE-28614: Results for branch branch-2.6 [build #133 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Introduce a field to display whether the snapshot is expired > > > Key: HBASE-28614 > URL: https://issues.apache.org/jira/browse/HBASE-28614 > Project: HBase > Issue Type: Improvement > Components: shell, snapshots, UI > Environment: hbase master >Reporter: guluo >Assignee: guluo >Priority: Minor > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > HBase supports to create snapshot with TTL, and expired snapshots will be > periodically deleted. > This period is 30 min by default, as follow. > {code:java} > private static final String SNAPSHOT_CLEANER_INTERVAL = > "hbase.master.cleaner.snapshot.interval"; > private static final int SNAPSHOT_CLEANER_DEFAULT_INTERVAL = 1800 * 1000; // > Default 30 min {code} > > Therefore, the following situation may occur: > The expired snapshot would still exist for a period of time on hbase cluster, > and would not be deleted until the next operation of the periodic thread. > So, Sometimes, we may use the expired snapshot because we donot know whether > the snapshot is expired. > > So, I think we can introduce a expired field for this situation in HBase UI. > And on hbase shell ,adding snapshot TTL info and displaying expired if the > snaphost has already expired. > Or any better suggestions? Thanks a lot! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28526) hbase-rest client shading conflict with hbase-shaded-client in HBase 2.x
[ https://issues.apache.org/jira/browse/HBASE-28526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852629#comment-17852629 ] Hudson commented on HBASE-28526: Results for branch branch-2.6 [build #133 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/133/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > hbase-rest client shading conflict with hbase-shaded-client in HBase 2.x > > > Key: HBASE-28526 > URL: https://issues.apache.org/jira/browse/HBASE-28526 > Project: HBase > Issue Type: Bug > Components: REST >Affects Versions: 2.6.0, 2.4.17, 2.7.0, 2.5.8 >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 2.6.1, 2.5.9 > > > When trying to decode a protobuf encoded CellSet, I get > {noformat} > Exception in thread "main" java.lang.NoSuchMethodError: > org.apache.hadoop.hbase.protobuf.ProtobufUtil.mergeFrom(Lcom/google/protobuf/Message$Builder;[B)V > at > org.apache.hadoop.hbase.rest.model.CellSetModel.getObjectFromMessage(CellSetModel.java:129) > at RestClientExample.getMulti(RestClientExample.java:191) > at RestClientExample.start(RestClientExample.java:138) > at RestClientExample.main(RestClientExample.java:124) > {noformat} > Seems to be caused by relocating protobuf 2.5 in hbase-shaded-client. > It works fine with the unrelcoated client i.e. when using the > {noformat} > export CLASSPATH=`hbase --internal-classpath classpath`: > {noformat} > command to set up the classpath for the client. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28622) FilterListWithAND can swallow SEEK_NEXT_USING_HINT
[ https://issues.apache.org/jira/browse/HBASE-28622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852582#comment-17852582 ] Hudson commented on HBASE-28622: Results for branch master [build #1089 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1089/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1089/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1089/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1089/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > FilterListWithAND can swallow SEEK_NEXT_USING_HINT > -- > > Key: HBASE-28622 > URL: https://issues.apache.org/jira/browse/HBASE-28622 > Project: HBase > Issue Type: Bug > Components: Filters >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > org.apache.hadoop.hbase.filter.FilterListWithAND.filterRowKey(Cell) will > return true if ANY of the filters returns true for Filter#filterRowKey(). > However, the SEEK_NEXT_USING_HINT mechanism relies on filterRowKey() > returning false, so that filterCell() can return SEEK_NEXT_USING_HINT. > If none of the filters matches, but one of them returns true for > filterRowKey(), then the filter(s) that returned false, so that they can > return SEEK_NEXT_USING_HINT in filterCell() never get a chance to return > SEEK_NEXT_USING_HINT, and instead of seeking to the hint, FilterListWithAND > will do very slow full scan. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28622) FilterListWithAND can swallow SEEK_NEXT_USING_HINT
[ https://issues.apache.org/jira/browse/HBASE-28622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852563#comment-17852563 ] Hudson commented on HBASE-28622: Results for branch branch-3 [build #221 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/221/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/221/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/221/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/221/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > FilterListWithAND can swallow SEEK_NEXT_USING_HINT > -- > > Key: HBASE-28622 > URL: https://issues.apache.org/jira/browse/HBASE-28622 > Project: HBase > Issue Type: Bug > Components: Filters >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > org.apache.hadoop.hbase.filter.FilterListWithAND.filterRowKey(Cell) will > return true if ANY of the filters returns true for Filter#filterRowKey(). > However, the SEEK_NEXT_USING_HINT mechanism relies on filterRowKey() > returning false, so that filterCell() can return SEEK_NEXT_USING_HINT. > If none of the filters matches, but one of them returns true for > filterRowKey(), then the filter(s) that returned false, so that they can > return SEEK_NEXT_USING_HINT in filterCell() never get a chance to return > SEEK_NEXT_USING_HINT, and instead of seeking to the hint, FilterListWithAND > will do very slow full scan. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28622) FilterListWithAND can swallow SEEK_NEXT_USING_HINT
[ https://issues.apache.org/jira/browse/HBASE-28622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852551#comment-17852551 ] Hudson commented on HBASE-28622: Results for branch branch-2.5 [build #542 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/542/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/542/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/542/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/542/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/542/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > FilterListWithAND can swallow SEEK_NEXT_USING_HINT > -- > > Key: HBASE-28622 > URL: https://issues.apache.org/jira/browse/HBASE-28622 > Project: HBase > Issue Type: Bug > Components: Filters >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > org.apache.hadoop.hbase.filter.FilterListWithAND.filterRowKey(Cell) will > return true if ANY of the filters returns true for Filter#filterRowKey(). > However, the SEEK_NEXT_USING_HINT mechanism relies on filterRowKey() > returning false, so that filterCell() can return SEEK_NEXT_USING_HINT. > If none of the filters matches, but one of them returns true for > filterRowKey(), then the filter(s) that returned false, so that they can > return SEEK_NEXT_USING_HINT in filterCell() never get a chance to return > SEEK_NEXT_USING_HINT, and instead of seeking to the hint, FilterListWithAND > will do very slow full scan. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28622) FilterListWithAND can swallow SEEK_NEXT_USING_HINT
[ https://issues.apache.org/jira/browse/HBASE-28622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852298#comment-17852298 ] Hudson commented on HBASE-28622: Results for branch branch-2 [build #1070 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1070/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1070/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1070/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1070/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1070/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > FilterListWithAND can swallow SEEK_NEXT_USING_HINT > -- > > Key: HBASE-28622 > URL: https://issues.apache.org/jira/browse/HBASE-28622 > Project: HBase > Issue Type: Bug > Components: Filters >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > org.apache.hadoop.hbase.filter.FilterListWithAND.filterRowKey(Cell) will > return true if ANY of the filters returns true for Filter#filterRowKey(). > However, the SEEK_NEXT_USING_HINT mechanism relies on filterRowKey() > returning false, so that filterCell() can return SEEK_NEXT_USING_HINT. > If none of the filters matches, but one of them returns true for > filterRowKey(), then the filter(s) that returned false, so that they can > return SEEK_NEXT_USING_HINT in filterCell() never get a chance to return > SEEK_NEXT_USING_HINT, and instead of seeking to the hint, FilterListWithAND > will do very slow full scan. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28622) FilterListWithAND can swallow SEEK_NEXT_USING_HINT
[ https://issues.apache.org/jira/browse/HBASE-28622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852273#comment-17852273 ] Hudson commented on HBASE-28622: Results for branch branch-2.6 [build #132 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/132/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/132/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/132/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/132/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/132/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > FilterListWithAND can swallow SEEK_NEXT_USING_HINT > -- > > Key: HBASE-28622 > URL: https://issues.apache.org/jira/browse/HBASE-28622 > Project: HBase > Issue Type: Bug > Components: Filters >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > org.apache.hadoop.hbase.filter.FilterListWithAND.filterRowKey(Cell) will > return true if ANY of the filters returns true for Filter#filterRowKey(). > However, the SEEK_NEXT_USING_HINT mechanism relies on filterRowKey() > returning false, so that filterCell() can return SEEK_NEXT_USING_HINT. > If none of the filters matches, but one of them returns true for > filterRowKey(), then the filter(s) that returned false, so that they can > return SEEK_NEXT_USING_HINT in filterCell() never get a chance to return > SEEK_NEXT_USING_HINT, and instead of seeking to the hint, FilterListWithAND > will do very slow full scan. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28635) Bump io.airlift:aircompressor from 0.24 to 0.27
[ https://issues.apache.org/jira/browse/HBASE-28635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852186#comment-17852186 ] Hudson commented on HBASE-28635: Results for branch master [build #1088 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1088/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1088/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1088/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1088/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Bump io.airlift:aircompressor from 0.24 to 0.27 > --- > > Key: HBASE-28635 > URL: https://issues.apache.org/jira/browse/HBASE-28635 > Project: HBase > Issue Type: Task > Components: dependabot, dependencies, security >Reporter: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28635) Bump io.airlift:aircompressor from 0.24 to 0.27
[ https://issues.apache.org/jira/browse/HBASE-28635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852184#comment-17852184 ] Hudson commented on HBASE-28635: Results for branch branch-3 [build #220 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/220/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/220/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/220/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/220/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Bump io.airlift:aircompressor from 0.24 to 0.27 > --- > > Key: HBASE-28635 > URL: https://issues.apache.org/jira/browse/HBASE-28635 > Project: HBase > Issue Type: Task > Components: dependabot, dependencies, security >Reporter: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28635) Bump io.airlift:aircompressor from 0.24 to 0.27
[ https://issues.apache.org/jira/browse/HBASE-28635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852179#comment-17852179 ] Hudson commented on HBASE-28635: Results for branch branch-2.5 [build #541 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/541/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/541/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/541/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/541/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/541/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Bump io.airlift:aircompressor from 0.24 to 0.27 > --- > > Key: HBASE-28635 > URL: https://issues.apache.org/jira/browse/HBASE-28635 > Project: HBase > Issue Type: Task > Components: dependabot, dependencies, security >Reporter: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28635) Bump io.airlift:aircompressor from 0.24 to 0.27
[ https://issues.apache.org/jira/browse/HBASE-28635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851905#comment-17851905 ] Hudson commented on HBASE-28635: Results for branch branch-2 [build #1069 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1069/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1069/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1069/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1069/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1069/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Bump io.airlift:aircompressor from 0.24 to 0.27 > --- > > Key: HBASE-28635 > URL: https://issues.apache.org/jira/browse/HBASE-28635 > Project: HBase > Issue Type: Task > Components: dependabot, dependencies, security >Reporter: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28635) Bump io.airlift:aircompressor from 0.24 to 0.27
[ https://issues.apache.org/jira/browse/HBASE-28635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851894#comment-17851894 ] Hudson commented on HBASE-28635: Results for branch branch-2.6 [build #131 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/131/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/131/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/131/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/131/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/131/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Bump io.airlift:aircompressor from 0.24 to 0.27 > --- > > Key: HBASE-28635 > URL: https://issues.apache.org/jira/browse/HBASE-28635 > Project: HBase > Issue Type: Task > Components: dependabot, dependencies, security >Reporter: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28619) Fix the inaccurate message when snapshot doesn't exist
[ https://issues.apache.org/jira/browse/HBASE-28619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851460#comment-17851460 ] Hudson commented on HBASE-28619: Results for branch master [build #1087 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1087/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1087/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1087/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1087/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Fix the inaccurate message when snapshot doesn't exist > -- > > Key: HBASE-28619 > URL: https://issues.apache.org/jira/browse/HBASE-28619 > Project: HBase > Issue Type: Bug > Components: snapshots >Affects Versions: 2.4.13 >Reporter: guluo >Priority: Minor > Labels: pull-request-available > > We would get the as following message when restore a non-existing snapshot. > {code:java} > hbase:021:0> restore_snapshot 'non_existing_snap' > ERROR: Unable to find the table name for snapshot=non_existing_snap > For usage try 'help "restore_snapshot"' > Took 0.0170 seconds {code} > > ERROR: {color:#FF}Unable to find the table{color} name for > snapshot=non_existing_snap > This error message is inaccurate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28630) Doc for the config of hbase.ipc.sserver.callqueue.read.ratio is misleading
[ https://issues.apache.org/jira/browse/HBASE-28630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851459#comment-17851459 ] Hudson commented on HBASE-28630: Results for branch master [build #1087 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1087/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1087/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1087/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1087/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Doc for the config of hbase.ipc.sserver.callqueue.read.ratio is misleading > -- > > Key: HBASE-28630 > URL: https://issues.apache.org/jira/browse/HBASE-28630 > Project: HBase > Issue Type: Bug >Reporter: MisterWang >Assignee: MisterWang >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0-alpha-1 > > > Doc for the config of hbase.ipc.sserver.callqueue.read.ratio is misleading. > Fix the explanation for the configuration of > hbase.ipc.sserver.callqueue.read.ratio -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28619) Fix the inaccurate message when snapshot doesn't exist
[ https://issues.apache.org/jira/browse/HBASE-28619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851458#comment-17851458 ] Hudson commented on HBASE-28619: Results for branch branch-3 [build #219 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/219/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/219/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/219/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/219/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Fix the inaccurate message when snapshot doesn't exist > -- > > Key: HBASE-28619 > URL: https://issues.apache.org/jira/browse/HBASE-28619 > Project: HBase > Issue Type: Bug > Components: snapshots >Affects Versions: 2.4.13 >Reporter: guluo >Priority: Minor > Labels: pull-request-available > > We would get the as following message when restore a non-existing snapshot. > {code:java} > hbase:021:0> restore_snapshot 'non_existing_snap' > ERROR: Unable to find the table name for snapshot=non_existing_snap > For usage try 'help "restore_snapshot"' > Took 0.0170 seconds {code} > > ERROR: {color:#FF}Unable to find the table{color} name for > snapshot=non_existing_snap > This error message is inaccurate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28619) Fix the inaccurate message when snapshot doesn't exist
[ https://issues.apache.org/jira/browse/HBASE-28619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851455#comment-17851455 ] Hudson commented on HBASE-28619: Results for branch branch-2.5 [build #540 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/540/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/540/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/540/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/540/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/540/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Fix the inaccurate message when snapshot doesn't exist > -- > > Key: HBASE-28619 > URL: https://issues.apache.org/jira/browse/HBASE-28619 > Project: HBase > Issue Type: Bug > Components: snapshots >Affects Versions: 2.4.13 >Reporter: guluo >Priority: Minor > Labels: pull-request-available > > We would get the as following message when restore a non-existing snapshot. > {code:java} > hbase:021:0> restore_snapshot 'non_existing_snap' > ERROR: Unable to find the table name for snapshot=non_existing_snap > For usage try 'help "restore_snapshot"' > Took 0.0170 seconds {code} > > ERROR: {color:#FF}Unable to find the table{color} name for > snapshot=non_existing_snap > This error message is inaccurate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28619) Fix the inaccurate message when snapshot doesn't exist
[ https://issues.apache.org/jira/browse/HBASE-28619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851354#comment-17851354 ] Hudson commented on HBASE-28619: Results for branch branch-2 [build #1068 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1068/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1068/General_20Nightly_20Build_20Report/] (x) {color:red}-1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1068/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1068/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1068/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Fix the inaccurate message when snapshot doesn't exist > -- > > Key: HBASE-28619 > URL: https://issues.apache.org/jira/browse/HBASE-28619 > Project: HBase > Issue Type: Bug > Components: snapshots >Affects Versions: 2.4.13 >Reporter: guluo >Priority: Minor > Labels: pull-request-available > > We would get the as following message when restore a non-existing snapshot. > {code:java} > hbase:021:0> restore_snapshot 'non_existing_snap' > ERROR: Unable to find the table name for snapshot=non_existing_snap > For usage try 'help "restore_snapshot"' > Took 0.0170 seconds {code} > > ERROR: {color:#FF}Unable to find the table{color} name for > snapshot=non_existing_snap > This error message is inaccurate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28546) Make WAL rolling exception clear
[ https://issues.apache.org/jira/browse/HBASE-28546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851350#comment-17851350 ] Hudson commented on HBASE-28546: Results for branch branch-2.6 [build #130 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make WAL rolling exception clear > > > Key: HBASE-28546 > URL: https://issues.apache.org/jira/browse/HBASE-28546 > Project: HBase > Issue Type: Bug >Reporter: Wei-Chiu Chuang >Assignee: Wei-Chiu Chuang >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0-alpha-1, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Occasionally we see errors like this that doesn't really give much clue what > went wrong. > {noformat} > 2024-04-22 08:08:02,026 ERROR org.apache.hadoop.hbase.master.HMaster: * > ABORTING master ccycloud-7.ozn-hb973chf3oz.xyz,22001,1713770648404: Log > rolling failed * > java.lang.RuntimeException > at > org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:217) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeMagicAndWALHeader(AsyncProtobufLogWriter.java:223) > at > org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:164) > at > org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:726) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:129) > at > org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:886) > at > org.apache.hadoop.hbase.wal.AbstractWALRoller$RollController.rollWal(AbstractWALRoller.java:304) > at > org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:211) > {noformat} > In this case, it was due to a time out exception. It would be helpful to make > the log message more friendly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28619) Fix the inaccurate message when snapshot doesn't exist
[ https://issues.apache.org/jira/browse/HBASE-28619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851351#comment-17851351 ] Hudson commented on HBASE-28619: Results for branch branch-2.6 [build #130 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/130/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Fix the inaccurate message when snapshot doesn't exist > -- > > Key: HBASE-28619 > URL: https://issues.apache.org/jira/browse/HBASE-28619 > Project: HBase > Issue Type: Bug > Components: snapshots >Affects Versions: 2.4.13 >Reporter: guluo >Priority: Minor > Labels: pull-request-available > > We would get the as following message when restore a non-existing snapshot. > {code:java} > hbase:021:0> restore_snapshot 'non_existing_snap' > ERROR: Unable to find the table name for snapshot=non_existing_snap > For usage try 'help "restore_snapshot"' > Took 0.0170 seconds {code} > > ERROR: {color:#FF}Unable to find the table{color} name for > snapshot=non_existing_snap > This error message is inaccurate. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28546) Make WAL rolling exception clear
[ https://issues.apache.org/jira/browse/HBASE-28546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851338#comment-17851338 ] Hudson commented on HBASE-28546: Results for branch master [build #1086 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1086/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1086/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1086/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1086/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make WAL rolling exception clear > > > Key: HBASE-28546 > URL: https://issues.apache.org/jira/browse/HBASE-28546 > Project: HBase > Issue Type: Bug >Reporter: Wei-Chiu Chuang >Assignee: Wei-Chiu Chuang >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0-alpha-1, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Occasionally we see errors like this that doesn't really give much clue what > went wrong. > {noformat} > 2024-04-22 08:08:02,026 ERROR org.apache.hadoop.hbase.master.HMaster: * > ABORTING master ccycloud-7.ozn-hb973chf3oz.xyz,22001,1713770648404: Log > rolling failed * > java.lang.RuntimeException > at > org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:217) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeMagicAndWALHeader(AsyncProtobufLogWriter.java:223) > at > org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:164) > at > org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:726) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:129) > at > org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:886) > at > org.apache.hadoop.hbase.wal.AbstractWALRoller$RollController.rollWal(AbstractWALRoller.java:304) > at > org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:211) > {noformat} > In this case, it was due to a time out exception. It would be helpful to make > the log message more friendly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28420) Aborting Active HMaster is not rejecting remote Procedure Reports
[ https://issues.apache.org/jira/browse/HBASE-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851337#comment-17851337 ] Hudson commented on HBASE-28420: Results for branch master [build #1086 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1086/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1086/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1086/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1086/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Aborting Active HMaster is not rejecting remote Procedure Reports > - > > Key: HBASE-28420 > URL: https://issues.apache.org/jira/browse/HBASE-28420 > Project: HBase > Issue Type: Bug > Components: master, proc-v2 >Affects Versions: 2.4.17, 2.5.8 >Reporter: Umesh Kumar Kumawat >Assignee: Umesh Kumar Kumawat >Priority: Critical > Labels: pull-request-available > > When the Active Hmaster is in the process of abortion and another HMaster is > becoming Active HMaster,at the same time if any region server reports the > completion of the remote procedure, it generally goes to the old active > HMaster because of the cached value of rssStub -> > [code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L2829] > ([caller > method|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L3941]). > On the Master side > ([code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java#L2381]), > It did check if the service is started but that returns true if the master > is in the process of abortion(I didn't see when we are setting this flag > false while abortion). > This issue becomes *critical* when *ServerCrash of meta hosting RS and master > failover* happens at the same time and hbase:meta got stuck in the offline > state. > Logs for abortion start of HMaster > {noformat} > 2024-02-02 07:33:11,581 ERROR [PEWorker-6] master.HMaster - * ABORTING > master server4-1xxx,61000,1705169084562: > FAILED persisting region=52d36581218e00a2668776cfea897132 state=CLOSING > *{noformat} > {noformat} > 2024-02-02 07:33:40,999 INFO [master/server4-1xxx:61000] > regionserver.HRegionServer - Exiting; > stopping=hbase2b-mnds4-1-ia2.ops.sfdc.net,61000,1705169084562; zookeeper > connection closed.{noformat} > it took almost 30 seconds to abort the HMaster. > > Logs of starting SCP for meta carrying host. (This SCP is started by the new > active HMaster) > {noformat} > 2024-02-02 07:33:32,622 INFO [aster/server3-1xxx61000:becomeActiveMaster] > assignment.AssignmentManager - Scheduled > ServerCrashProcedure pid=3305546 for server5-1xxx61020,1706857451955 > (carryingMeta=true) server5-1- > xxx61020,1706857451955/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@1b0a5293[Write > > locks = 1, Read locks = 0], oldState=ONLINE.{noformat} > initialization of remote procedure > {noformat} > 2024-02-02 07:33:33,178 INFO [PEWorker-4] procedure2.ProcedureExecutor - > Initialized subprocedures=[{pid=3305548, > ppid=3305547, state=RUNNABLE; SplitWALRemoteProcedure server5-1- > t%2C61020%2C1706857451955.meta.1706858156058.meta, > worker=server4-1-,61020,1705169180881}]{noformat} > Logs of remote procedure handling on Old Active Hmaster(server4-1xxx,61000) > (in the process of abortion) > {noformat} > 2024-02-02 07:33:37,990 DEBUG > [r.default.FPBQ.Fifo.handler=243,queue=9,port=61000] master.HMaster - Remote > procedure > done, pid=3305548{noformat} > This should be handled by the new active HMaster so that it can wake up the > suspended Procedure on the new Active Hmaster. As the new ActiveHMaster was > not able to wake that up, SCP procedure got stuck thus meta stayed OFFLINE. > > Logs of Hmaster trying to becomeActivehmaster but stuck- > {noformat} > 2024-02-02 07:33:43,159 WARN [aster/server3-1-ia2:61000:becomeActiveMaster] > master.HMaster - hbase:meta,,1.1588230740 > is NOT online; state={1588230740 state=OPEN,
[jira] [Commented] (HBASE-28546) Make WAL rolling exception clear
[ https://issues.apache.org/jira/browse/HBASE-28546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851336#comment-17851336 ] Hudson commented on HBASE-28546: Results for branch branch-3 [build #218 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/218/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/218/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/218/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/218/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make WAL rolling exception clear > > > Key: HBASE-28546 > URL: https://issues.apache.org/jira/browse/HBASE-28546 > Project: HBase > Issue Type: Bug >Reporter: Wei-Chiu Chuang >Assignee: Wei-Chiu Chuang >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0-alpha-1, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Occasionally we see errors like this that doesn't really give much clue what > went wrong. > {noformat} > 2024-04-22 08:08:02,026 ERROR org.apache.hadoop.hbase.master.HMaster: * > ABORTING master ccycloud-7.ozn-hb973chf3oz.xyz,22001,1713770648404: Log > rolling failed * > java.lang.RuntimeException > at > org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:217) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeMagicAndWALHeader(AsyncProtobufLogWriter.java:223) > at > org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:164) > at > org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:726) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:129) > at > org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:886) > at > org.apache.hadoop.hbase.wal.AbstractWALRoller$RollController.rollWal(AbstractWALRoller.java:304) > at > org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:211) > {noformat} > In this case, it was due to a time out exception. It would be helpful to make > the log message more friendly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28420) Aborting Active HMaster is not rejecting remote Procedure Reports
[ https://issues.apache.org/jira/browse/HBASE-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851335#comment-17851335 ] Hudson commented on HBASE-28420: Results for branch branch-3 [build #218 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/218/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/218/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/218/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/218/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Aborting Active HMaster is not rejecting remote Procedure Reports > - > > Key: HBASE-28420 > URL: https://issues.apache.org/jira/browse/HBASE-28420 > Project: HBase > Issue Type: Bug > Components: master, proc-v2 >Affects Versions: 2.4.17, 2.5.8 >Reporter: Umesh Kumar Kumawat >Assignee: Umesh Kumar Kumawat >Priority: Critical > Labels: pull-request-available > > When the Active Hmaster is in the process of abortion and another HMaster is > becoming Active HMaster,at the same time if any region server reports the > completion of the remote procedure, it generally goes to the old active > HMaster because of the cached value of rssStub -> > [code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L2829] > ([caller > method|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L3941]). > On the Master side > ([code|https://github.com/apache/hbase/blob/branch-2.5/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java#L2381]), > It did check if the service is started but that returns true if the master > is in the process of abortion(I didn't see when we are setting this flag > false while abortion). > This issue becomes *critical* when *ServerCrash of meta hosting RS and master > failover* happens at the same time and hbase:meta got stuck in the offline > state. > Logs for abortion start of HMaster > {noformat} > 2024-02-02 07:33:11,581 ERROR [PEWorker-6] master.HMaster - * ABORTING > master server4-1xxx,61000,1705169084562: > FAILED persisting region=52d36581218e00a2668776cfea897132 state=CLOSING > *{noformat} > {noformat} > 2024-02-02 07:33:40,999 INFO [master/server4-1xxx:61000] > regionserver.HRegionServer - Exiting; > stopping=hbase2b-mnds4-1-ia2.ops.sfdc.net,61000,1705169084562; zookeeper > connection closed.{noformat} > it took almost 30 seconds to abort the HMaster. > > Logs of starting SCP for meta carrying host. (This SCP is started by the new > active HMaster) > {noformat} > 2024-02-02 07:33:32,622 INFO [aster/server3-1xxx61000:becomeActiveMaster] > assignment.AssignmentManager - Scheduled > ServerCrashProcedure pid=3305546 for server5-1xxx61020,1706857451955 > (carryingMeta=true) server5-1- > xxx61020,1706857451955/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@1b0a5293[Write > > locks = 1, Read locks = 0], oldState=ONLINE.{noformat} > initialization of remote procedure > {noformat} > 2024-02-02 07:33:33,178 INFO [PEWorker-4] procedure2.ProcedureExecutor - > Initialized subprocedures=[{pid=3305548, > ppid=3305547, state=RUNNABLE; SplitWALRemoteProcedure server5-1- > t%2C61020%2C1706857451955.meta.1706858156058.meta, > worker=server4-1-,61020,1705169180881}]{noformat} > Logs of remote procedure handling on Old Active Hmaster(server4-1xxx,61000) > (in the process of abortion) > {noformat} > 2024-02-02 07:33:37,990 DEBUG > [r.default.FPBQ.Fifo.handler=243,queue=9,port=61000] master.HMaster - Remote > procedure > done, pid=3305548{noformat} > This should be handled by the new active HMaster so that it can wake up the > suspended Procedure on the new Active Hmaster. As the new ActiveHMaster was > not able to wake that up, SCP procedure got stuck thus meta stayed OFFLINE. > > Logs of Hmaster trying to becomeActivehmaster but stuck- > {noformat} > 2024-02-02 07:33:43,159 WARN [aster/server3-1-ia2:61000:becomeActiveMaster] > master.HMaster - hbase:meta,,1.1588230740 > is NOT online; state={1588230740
[jira] [Commented] (HBASE-28546) Make WAL rolling exception clear
[ https://issues.apache.org/jira/browse/HBASE-28546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851332#comment-17851332 ] Hudson commented on HBASE-28546: Results for branch branch-2.5 [build #539 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/539/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/539/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/539/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/539/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/539/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Make WAL rolling exception clear > > > Key: HBASE-28546 > URL: https://issues.apache.org/jira/browse/HBASE-28546 > Project: HBase > Issue Type: Bug >Reporter: Wei-Chiu Chuang >Assignee: Wei-Chiu Chuang >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0-alpha-1, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Occasionally we see errors like this that doesn't really give much clue what > went wrong. > {noformat} > 2024-04-22 08:08:02,026 ERROR org.apache.hadoop.hbase.master.HMaster: * > ABORTING master ccycloud-7.ozn-hb973chf3oz.xyz,22001,1713770648404: Log > rolling failed * > java.lang.RuntimeException > at > org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeWALMetadata(AsyncProtobufLogWriter.java:217) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.writeMagicAndWALHeader(AsyncProtobufLogWriter.java:223) > at > org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:164) > at > org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:116) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:726) > at > org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:129) > at > org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:886) > at > org.apache.hadoop.hbase.wal.AbstractWALRoller$RollController.rollWal(AbstractWALRoller.java:304) > at > org.apache.hadoop.hbase.wal.AbstractWALRoller.run(AbstractWALRoller.java:211) > {noformat} > In this case, it was due to a time out exception. It would be helpful to make > the log message more friendly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28628) Use Base64.getUrlEncoder().withoutPadding() in REST tests
[ https://issues.apache.org/jira/browse/HBASE-28628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851249#comment-17851249 ] Hudson commented on HBASE-28628: Results for branch branch-2.6 [build #129 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/129/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/129/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/129/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/129/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.6/129/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Base64.getUrlEncoder().withoutPadding() in REST tests > - > > Key: HBASE-28628 > URL: https://issues.apache.org/jira/browse/HBASE-28628 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available, test > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The encoder returned by java.util.Base64.getUrlEncoder() is unsuitable for > the purpose. > To get an encoder that is actually usable in URLs, > java.util.Base64.getUrlEncoder().withoutPadding() must be used. > The relevant Java bug is https://bugs.openjdk.org/browse/JDK-8026330 , > however instead of fixing the encoder, Java has decided to keep the broken > default, and add the .withoutPadding() method as a way to get a working one. > Due to sheer luck (or rather bad luck), this is not triggered in our tests, > but anyone using them as a template will be in for a ride when hit by this > problem. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28628) Use Base64.getUrlEncoder().withoutPadding() in REST tests
[ https://issues.apache.org/jira/browse/HBASE-28628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851203#comment-17851203 ] Hudson commented on HBASE-28628: Results for branch branch-2.5 [build #538 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/538/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/538/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/538/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/538/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/538/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Base64.getUrlEncoder().withoutPadding() in REST tests > - > > Key: HBASE-28628 > URL: https://issues.apache.org/jira/browse/HBASE-28628 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available, test > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The encoder returned by java.util.Base64.getUrlEncoder() is unsuitable for > the purpose. > To get an encoder that is actually usable in URLs, > java.util.Base64.getUrlEncoder().withoutPadding() must be used. > The relevant Java bug is https://bugs.openjdk.org/browse/JDK-8026330 , > however instead of fixing the encoder, Java has decided to keep the broken > default, and add the .withoutPadding() method as a way to get a working one. > Due to sheer luck (or rather bad luck), this is not triggered in our tests, > but anyone using them as a template will be in for a ride when hit by this > problem. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28628) Use Base64.getUrlEncoder().withoutPadding() in REST tests
[ https://issues.apache.org/jira/browse/HBASE-28628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851202#comment-17851202 ] Hudson commented on HBASE-28628: Results for branch master [build #1085 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1085/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1085/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1085/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1085/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Base64.getUrlEncoder().withoutPadding() in REST tests > - > > Key: HBASE-28628 > URL: https://issues.apache.org/jira/browse/HBASE-28628 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available, test > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The encoder returned by java.util.Base64.getUrlEncoder() is unsuitable for > the purpose. > To get an encoder that is actually usable in URLs, > java.util.Base64.getUrlEncoder().withoutPadding() must be used. > The relevant Java bug is https://bugs.openjdk.org/browse/JDK-8026330 , > however instead of fixing the encoder, Java has decided to keep the broken > default, and add the .withoutPadding() method as a way to get a working one. > Due to sheer luck (or rather bad luck), this is not triggered in our tests, > but anyone using them as a template will be in for a ride when hit by this > problem. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28628) Use Base64.getUrlEncoder().withoutPadding() in REST tests
[ https://issues.apache.org/jira/browse/HBASE-28628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851201#comment-17851201 ] Hudson commented on HBASE-28628: Results for branch branch-3 [build #217 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/217/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/217/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/217/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/217/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Base64.getUrlEncoder().withoutPadding() in REST tests > - > > Key: HBASE-28628 > URL: https://issues.apache.org/jira/browse/HBASE-28628 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available, test > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The encoder returned by java.util.Base64.getUrlEncoder() is unsuitable for > the purpose. > To get an encoder that is actually usable in URLs, > java.util.Base64.getUrlEncoder().withoutPadding() must be used. > The relevant Java bug is https://bugs.openjdk.org/browse/JDK-8026330 , > however instead of fixing the encoder, Java has decided to keep the broken > default, and add the .withoutPadding() method as a way to get a working one. > Due to sheer luck (or rather bad luck), this is not triggered in our tests, > but anyone using them as a template will be in for a ride when hit by this > problem. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28628) Use Base64.getUrlEncoder().withoutPadding() in REST tests
[ https://issues.apache.org/jira/browse/HBASE-28628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850946#comment-17850946 ] Hudson commented on HBASE-28628: Results for branch branch-2 [build #1067 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1067/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1067/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1067/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1067/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1067/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use Base64.getUrlEncoder().withoutPadding() in REST tests > - > > Key: HBASE-28628 > URL: https://issues.apache.org/jira/browse/HBASE-28628 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available, test > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > The encoder returned by java.util.Base64.getUrlEncoder() is unsuitable for > the purpose. > To get an encoder that is actually usable in URLs, > java.util.Base64.getUrlEncoder().withoutPadding() must be used. > The relevant Java bug is https://bugs.openjdk.org/browse/JDK-8026330 , > however instead of fixing the encoder, Java has decided to keep the broken > default, and add the .withoutPadding() method as a way to get a working one. > Due to sheer luck (or rather bad luck), this is not triggered in our tests, > but anyone using them as a template will be in for a ride when hit by this > problem. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28582) ModifyTableProcedure should not reset TRSP on region node when closing unused region replicas
[ https://issues.apache.org/jira/browse/HBASE-28582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850860#comment-17850860 ] Hudson commented on HBASE-28582: Results for branch master [build #1084 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1084/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1084/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1084/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1084/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > ModifyTableProcedure should not reset TRSP on region node when closing unused > region replicas > - > > Key: HBASE-28582 > URL: https://issues.apache.org/jira/browse/HBASE-28582 > Project: HBase > Issue Type: Bug > Components: proc-v2 >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Critical > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > Found this when digging HBASE-28522. > First, this is not safe as MTP does not like DTP where we hold the exclusive > lock all the time. > Second, even if we hold the exclusive lock all the time, as showed in > HBASE-28522, we may still hang there forever because SCP will not interrupt > the TRSP. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28626) MultiRowRangeFilter deserialization fails in org.apache.hadoop.hbase.rest.model.ScannerModel
[ https://issues.apache.org/jira/browse/HBASE-28626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850861#comment-17850861 ] Hudson commented on HBASE-28626: Results for branch master [build #1084 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1084/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1084/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1084/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1084/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > MultiRowRangeFilter deserialization fails in > org.apache.hadoop.hbase.rest.model.ScannerModel > > > Key: HBASE-28626 > URL: https://issues.apache.org/jira/browse/HBASE-28626 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.9 > > > org.apache.hadoop.hbase.filter.MultiRowRangeFilter.BasicRowRange has several > getters that have no corresponing setters. > jackson serializes the pseudo-getters' values, but when it tries to > deserialize, there are no corresponding setters and it errors out. > {noformat} > com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException: > Unrecognized field "ascendingOrder" (class > org.apache.hadoop.hbase.filter.MultiRowRangeFilter$RowRange), not marked as > ignorable (4 known properties: "startRow", "startRowInclusive", "stopRow", > "stopRowInclusive"]) > at [Source: > (String)"{"type":"FilterList","op":"MUST_PASS_ALL","comparator":null,"value":null,"filters":[{"type":"MultiRowRangeFilter","op":null,"comparator":null,"value":null,"filters":null,"limit":null,"offset":null,"family":null,"qualifier":null,"ifMissing":null,"latestVersion":null,"minColumn":null,"minColumnInclusive":null,"maxColumn":null,"maxColumnInclusive":null,"dropDependentColumn":null,"chance":null,"prefixes":null,"ranges":[{"startRow":"MQ==","startRowInclusive":true,"stopRow":"MQ==","stopRowInclusive":t"[truncated > 553 chars]; line: 1, column: 526] (through reference chain: > org.apache.hadoop.hbase.rest.model.ScannerModel$FilterModel["filters"]->java.util.ArrayList[0]->org.apache.hadoop.hbase.rest.model.ScannerModel$FilterModel["ranges"]->java.util.ArrayList[0]->org.apache.hadoop.hbase.filter.MultiRowRangeFilter$RowRange["ascendingOrder"]) > at > com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException.from(UnrecognizedPropertyException.java:61) > at > com.fasterxml.jackson.databind.DeserializationContext.handleUnknownProperty(DeserializationContext.java:1127) > at > com.fasterxml.jackson.databind.deser.std.StdDeserializer.handleUnknownProperty(StdDeserializer.java:2036) > at > com.fasterxml.jackson.databind.deser.BeanDeserializerBase.handleUnknownProperty(BeanDeserializerBase.java:1700) > at > com.fasterxml.jackson.databind.deser.BeanDeserializerBase.handleUnknownVanilla(BeanDeserializerBase.java:1678) > at > com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:320) > at > com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:177) > at > com.fasterxml.jackson.databind.deser.std.CollectionDeserializer._deserializeFromArray(CollectionDeserializer.java:355) > at > com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:244) > at > com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:28) > at > com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:138) > at > com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:314) > at > com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:177) > at > com.fasterxml.jackson.databind.deser.std.CollectionDeserializer._deserializeFromArray(CollectionDeserializer.java:355) > at >