[jira] [Updated] (HBASE-28519) HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1

2024-04-12 Thread Ke Han (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ke Han updated HBASE-28519:
---
Description: 
h1. Reproduce

Step1: Start up HBase-2.5.8 cluster: 4 nodes: 1 HM, 2 RS, 1 HDFS 
(hadoop-2.10.2).

Step2: Perform a full-stop upgrade to HBase-3.0.0-beta-1 cluster: 1 HM, 2 RS, 1 
HDFS (hadoop-2.10.2). +(No command is needed before the upgrade)+

HMaster aborts with the following exception
{code:java}
2024-04-13T03:47:15,969 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: Failed to become active master
java.lang.IllegalStateException: Expected the service ClusterSchemaServiceImpl 
[FAILED] to be RUNNING, but the service has FAILED
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
 ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
        at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: 
Failed 2 actions: RetriesExhaustedException: 2 times, servers with issues: 
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.makeError(BufferedMutatorOverAsyncBufferedMutator.java:107)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.internalFlush(BufferedMutatorOverAsyncBufferedMutator.java:122)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.close(BufferedMutatorOverAsyncBufferedMutator.java:166)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.TableNamespaceManager.migrateNamespaceTable(TableNamespaceManager.java:92)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:122)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.ClusterSchemaServiceImpl.doStart(ClusterSchemaServiceImpl.java:61)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.startAsync(AbstractService.java:252)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1532)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        ... 5 more
2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: Master server abort: loaded coprocessors are: 
[org.apache.hadoop.hbase.quotas.MasterQuotasObserver]
2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: * ABORTING master hmaster,16000,1712980015693: Unhandled 
exception. Starting shutdown. *
java.lang.IllegalStateException: Expected the service ClusterSchemaServiceImpl 
[FAILED] to be RUNNING, but the service has FAILED
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
 ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
        

[jira] [Updated] (HBASE-28519) HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1

2024-04-12 Thread Ke Han (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ke Han updated HBASE-28519:
---
Description: 
h1. Reproduce

Start up HBase-2.5.8 cluster: 4 nodes: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).

Then directly perform a full-stop upgrade to HBase-3.0.0-beta-1 cluster: 1 HM, 
2 RS, 1 HDFS (hadoop-2.10.2). (No command is needed before the upgrade)

HMaster aborts with the following exception:
{code:java}
2024-04-13T03:47:15,969 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: Failed to become active master
java.lang.IllegalStateException: Expected the service ClusterSchemaServiceImpl 
[FAILED] to be RUNNING, but the service has FAILED
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
 ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
        at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: 
Failed 2 actions: RetriesExhaustedException: 2 times, servers with issues: 
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.makeError(BufferedMutatorOverAsyncBufferedMutator.java:107)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.internalFlush(BufferedMutatorOverAsyncBufferedMutator.java:122)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.close(BufferedMutatorOverAsyncBufferedMutator.java:166)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.TableNamespaceManager.migrateNamespaceTable(TableNamespaceManager.java:92)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:122)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.ClusterSchemaServiceImpl.doStart(ClusterSchemaServiceImpl.java:61)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.startAsync(AbstractService.java:252)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1532)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        ... 5 more
2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: Master server abort: loaded coprocessors are: 
[org.apache.hadoop.hbase.quotas.MasterQuotasObserver]
2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: * ABORTING master hmaster,16000,1712980015693: Unhandled 
exception. Starting shutdown. *
java.lang.IllegalStateException: Expected the service ClusterSchemaServiceImpl 
[FAILED] to be RUNNING, but the service has FAILED
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
 ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 

[jira] [Updated] (HBASE-28519) HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1

2024-04-12 Thread Ke Han (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ke Han updated HBASE-28519:
---
Priority: Critical  (was: Major)

> HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1
> ---
>
> Key: HBASE-28519
> URL: https://issues.apache.org/jira/browse/HBASE-28519
> Project: HBase
>  Issue Type: Bug
>  Components: master
>Affects Versions: 3.0.0-alpha-1, 3.0.0-alpha-4, 3.0.0-beta-1, 2.5.8
>Reporter: Ke Han
>Priority: Critical
> Attachments: all_logs.tar.gz, hbase--master-64f850a4e287.log
>
>
> h1. Reproduce
> Start up HBase-2.5.8 cluster: 4 nodes: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
> Execute one read command: LIST, then perform a full-stop upgrade to 
> HBase-3.0.0-beta-1 cluster: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
> HMaster aborts with the following exception:
> {code:java}
> 2024-04-13T03:47:15,969 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: Failed to become active master
> java.lang.IllegalStateException: Expected the service 
> ClusterSchemaServiceImpl [FAILED] to be RUNNING, but the service has FAILED
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
> ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
>  ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
> Caused by: 
> org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2 
> actions: RetriesExhaustedException: 2 times, servers with issues: 
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.makeError(BufferedMutatorOverAsyncBufferedMutator.java:107)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.internalFlush(BufferedMutatorOverAsyncBufferedMutator.java:122)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.close(BufferedMutatorOverAsyncBufferedMutator.java:166)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.migrateNamespaceTable(TableNamespaceManager.java:92)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:122)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.ClusterSchemaServiceImpl.doStart(ClusterSchemaServiceImpl.java:61)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.startAsync(AbstractService.java:252)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1532)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         ... 5 more
> 2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: Master server abort: loaded coprocessors are: 
> [org.apache.hadoop.hbase.quotas.MasterQuotasObserver]
> 2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: * ABORTING master hmaster,16000,1712980015693: Unhandled 
> exception. Starting shutdown. *
> java.lang.IllegalStateException: Expected the service 
> ClusterSchemaServiceImpl [FAILED] to be RUNNING, but the service has FAILED
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> 

[jira] [Updated] (HBASE-28519) HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1

2024-04-12 Thread Ke Han (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ke Han updated HBASE-28519:
---
Component/s: master

> HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1
> ---
>
> Key: HBASE-28519
> URL: https://issues.apache.org/jira/browse/HBASE-28519
> Project: HBase
>  Issue Type: Bug
>  Components: master
>Affects Versions: 3.0.0-alpha-1, 3.0.0-alpha-4, 3.0.0-beta-1, 2.5.8
>Reporter: Ke Han
>Priority: Major
> Attachments: all_logs.tar.gz, hbase--master-64f850a4e287.log
>
>
> h1. Reproduce
> Start up HBase-2.5.8 cluster: 4 nodes: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
> Execute one read command: LIST, then perform a full-stop upgrade to 
> HBase-3.0.0-beta-1 cluster: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
> HMaster aborts with the following exception:
> {code:java}
> 2024-04-13T03:47:15,969 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: Failed to become active master
> java.lang.IllegalStateException: Expected the service 
> ClusterSchemaServiceImpl [FAILED] to be RUNNING, but the service has FAILED
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
> ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
>  ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
> Caused by: 
> org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2 
> actions: RetriesExhaustedException: 2 times, servers with issues: 
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.makeError(BufferedMutatorOverAsyncBufferedMutator.java:107)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.internalFlush(BufferedMutatorOverAsyncBufferedMutator.java:122)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.close(BufferedMutatorOverAsyncBufferedMutator.java:166)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.migrateNamespaceTable(TableNamespaceManager.java:92)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:122)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.ClusterSchemaServiceImpl.doStart(ClusterSchemaServiceImpl.java:61)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.startAsync(AbstractService.java:252)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1532)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         ... 5 more
> 2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: Master server abort: loaded coprocessors are: 
> [org.apache.hadoop.hbase.quotas.MasterQuotasObserver]
> 2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: * ABORTING master hmaster,16000,1712980015693: Unhandled 
> exception. Starting shutdown. *
> java.lang.IllegalStateException: Expected the service 
> ClusterSchemaServiceImpl [FAILED] to be RUNNING, but the service has FAILED
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> 

[jira] [Updated] (HBASE-28519) HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1

2024-04-12 Thread Ke Han (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ke Han updated HBASE-28519:
---
Attachment: all_logs.tar.gz

> HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1
> ---
>
> Key: HBASE-28519
> URL: https://issues.apache.org/jira/browse/HBASE-28519
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 3.0.0-alpha-1, 3.0.0-alpha-4, 3.0.0-beta-1, 2.5.8
>Reporter: Ke Han
>Priority: Major
> Attachments: all_logs.tar.gz, hbase--master-64f850a4e287.log
>
>
> h1. Reproduce
> Start up HBase-2.5.8 cluster: 4 nodes: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
> Execute one read command: LIST, then perform a full-stop upgrade to 
> HBase-3.0.0-beta-1 cluster: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
> HMaster aborts with the following exception:
> {code:java}
> 2024-04-13T03:47:15,969 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: Failed to become active master
> java.lang.IllegalStateException: Expected the service 
> ClusterSchemaServiceImpl [FAILED] to be RUNNING, but the service has FAILED
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
> ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
>  ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
> Caused by: 
> org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2 
> actions: RetriesExhaustedException: 2 times, servers with issues: 
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.makeError(BufferedMutatorOverAsyncBufferedMutator.java:107)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.internalFlush(BufferedMutatorOverAsyncBufferedMutator.java:122)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.close(BufferedMutatorOverAsyncBufferedMutator.java:166)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.migrateNamespaceTable(TableNamespaceManager.java:92)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:122)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.ClusterSchemaServiceImpl.doStart(ClusterSchemaServiceImpl.java:61)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.startAsync(AbstractService.java:252)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1532)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         ... 5 more
> 2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: Master server abort: loaded coprocessors are: 
> [org.apache.hadoop.hbase.quotas.MasterQuotasObserver]
> 2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: * ABORTING master hmaster,16000,1712980015693: Unhandled 
> exception. Starting shutdown. *
> java.lang.IllegalStateException: Expected the service 
> ClusterSchemaServiceImpl [FAILED] to be RUNNING, but the service has FAILED
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> 

[jira] [Updated] (HBASE-28519) HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1

2024-04-12 Thread Ke Han (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ke Han updated HBASE-28519:
---
Description: 
h1. Reproduce

Start up HBase-2.5.8 cluster: 4 nodes: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).

Execute one read command: LIST, then perform a full-stop upgrade to 
HBase-3.0.0-beta-1 cluster: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).

HMaster aborts with the following exception:
{code:java}
2024-04-13T03:47:15,969 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: Failed to become active master
java.lang.IllegalStateException: Expected the service ClusterSchemaServiceImpl 
[FAILED] to be RUNNING, but the service has FAILED
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
 ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
        at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: 
Failed 2 actions: RetriesExhaustedException: 2 times, servers with issues: 
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.makeError(BufferedMutatorOverAsyncBufferedMutator.java:107)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.internalFlush(BufferedMutatorOverAsyncBufferedMutator.java:122)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.close(BufferedMutatorOverAsyncBufferedMutator.java:166)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.TableNamespaceManager.migrateNamespaceTable(TableNamespaceManager.java:92)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:122)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.ClusterSchemaServiceImpl.doStart(ClusterSchemaServiceImpl.java:61)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.startAsync(AbstractService.java:252)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1532)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        ... 5 more
2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: Master server abort: loaded coprocessors are: 
[org.apache.hadoop.hbase.quotas.MasterQuotasObserver]
2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: * ABORTING master hmaster,16000,1712980015693: Unhandled 
exception. Starting shutdown. *
java.lang.IllegalStateException: Expected the service ClusterSchemaServiceImpl 
[FAILED] to be RUNNING, but the service has FAILED
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
 ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 

[jira] [Updated] (HBASE-28519) HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1

2024-04-12 Thread Ke Han (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ke Han updated HBASE-28519:
---
Attachment: hbase--master-64f850a4e287.log

> HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1
> ---
>
> Key: HBASE-28519
> URL: https://issues.apache.org/jira/browse/HBASE-28519
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 3.0.0-alpha-1, 3.0.0-alpha-4, 3.0.0-beta-1, 2.5.8
>Reporter: Ke Han
>Priority: Major
> Attachments: hbase--master-64f850a4e287.log
>
>
> h1. Reproduce
> Start up HBase-2.5.8 cluster: 4 nodes: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
> Execute one read command: LIST, then perform a full-stop upgrade to 
> HBase-3.0.0-beta-1 cluster: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
> HMaster aborts with the following exception:
> {code:java}
> 2024-04-13T03:47:15,969 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: Failed to become active master
> java.lang.IllegalStateException: Expected the service 
> ClusterSchemaServiceImpl [FAILED] to be RUNNING, but the service has FAILED
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
> ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
>  ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
> Caused by: 
> org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2 
> actions: RetriesExhaustedException: 2 times, servers with issues: 
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.makeError(BufferedMutatorOverAsyncBufferedMutator.java:107)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.internalFlush(BufferedMutatorOverAsyncBufferedMutator.java:122)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.close(BufferedMutatorOverAsyncBufferedMutator.java:166)
>  ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.migrateNamespaceTable(TableNamespaceManager.java:92)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:122)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hadoop.hbase.master.ClusterSchemaServiceImpl.doStart(ClusterSchemaServiceImpl.java:61)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.startAsync(AbstractService.java:252)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1532)
>  ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
>         ... 5 more
> 2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: Master server abort: loaded coprocessors are: 
> [org.apache.hadoop.hbase.quotas.MasterQuotasObserver]
> 2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
> master.HMaster: * ABORTING master hmaster,16000,1712980015693: Unhandled 
> exception. Starting shutdown. *
> java.lang.IllegalStateException: Expected the service 
> ClusterSchemaServiceImpl [FAILED] to be RUNNING, but the service has FAILED
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
>  ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
>         at 
> 

[jira] [Created] (HBASE-28519) HMaster crash when upgrading from HBase-2.5.8 to HBase-3.0.0-beta-1

2024-04-12 Thread Ke Han (Jira)
Ke Han created HBASE-28519:
--

 Summary: HMaster crash when upgrading from HBase-2.5.8 to 
HBase-3.0.0-beta-1
 Key: HBASE-28519
 URL: https://issues.apache.org/jira/browse/HBASE-28519
 Project: HBase
  Issue Type: Bug
Affects Versions: 2.5.8, 3.0.0-beta-1, 3.0.0-alpha-4, 3.0.0-alpha-1
Reporter: Ke Han


h1. Reproduce

Start up HBase-2.5.8 cluster: 4 nodes: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).
 * HDFS is running Hadoop-2.10.2

Execute one read command: LIST, then perform a full-stop upgrade to 
HBase-3.0.0-beta-1 cluster: 1 HM, 2 RS, 1 HDFS (hadoop-2.10.2).

HMaster will abort with the following exception

 
{code:java}
2024-04-13T03:47:15,969 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: Failed to become active master
java.lang.IllegalStateException: Expected the service ClusterSchemaServiceImpl 
[FAILED] to be RUNNING, but the service has FAILED
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:613) 
~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.trace.TraceUtil.lambda$tracedRunnable$2(TraceUtil.java:155)
 ~[hbase-common-3.0.0-beta-1.jar:3.0.0-beta-1]
        at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: 
Failed 2 actions: RetriesExhaustedException: 2 times, servers with issues: 
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.makeError(BufferedMutatorOverAsyncBufferedMutator.java:107)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.internalFlush(BufferedMutatorOverAsyncBufferedMutator.java:122)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.client.BufferedMutatorOverAsyncBufferedMutator.close(BufferedMutatorOverAsyncBufferedMutator.java:166)
 ~[hbase-client-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.TableNamespaceManager.migrateNamespaceTable(TableNamespaceManager.java:92)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:122)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.ClusterSchemaServiceImpl.doStart(ClusterSchemaServiceImpl.java:61)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.startAsync(AbstractService.java:252)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1532)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        ... 5 more
2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: Master server abort: loaded coprocessors are: 
[org.apache.hadoop.hbase.quotas.MasterQuotasObserver]
2024-04-13T03:47:15,970 ERROR [master/hmaster:16000:becomeActiveMaster] 
master.HMaster: * ABORTING master hmaster,16000,1712980015693: Unhandled 
exception. Starting shutdown. *
java.lang.IllegalStateException: Expected the service ClusterSchemaServiceImpl 
[FAILED] to be RUNNING, but the service has FAILED
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:384)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hbase.thirdparty.com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:324)
 ~[hbase-shaded-miscellaneous-4.1.5.jar:4.1.5]
        at 
org.apache.hadoop.hbase.master.HMaster.initClusterSchemaService(HMaster.java:1535)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1204)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2494)
 ~[hbase-server-3.0.0-beta-1.jar:3.0.0-beta-1]
        at 

[jira] [Resolved] (HBASE-28498) fix spotless:check errors

2024-04-12 Thread Duo Zhang (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang resolved HBASE-28498.
---
Fix Version/s: 2.6.0
 Hadoop Flags: Reviewed
   Resolution: Fixed

Merged to branch-2.6+.

Thanks [~nikitapande]!

> fix spotless:check errors
> -
>
> Key: HBASE-28498
> URL: https://issues.apache.org/jira/browse/HBASE-28498
> Project: HBase
>  Issue Type: Improvement
>Affects Versions: 2.6.0
>Reporter: Nikita Pande
>Assignee: Nikita Pande
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.6.0
>
>
>  I have observed that mvn spotless:check gives error on branch-2.6
> {noformat}
> The following files had format violations:
> [ERROR]     RELEASENOTES.md{noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5823:
URL: https://github.com/apache/hbase/pull/5823#issuecomment-2053013389

   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 35s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  3s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 42s |  master passed  |
   | +1 :green_heart: |  compile  |   0m 44s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   5m 15s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 26s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 30s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 43s |  the patch passed  |
   | +1 :green_heart: |  javac  |   0m 43s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   5m 12s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 25s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  unit  | 240m 10s |  hbase-server in the patch passed.  
|
   |  |   | 263m 14s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.45 ServerAPI=1.45 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5823 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux 26a3dd21de9d 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 
23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Temurin-1.8.0_352-b08 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/testReport/
 |
   | Max. process+thread count | 4919 (vs. ulimit of 3) |
   | modules | C: hbase-server U: hbase-server |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28498 fix spotless:check errors [hbase]

2024-04-12 Thread via GitHub


Apache9 merged PR #5801:
URL: https://github.com/apache/hbase/pull/5801


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5823:
URL: https://github.com/apache/hbase/pull/5823#issuecomment-2052976926

   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 26s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  2s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   3m 17s |  master passed  |
   | +1 :green_heart: |  compile  |   0m 48s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   5m 55s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 26s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 58s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 48s |  the patch passed  |
   | +1 :green_heart: |  javac  |   0m 48s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   5m 52s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 25s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  unit  | 219m 14s |  hbase-server in the patch passed.  
|
   |  |   | 244m  7s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.43 ServerAPI=1.43 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5823 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux ef87458b881a 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 
23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-11.0.17+8 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/testReport/
 |
   | Max. process+thread count | 5107 (vs. ulimit of 3) |
   | modules | C: hbase-server U: hbase-server |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5823:
URL: https://github.com/apache/hbase/pull/5823#issuecomment-2052950637

   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 16s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  3s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 51s |  master passed  |
   | +1 :green_heart: |  compile  |   0m 55s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   5m 13s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 28s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 48s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 54s |  the patch passed  |
   | +1 :green_heart: |  javac  |   0m 54s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   5m 16s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 28s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  unit  | 211m 37s |  hbase-server in the patch passed.  
|
   |  |   | 235m  0s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.45 ServerAPI=1.45 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5823 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux 1eab0b7068d8 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 
23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-17.0.10+7 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/testReport/
 |
   | Max. process+thread count | 5540 (vs. ulimit of 3) |
   | modules | C: hbase-server U: hbase-server |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5823:
URL: https://github.com/apache/hbase/pull/5823#issuecomment-2052637779

   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 27s |  Docker mode activated.  |
   ||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  No case conflicting files 
found.  |
   | +1 :green_heart: |  hbaseanti  |   0m  0s |  Patch does not have any 
anti-patterns.  |
   | +1 :green_heart: |  @author  |   0m  0s |  The patch does not contain any 
@author tags.  |
   ||| _ master Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 57s |  master passed  |
   | +1 :green_heart: |  compile  |   2m 37s |  master passed  |
   | +1 :green_heart: |  checkstyle  |   0m 37s |  master passed  |
   | +1 :green_heart: |  spotless  |   0m 44s |  branch has no errors when 
running spotless:check.  |
   | +1 :green_heart: |  spotbugs  |   1m 33s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 59s |  the patch passed  |
   | +1 :green_heart: |  compile  |   2m 36s |  the patch passed  |
   | -0 :warning: |  javac  |   2m 36s |  hbase-server generated 1 new + 194 
unchanged - 1 fixed = 195 total (was 195)  |
   | +1 :green_heart: |  checkstyle  |   0m 36s |  the patch passed  |
   | +1 :green_heart: |  whitespace  |   0m  0s |  The patch has no whitespace 
issues.  |
   | +1 :green_heart: |  hadoopcheck  |   5m 31s |  Patch does not cause any 
errors with Hadoop 3.3.6.  |
   | +1 :green_heart: |  spotless  |   0m 44s |  patch has no errors when 
running spotless:check.  |
   | +1 :green_heart: |  spotbugs  |   1m 39s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  asflicense  |   0m  8s |  The patch does not generate 
ASF License warnings.  |
   |  |   |  30m  6s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.43 ServerAPI=1.43 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/artifact/yetus-general-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5823 |
   | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti 
spotless checkstyle compile |
   | uname | Linux 66205be1eab1 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 
23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-11.0.17+8 |
   | javac | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/artifact/yetus-general-check/output/diff-compile-javac-hbase-server.txt
 |
   | Max. process+thread count | 81 (vs. ulimit of 3) |
   | modules | C: hbase-server U: hbase-server |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/2/console 
|
   | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5823:
URL: https://github.com/apache/hbase/pull/5823#issuecomment-2052611610

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 17s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  2s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   4m 34s |  master passed  |
   | +1 :green_heart: |  compile  |   1m 12s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   6m 18s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 35s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   4m 14s |  the patch passed  |
   | +1 :green_heart: |  compile  |   1m  9s |  the patch passed  |
   | +1 :green_heart: |  javac  |   1m  9s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   6m 12s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 29s |  the patch passed  |
   ||| _ Other Tests _ |
   | -1 :x: |  unit  | 335m  9s |  hbase-server in the patch failed.  |
   |  |   | 365m  1s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.45 ServerAPI=1.45 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5823 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux 2556eb507b86 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 
23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-11.0.17+8 |
   | unit | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/testReport/
 |
   | Max. process+thread count | 4876 (vs. ulimit of 3) |
   | modules | C: hbase-server U: hbase-server |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5823:
URL: https://github.com/apache/hbase/pull/5823#issuecomment-2052598648

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 18s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  2s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   4m 29s |  master passed  |
   | +1 :green_heart: |  compile  |   1m 18s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   6m 10s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 37s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   4m  2s |  the patch passed  |
   | +1 :green_heart: |  compile  |   1m  9s |  the patch passed  |
   | +1 :green_heart: |  javac  |   1m  9s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   6m  7s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 31s |  the patch passed  |
   ||| _ Other Tests _ |
   | -1 :x: |  unit  | 320m  8s |  hbase-server in the patch failed.  |
   |  |   | 349m 50s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.45 ServerAPI=1.45 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5823 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux 1898799b7b79 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 
23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-17.0.10+7 |
   | unit | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-jdk17-hadoop3-check/output/patch-unit-hbase-server.txt
 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/testReport/
 |
   | Max. process+thread count | 4752 (vs. ulimit of 3) |
   | modules | C: hbase-server U: hbase-server |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Commented] (HBASE-28506) Remove hbase-compression-xz

2024-04-12 Thread Andrew Kyle Purtell (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-28506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836748#comment-17836748
 ] 

Andrew Kyle Purtell commented on HBASE-28506:
-

Thanks [~bbeaudreault] and [~zhangduo] for the reviews

> Remove hbase-compression-xz
> ---
>
> Key: HBASE-28506
> URL: https://issues.apache.org/jira/browse/HBASE-28506
> Project: HBase
>  Issue Type: Task
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.6.0, 3.0.0-beta-2
>
>
> Refer to [https://lists.apache.org/thread/on62z40rwotrcc8w1l5n55rd4zldho5g] .
> Deprecate in 2.5.x, remove in 2.6.
> I will add a release note when resolving this issue.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (HBASE-28507) Deprecate hbase-compression-xz

2024-04-12 Thread Andrew Kyle Purtell (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-28507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836747#comment-17836747
 ] 

Andrew Kyle Purtell commented on HBASE-28507:
-

Thanks [~bbeaudreault] and [~zhangduo] for the reviews

> Deprecate hbase-compression-xz
> --
>
> Key: HBASE-28507
> URL: https://issues.apache.org/jira/browse/HBASE-28507
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.5.9
>
>
> Refer to [https://lists.apache.org/thread/on62z40rwotrcc8w1l5n55rd4zldho5g] .
> Deprecate in 2.5.x.
> I will add a release note when resolving this issue.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] HBASE-28507 Deprecate hbase-compression-xz [hbase]

2024-04-12 Thread via GitHub


apurtell merged PR #5810:
URL: https://github.com/apache/hbase/pull/5810


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (HBASE-28507) Deprecate hbase-compression-xz

2024-04-12 Thread Andrew Kyle Purtell (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Kyle Purtell updated HBASE-28507:

Hadoop Flags: Reviewed
  Resolution: Fixed
  Status: Resolved  (was: Patch Available)

> Deprecate hbase-compression-xz
> --
>
> Key: HBASE-28507
> URL: https://issues.apache.org/jira/browse/HBASE-28507
> Project: HBase
>  Issue Type: Sub-task
>Reporter: Andrew Kyle Purtell
>Assignee: Andrew Kyle Purtell
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.5.9
>
>
> Refer to [https://lists.apache.org/thread/on62z40rwotrcc8w1l5n55rd4zldho5g] .
> Deprecate in 2.5.x.
> I will add a release note when resolving this issue.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (HBASE-27826) Region split and merge time while offline is O(n) with respect to number of store files

2024-04-12 Thread Andrew Kyle Purtell (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-27826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836743#comment-17836743
 ] 

Andrew Kyle Purtell commented on HBASE-27826:
-

We can use this issue as an umbrella and break up changes into subtasks with 
small scope that will be easy to review.

> Region split and merge time while offline is O(n) with respect to number of 
> store files
> ---
>
> Key: HBASE-27826
> URL: https://issues.apache.org/jira/browse/HBASE-27826
> Project: HBase
>  Issue Type: Bug
>Affects Versions: 2.5.4
>Reporter: Andrew Kyle Purtell
>Priority: Major
> Fix For: 2.7.0, 3.0.0-beta-2
>
>
> This is a significant availability issue when HFiles are on S3. =
> HBASE-26079 ({_}Use StoreFileTracker when splitting and merging{_}) changed 
> the split and merge table procedure implementations to indirect through the 
> StoreFileTracker implementation when selecting HFiles to be merged or split, 
> rather than directly listing those using file system APIs. It also changed 
> the commit logic in HRegionFileSystem to add the link/ref files on resulting 
> split or merged regions to the StoreFileTracker. However, the creation of a 
> link file is still a filesystem operation and creating a “file” on S3 can 
> take well over a second. If, for example there are 20 store files in a 
> region, which is not uncommon, after the region is taken offline for a split 
> (or merge) it may require more than 20 seconds to create the link files 
> before the results can be brought back online, creating a severe availability 
> problem. Splits and merges are supposed to be fast, completing in less than a 
> second, certainly less than a few seconds. This has been true when HFiles are 
> stored on HDFS only because file creation operations there are nearly 
> instantaneous. 
> There are two issues but both can be handled with modifications to the store 
> file tracker interface and the file based store file tracker implementation. 
> When the file based store file file tracker is enabled the HFile links should 
> be virtual entities that only exist in the file manifest. We do not require 
> physical files in the filesystem to serve as links now. That is the magic of 
> the this file tracker, the manifest file replaces requirements to list the 
> filesystem.
> Then, when splitting or merging, the HFile links should be collected into a 
> list and committed in one batch using a new FILE file tracker interface, 
> requiring only one update of the manifest file in S3, bringing the time 
> requirement for this operation to O(1) down from O[n].



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5823:
URL: https://github.com/apache/hbase/pull/5823#issuecomment-205261

   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 27s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  3s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 47s |  master passed  |
   | +1 :green_heart: |  compile  |   0m 40s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   5m 40s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 25s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   2m 24s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 38s |  the patch passed  |
   | +1 :green_heart: |  javac  |   0m 38s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   5m 35s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 22s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  unit  | 226m 12s |  hbase-server in the patch passed.  
|
   |  |   | 249m 10s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.43 ServerAPI=1.43 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5823 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux 6a7381d0d9ab 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 
23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Temurin-1.8.0_352-b08 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/testReport/
 |
   | Max. process+thread count | 4970 (vs. ulimit of 3) |
   | modules | C: hbase-server U: hbase-server |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Work started] (HBASE-28514) HBase web console automatically listing directories in static/css

2024-04-12 Thread Shanmukha Haripriya Kota (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on HBASE-28514 started by Shanmukha Haripriya Kota.

> HBase web console automatically listing directories in static/css
> -
>
> Key: HBASE-28514
> URL: https://issues.apache.org/jira/browse/HBASE-28514
> Project: HBase
>  Issue Type: Bug
>  Components: UI
>Reporter: Shanmukha Haripriya Kota
>Assignee: Shanmukha Haripriya Kota
>Priority: Major
>
> HBase web console automatically lists directories present in 
> \{link-to-master-ui}/static/css. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (HBASE-28508) Remove the need for ADMIN permissions for RSRpcServices#execRegionServerService

2024-04-12 Thread Rushabh Shah (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-28508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836720#comment-17836720
 ] 

Rushabh Shah commented on HBASE-28508:
--

> For region server level CPs, I think requiring ADMIN permission is 
> reasonable...

IMO it depends on the implementation of the region server CPs to decide whether 
it is reasonable.

> Remove the need for ADMIN permissions for 
> RSRpcServices#execRegionServerService
> ---
>
> Key: HBASE-28508
> URL: https://issues.apache.org/jira/browse/HBASE-28508
> Project: HBase
>  Issue Type: Bug
>  Components: acl
>Affects Versions: 2.4.17, 2.5.8
>Reporter: Rushabh Shah
>Assignee: Rushabh Shah
>Priority: Major
>  Labels: pull-request-available
>
> We have introduced a new regionserver coproc within phoenix and all the 
> permission related tests are failing with the following exception.
> {noformat}
> Caused by: 
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.security.AccessDeniedException):
>  org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient 
> permissions for user 'groupUser_N42' (global, action=ADMIN)
>   at 
> org.apache.hadoop.hbase.security.access.AccessChecker.requireGlobalPermission(AccessChecker.java:152)
>   at 
> org.apache.hadoop.hbase.security.access.AccessChecker.requirePermission(AccessChecker.java:125)
>   at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.requirePermission(RSRpcServices.java:1318)
>   at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.rpcPreCheck(RSRpcServices.java:584)
>   at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execRegionServerService(RSRpcServices.java:3804)
>   at 
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45016)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:415)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:124)
>   at org.apache.hadoop.hbase.ipc.RpcHandler.run(RpcHandler.java:102)
>   at org.apache.hadoop.hbase.ipc.RpcHandler.run(RpcHandler.java:82)
> {noformat}
> This check is failing. 
> [RSRpcServices|https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java#L3815]
> {code}
>   @Override
>   public CoprocessorServiceResponse execRegionServerService(RpcController 
> controller,
> CoprocessorServiceRequest request) throws ServiceException {
> rpcPreCheck("execRegionServerService");
> return server.execRegionServerService(controller, request);
>   }
>   private void rpcPreCheck(String requestName) throws ServiceException {
> try {
>   checkOpen();
>   requirePermission(requestName, Permission.Action.ADMIN);
> } catch (IOException ioe) {
>   throw new ServiceException(ioe);
> }
>   }
> {code}
> Why do we need ADMIN permissions to call region server coproc? We don't need 
> ADMIN permissions to call all region co-procs. We require ADMIN permissions 
> to execute some region coprocs (compactionSwitch, clearRegionBlockCache).
> Can we change the permission to READ? 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5823:
URL: https://github.com/apache/hbase/pull/5823#issuecomment-2052075005

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 30s |  Docker mode activated.  |
   ||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  No case conflicting files 
found.  |
   | +1 :green_heart: |  hbaseanti  |   0m  0s |  Patch does not have any 
anti-patterns.  |
   | +1 :green_heart: |  @author  |   0m  0s |  The patch does not contain any 
@author tags.  |
   ||| _ master Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   3m 23s |  master passed  |
   | +1 :green_heart: |  compile  |   2m 38s |  master passed  |
   | +1 :green_heart: |  checkstyle  |   0m 38s |  master passed  |
   | +1 :green_heart: |  spotless  |   0m 46s |  branch has no errors when 
running spotless:check.  |
   | +1 :green_heart: |  spotbugs  |   1m 35s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   3m  3s |  the patch passed  |
   | +1 :green_heart: |  compile  |   2m 36s |  the patch passed  |
   | -0 :warning: |  javac  |   2m 36s |  hbase-server generated 1 new + 194 
unchanged - 1 fixed = 195 total (was 195)  |
   | -0 :warning: |  checkstyle  |   0m 35s |  hbase-server: The patch 
generated 1 new + 4 unchanged - 0 fixed = 5 total (was 4)  |
   | +1 :green_heart: |  whitespace  |   0m  0s |  The patch has no whitespace 
issues.  |
   | +1 :green_heart: |  hadoopcheck  |   5m 35s |  Patch does not cause any 
errors with Hadoop 3.3.6.  |
   | -1 :x: |  spotless  |   0m 39s |  patch has 44 errors when running 
spotless:check, run spotless:apply to fix.  |
   | +1 :green_heart: |  spotbugs  |   1m 42s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  asflicense  |   0m 11s |  The patch does not generate 
ASF License warnings.  |
   |  |   |  30m 49s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.43 ServerAPI=1.43 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-general-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5823 |
   | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti 
spotless checkstyle compile |
   | uname | Linux 4f67ece1d2b1 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 
23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-11.0.17+8 |
   | javac | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-server.txt
 |
   | checkstyle | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt
 |
   | spotless | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/artifact/yetus-general-check/output/patch-spotless.txt
 |
   | Max. process+thread count | 82 (vs. ulimit of 3) |
   | modules | C: hbase-server U: hbase-server |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5823/1/console 
|
   | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28518 Allow specifying a filter for the REST multiget endpoint [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5822:
URL: https://github.com/apache/hbase/pull/5822#issuecomment-2052042392

   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 27s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  2s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 12s |  Maven dependency ordering for branch  |
   | +1 :green_heart: |  mvninstall  |   3m  8s |  master passed  |
   | +1 :green_heart: |  compile  |   0m 36s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   5m 38s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 28s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 10s |  Maven dependency ordering for patch  |
   | +1 :green_heart: |  mvninstall  |   2m 55s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 38s |  the patch passed  |
   | +1 :green_heart: |  javac  |   0m 38s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   5m 37s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 28s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  unit  |   1m 28s |  hbase-client in the patch passed.  
|
   | +1 :green_heart: |  unit  |   3m 38s |  hbase-rest in the patch passed.  |
   |  |   |  26m 40s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.43 ServerAPI=1.43 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5822 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux d5ba3f9d86f8 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 
23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-17.0.10+7 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/testReport/
 |
   | Max. process+thread count | 1745 (vs. ulimit of 3) |
   | modules | C: hbase-client hbase-rest U: . |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28518 Allow specifying a filter for the REST multiget endpoint [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5822:
URL: https://github.com/apache/hbase/pull/5822#issuecomment-2052042127

   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 42s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  2s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 11s |  Maven dependency ordering for branch  |
   | +1 :green_heart: |  mvninstall  |   2m 56s |  master passed  |
   | +1 :green_heart: |  compile  |   0m 40s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   5m 18s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 34s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 15s |  Maven dependency ordering for patch  |
   | +1 :green_heart: |  mvninstall  |   2m 50s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 39s |  the patch passed  |
   | +1 :green_heart: |  javac  |   0m 39s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   5m 12s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 33s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  unit  |   1m 37s |  hbase-client in the patch passed.  
|
   | +1 :green_heart: |  unit  |   3m 35s |  hbase-rest in the patch passed.  |
   |  |   |  26m 39s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.45 ServerAPI=1.45 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5822 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux 3c974b7f9ab1 5.4.0-174-generic #193-Ubuntu SMP Thu Mar 7 
14:29:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-11.0.17+8 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/testReport/
 |
   | Max. process+thread count | 1760 (vs. ulimit of 3) |
   | modules | C: hbase-client hbase-rest U: . |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28518 Allow specifying a filter for the REST multiget endpoint [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5822:
URL: https://github.com/apache/hbase/pull/5822#issuecomment-2052041653

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 37s |  Docker mode activated.  |
   ||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  No case conflicting files 
found.  |
   | +1 :green_heart: |  hbaseanti  |   0m  0s |  Patch does not have any 
anti-patterns.  |
   | +1 :green_heart: |  @author  |   0m  0s |  The patch does not contain any 
@author tags.  |
   ||| _ master Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 11s |  Maven dependency ordering for branch  |
   | +1 :green_heart: |  mvninstall  |   3m  3s |  master passed  |
   | +1 :green_heart: |  compile  |   1m  8s |  master passed  |
   | +1 :green_heart: |  checkstyle  |   0m 29s |  master passed  |
   | +1 :green_heart: |  spotless  |   0m 44s |  branch has no errors when 
running spotless:check.  |
   | +1 :green_heart: |  spotbugs  |   1m 15s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 12s |  Maven dependency ordering for patch  |
   | +1 :green_heart: |  mvninstall  |   2m 49s |  the patch passed  |
   | +1 :green_heart: |  compile  |   1m  6s |  the patch passed  |
   | -0 :warning: |  javac  |   0m 28s |  hbase-rest generated 2 new + 161 
unchanged - 4 fixed = 163 total (was 165)  |
   | -0 :warning: |  checkstyle  |   0m 10s |  hbase-rest: The patch generated 
3 new + 0 unchanged - 0 fixed = 3 total (was 0)  |
   | +1 :green_heart: |  whitespace  |   0m  0s |  The patch has no whitespace 
issues.  |
   | +1 :green_heart: |  hadoopcheck  |   4m 59s |  Patch does not cause any 
errors with Hadoop 3.3.6.  |
   | -1 :x: |  spotless  |   0m 41s |  patch has 66 errors when running 
spotless:check, run spotless:apply to fix.  |
   | +1 :green_heart: |  spotbugs  |   1m 32s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  asflicense  |   0m 21s |  The patch does not generate 
ASF License warnings.  |
   |  |   |  26m 11s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.45 ServerAPI=1.45 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/artifact/yetus-general-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5822 |
   | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti 
spotless checkstyle compile |
   | uname | Linux 0530e4b9aba3 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 
23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Eclipse Adoptium-11.0.17+8 |
   | javac | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-rest.txt
 |
   | checkstyle | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-rest.txt
 |
   | spotless | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/artifact/yetus-general-check/output/patch-spotless.txt
 |
   | Max. process+thread count | 77 (vs. ulimit of 3) |
   | modules | C: hbase-client hbase-rest U: . |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/console 
|
   | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28518 Allow specifying a filter for the REST multiget endpoint [hbase]

2024-04-12 Thread via GitHub


Apache-HBase commented on PR #5822:
URL: https://github.com/apache/hbase/pull/5822#issuecomment-2052038253

   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   0m 41s |  Docker mode activated.  |
   | -0 :warning: |  yetus  |   0m  3s |  Unprocessed flag(s): 
--brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list 
--whitespace-tabs-ignore-list --quick-hadoopcheck  |
   ||| _ Prechecks _ |
   ||| _ master Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m  8s |  Maven dependency ordering for branch  |
   | +1 :green_heart: |  mvninstall  |   2m 29s |  master passed  |
   | +1 :green_heart: |  compile  |   0m 37s |  master passed  |
   | +1 :green_heart: |  shadedjars  |   5m  8s |  branch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 29s |  master passed  |
   ||| _ Patch Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 14s |  Maven dependency ordering for patch  |
   | +1 :green_heart: |  mvninstall  |   2m 27s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 36s |  the patch passed  |
   | +1 :green_heart: |  javac  |   0m 36s |  the patch passed  |
   | +1 :green_heart: |  shadedjars  |   5m  9s |  patch has no errors when 
building our shaded downstream artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 29s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  unit  |   1m 16s |  hbase-client in the patch passed.  
|
   | +1 :green_heart: |  unit  |   3m 31s |  hbase-rest in the patch passed.  |
   |  |   |  24m 39s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.45 ServerAPI=1.45 base: 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hbase/pull/5822 |
   | Optional Tests | javac javadoc unit shadedjars compile |
   | uname | Linux f17988291c87 5.4.0-174-generic #193-Ubuntu SMP Thu Mar 7 
14:29:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/hbase-personality.sh |
   | git revision | master / 5a8ae13055 |
   | Default Java | Temurin-1.8.0_352-b08 |
   |  Test Results | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/testReport/
 |
   | Max. process+thread count | 1642 (vs. ulimit of 3) |
   | modules | C: hbase-client hbase-rest U: . |
   | Console output | 
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5822/1/console 
|
   | versions | git=2.34.1 maven=3.8.6 |
   | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (HBASE-28517) Make properties dynamically configured

2024-04-12 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HBASE-28517:
---
Labels: pull-request-available  (was: )

> Make properties dynamically configured
> --
>
> Key: HBASE-28517
> URL: https://issues.apache.org/jira/browse/HBASE-28517
> Project: HBase
>  Issue Type: Improvement
>Reporter: Abhishek Kothalikar
>Assignee: Abhishek Kothalikar
>Priority: Major
>  Labels: pull-request-available
>
> Make following properties dynamically configured, 
>   hbase.rs.evictblocksonclose
>   hbase.rs.cacheblocksonwrite
>   hbase.block.data.cacheonread
> for use case scenarios where configuring them dynamically would help in 
> achieving better throughput.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[PR] HBASE-28517 Make properties dynamically configured [hbase]

2024-04-12 Thread via GitHub


kabhishek4 opened a new pull request, #5823:
URL: https://github.com/apache/hbase/pull/5823

   Make following properties dynamically configured, 
   
 hbase.rs.evictblocksonclose
 hbase.rs.cacheblocksonwrite
 hbase.block.data.cacheonread
   
   for use case scenarios where configuring them dynamically would help in 
achieving better throughput.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (HBASE-28518) Allow specifying a filter for the REST multiget endpoint

2024-04-12 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HBASE-28518:
---
Labels: pull-request-available  (was: )

> Allow specifying a filter for the REST multiget endpoint
> 
>
> Key: HBASE-28518
> URL: https://issues.apache.org/jira/browse/HBASE-28518
> Project: HBase
>  Issue Type: Improvement
>  Components: REST
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
>  Labels: pull-request-available
>
> The native HBase API allows specifying Filters for get operations.
> The REST interface does not currently expose this functionality.
> Add a parameter to the multiget enpoint to allow specifying filters.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HBASE-28518) Allow specifying a filter for the REST multiget endpoint

2024-04-12 Thread Istvan Toth (Jira)
Istvan Toth created HBASE-28518:
---

 Summary: Allow specifying a filter for the REST multiget endpoint
 Key: HBASE-28518
 URL: https://issues.apache.org/jira/browse/HBASE-28518
 Project: HBase
  Issue Type: Improvement
  Components: REST
Reporter: Istvan Toth
Assignee: Istvan Toth


The native HBase API allows specifying Filters for get operations.
The REST interface does not currently expose this functionality.

Add a parameter to the multiget enpoint to allow specifying filters.




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HBASE-28517) Make properties dynamically configured

2024-04-12 Thread Abhishek Kothalikar (Jira)
Abhishek Kothalikar created HBASE-28517:
---

 Summary: Make properties dynamically configured
 Key: HBASE-28517
 URL: https://issues.apache.org/jira/browse/HBASE-28517
 Project: HBase
  Issue Type: Improvement
Reporter: Abhishek Kothalikar
Assignee: Abhishek Kothalikar


Make following properties dynamically configured, 

  hbase.rs.evictblocksonclose
  hbase.rs.cacheblocksonwrite
  hbase.block.data.cacheonread


for use case scenarios where configuring them dynamically would help in 
achieving better throughput.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] HBASE-28509 ScanResumer.resume would perform unnecessary scan when cl… [hbase]

2024-04-12 Thread via GitHub


Apache9 commented on code in PR #5817:
URL: https://github.com/apache/hbase/pull/5817#discussion_r1562669213


##
hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncTableResultScanner.java:
##
@@ -143,6 +144,18 @@ private void resumePrefetch() {
 resumer = null;
   }
 
+  private void termianteResumerIfPossible() {

Review Comment:
   Typo? terminateResumerIfPossible.



##
hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncTableResultScanner.java:
##
@@ -143,6 +144,18 @@ private void resumePrefetch() {
 resumer = null;
   }
 
+  private void termianteResumerIfPossible() {
+if (resumer == null) {
+  return;
+}
+if (resumer instanceof ScanResumerImpl) {
+  ((ScanResumerImpl) resumer).terminate();

Review Comment:
   Better add some comments here to explain why we have a cast here, instead of 
introduing a method directly in ScanResumer.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Commented] (HBASE-28508) Remove the need for ADMIN permissions for RSRpcServices#execRegionServerService

2024-04-12 Thread Duo Zhang (Jira)


[ 
https://issues.apache.org/jira/browse/HBASE-28508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836643#comment-17836643
 ] 

Duo Zhang commented on HBASE-28508:
---

For region server level CPs, I think requiring ADMIN permission is reasonable...

> Remove the need for ADMIN permissions for 
> RSRpcServices#execRegionServerService
> ---
>
> Key: HBASE-28508
> URL: https://issues.apache.org/jira/browse/HBASE-28508
> Project: HBase
>  Issue Type: Bug
>  Components: acl
>Affects Versions: 2.4.17, 2.5.8
>Reporter: Rushabh Shah
>Assignee: Rushabh Shah
>Priority: Major
>  Labels: pull-request-available
>
> We have introduced a new regionserver coproc within phoenix and all the 
> permission related tests are failing with the following exception.
> {noformat}
> Caused by: 
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.security.AccessDeniedException):
>  org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient 
> permissions for user 'groupUser_N42' (global, action=ADMIN)
>   at 
> org.apache.hadoop.hbase.security.access.AccessChecker.requireGlobalPermission(AccessChecker.java:152)
>   at 
> org.apache.hadoop.hbase.security.access.AccessChecker.requirePermission(AccessChecker.java:125)
>   at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.requirePermission(RSRpcServices.java:1318)
>   at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.rpcPreCheck(RSRpcServices.java:584)
>   at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execRegionServerService(RSRpcServices.java:3804)
>   at 
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45016)
>   at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:415)
>   at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:124)
>   at org.apache.hadoop.hbase.ipc.RpcHandler.run(RpcHandler.java:102)
>   at org.apache.hadoop.hbase.ipc.RpcHandler.run(RpcHandler.java:82)
> {noformat}
> This check is failing. 
> [RSRpcServices|https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java#L3815]
> {code}
>   @Override
>   public CoprocessorServiceResponse execRegionServerService(RpcController 
> controller,
> CoprocessorServiceRequest request) throws ServiceException {
> rpcPreCheck("execRegionServerService");
> return server.execRegionServerService(controller, request);
>   }
>   private void rpcPreCheck(String requestName) throws ServiceException {
> try {
>   checkOpen();
>   requirePermission(requestName, Permission.Action.ADMIN);
> } catch (IOException ioe) {
>   throw new ServiceException(ioe);
> }
>   }
> {code}
> Why do we need ADMIN permissions to call region server coproc? We don't need 
> ADMIN permissions to call all region co-procs. We require ADMIN permissions 
> to execute some region coprocs (compactionSwitch, clearRegionBlockCache).
> Can we change the permission to READ? 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (HBASE-28516) Bump idna from 2.8 to 3.7 in /dev-support/git-jira-release-audit

2024-04-12 Thread Duo Zhang (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang resolved HBASE-28516.
---
Fix Version/s: 4.0.0-alpha-1
 Hadoop Flags: Reviewed
   Resolution: Fixed

Merged to master.

> Bump idna from 2.8 to 3.7 in /dev-support/git-jira-release-audit
> 
>
> Key: HBASE-28516
> URL: https://issues.apache.org/jira/browse/HBASE-28516
> Project: HBase
>  Issue Type: Task
>  Components: dependabot, scripts, security
>Reporter: Duo Zhang
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0.0-alpha-1
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (HBASE-28516) Bump idna from 2.8 to 3.7 in /dev-support/git-jira-release-audit

2024-04-12 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HBASE-28516:
---
Labels: pull-request-available  (was: )

> Bump idna from 2.8 to 3.7 in /dev-support/git-jira-release-audit
> 
>
> Key: HBASE-28516
> URL: https://issues.apache.org/jira/browse/HBASE-28516
> Project: HBase
>  Issue Type: Task
>  Components: dependabot, scripts, security
>Reporter: Duo Zhang
>Priority: Major
>  Labels: pull-request-available
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] HBASE-28516 Bump idna from 2.8 to 3.7 in /dev-support/git-jira-release-audit [hbase]

2024-04-12 Thread via GitHub


Apache9 merged PR #5821:
URL: https://github.com/apache/hbase/pull/5821


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Created] (HBASE-28516) Bump idna from 2.8 to 3.7 in /dev-support/git-jira-release-audit

2024-04-12 Thread Duo Zhang (Jira)
Duo Zhang created HBASE-28516:
-

 Summary: Bump idna from 2.8 to 3.7 in 
/dev-support/git-jira-release-audit
 Key: HBASE-28516
 URL: https://issues.apache.org/jira/browse/HBASE-28516
 Project: HBase
  Issue Type: Task
  Components: dependabot, scripts, security
Reporter: Duo Zhang






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] HBASE-28466 Integration of time-based priority logic of bucket cache in prefetch functionality of HBase [hbase]

2024-04-12 Thread via GitHub


vinayakphegde commented on code in PR #5808:
URL: https://github.com/apache/hbase/pull/5808#discussion_r1562404151


##
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFilePreadReader.java:
##
@@ -37,6 +38,17 @@ public class HFilePreadReader extends HFileReaderImpl {
   public HFilePreadReader(ReaderContext context, HFileInfo fileInfo, 
CacheConfig cacheConf,
 Configuration conf) throws IOException {
 super(context, fileInfo, cacheConf, conf);
+
+try {
+  DataTieringManager dataTieringManager = DataTieringManager.getInstance();
+  if (!dataTieringManager.isHotData(this)) {
+LOG.debug("Data tiering is enabled for path '{}' and it is not hot 
data", path);
+return;
+  }
+} catch (IllegalStateException e) {
+  LOG.error("Error while getting DataTieringManager instance: {}", 
e.getMessage());

Review Comment:
   Another option is something like below.
   ```
   public HFilePreadReader(ReaderContext context, HFileInfo fileInfo, 
CacheConfig cacheConf,
   Configuration conf) throws IOException {
   super(context, fileInfo, cacheConf, conf);
   
   boolean isHotData = true;
   try {
 DataTieringManager dataTieringManager = 
DataTieringManager.getInstance();
 isHotData = dataTieringManager.isHotData(this);
   } catch (IllegalStateException e) {
 LOG.error("Error while getting DataTieringManager instance: {}", 
e.getMessage());
   }
   
   final MutableBoolean shouldCache = new MutableBoolean(true);
   
   boolean finalIsHotData = isHotData;
   cacheConf.getBlockCache().ifPresent(cache -> {
 Optional result = cache.shouldCacheFile(path.getName(), 
finalIsHotData);
 shouldCache.setValue(result.isPresent() ? result.get().booleanValue() 
: true);
   });
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28466 Integration of time-based priority logic of bucket cache in prefetch functionality of HBase [hbase]

2024-04-12 Thread via GitHub


vinayakphegde commented on code in PR #5808:
URL: https://github.com/apache/hbase/pull/5808#discussion_r1562353642


##
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFilePreadReader.java:
##
@@ -37,6 +38,17 @@ public class HFilePreadReader extends HFileReaderImpl {
   public HFilePreadReader(ReaderContext context, HFileInfo fileInfo, 
CacheConfig cacheConf,
 Configuration conf) throws IOException {
 super(context, fileInfo, cacheConf, conf);
+
+try {
+  DataTieringManager dataTieringManager = DataTieringManager.getInstance();
+  if (!dataTieringManager.isHotData(this)) {
+LOG.debug("Data tiering is enabled for path '{}' and it is not hot 
data", path);
+return;
+  }
+} catch (IllegalStateException e) {
+  LOG.error("Error while getting DataTieringManager instance: {}", 
e.getMessage());

Review Comment:
   Got it. How should I proceed? The `DataTieringManager#isHotData()` method 
requires `HFilePreadReader`. Should I update the existing `shouldCacheFile` 
method to pass `HFilePreadReader` like this?
   ```
   @Override
 public Optional shouldCacheFile(HFilePreadReader reader) {
   try {
 DataTieringManager dataTieringManager = 
DataTieringManager.getInstance();
 if (!dataTieringManager.isHotData(reader)) {
   LOG.debug("Data tiering is enabled for path '{}' and it is not hot 
data", reader.getPath());
   return Optional.of(false);
 }
   } catch (IllegalStateException e) {
 LOG.error("Error while getting DataTieringManager instance: {}", 
e.getMessage());
   }
   
   // if we don't have the file in fullyCachedFiles, we should cache it
   String fileName = reader.getPath().getName();
   return Optional.of(!fullyCachedFiles.containsKey(fileName));
 }
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28447 New site configuration option "hfile.block.size" [hbase]

2024-04-12 Thread via GitHub


gourabtaparia commented on code in PR #5820:
URL: https://github.com/apache/hbase/pull/5820#discussion_r1562328719


##
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreUtils.java:
##
@@ -204,4 +204,28 @@ public static long getStorefileFieldSize(HStoreFile file, 
ToLongFunction
+   * If the schema specifies a non default block size, use it.
+   * Otherwise, if the configuration specifies a non default block size, 
use it.
+   * Otherwise, use the default block size.
+   * 
+   * The default is defined by HConstants.DEFAULT_BLOCKSIZE.
+   * @param confThe configuration, can be null. Use the store 
configuration wherever
+   *possible so we properly support site configuration 
overrides.
+   * @param schemaBlockSize The block size as specified in the column family 
schema.
+   * @return The block size to use.
+   */
+  public static int getBlockSize(Configuration conf, int schemaBlockSize) {

Review Comment:
   A clarification : 
   
   Though you have already called out the "non default block size" - One 
Question - Right now there can be a case where the site configuration has non 
default block size say 1MB(to be applied to all the table/CF), and for some 
CF/table one wants explicitly 64 KB - so setting 64KB explicitly again in the 
schema won't be picked, as that is the default. 
   
   For such cases, one will need to explicitly set the schemaBlocksize(either 
BLOCKSIZE or configuration override in schema) for all required tables to 1MB. 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Resolved] (HBASE-28505) Implement enforcement to require Date Tiered Compaction for Time Range Data Tiering

2024-04-12 Thread Wellington Chevreuil (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wellington Chevreuil resolved HBASE-28505.
--
Resolution: Fixed

Merged into HBASE-28463 feature branch.

> Implement enforcement to require Date Tiered Compaction for Time Range Data 
> Tiering
> ---
>
> Key: HBASE-28505
> URL: https://issues.apache.org/jira/browse/HBASE-28505
> Project: HBase
>  Issue Type: Task
>Reporter: Vinayak Hegde
>Assignee: Vinayak Hegde
>Priority: Major
>  Labels: pull-request-available
>
> The implementation should enforce the requirement of enabling Date Tiered 
> Compaction for Time Range Data Tiering. This restriction ensures that users 
> can fully benefit from Time Range Data Tiering functionality by disallowing 
> its usage unless Date Tiered Compaction is enabled.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] HBASE-28505 Implement enforcement to require Date Tiered Compaction for Time Range Data Tiering [hbase]

2024-04-12 Thread via GitHub


wchevreuil merged PR #5809:
URL: https://github.com/apache/hbase/pull/5809


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] HBASE-28466 Integration of time-based priority logic of bucket cache in prefetch functionality of HBase [hbase]

2024-04-12 Thread via GitHub


wchevreuil commented on code in PR #5808:
URL: https://github.com/apache/hbase/pull/5808#discussion_r1562274788


##
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFilePreadReader.java:
##
@@ -37,6 +38,17 @@ public class HFilePreadReader extends HFileReaderImpl {
   public HFilePreadReader(ReaderContext context, HFileInfo fileInfo, 
CacheConfig cacheConf,
 Configuration conf) throws IOException {
 super(context, fileInfo, cacheConf, conf);
+
+try {
+  DataTieringManager dataTieringManager = DataTieringManager.getInstance();
+  if (!dataTieringManager.isHotData(this)) {
+LOG.debug("Data tiering is enabled for path '{}' and it is not hot 
data", path);
+return;
+  }
+} catch (IllegalStateException e) {
+  LOG.error("Error while getting DataTieringManager instance: {}", 
e.getMessage());

Review Comment:
   Please move this to BucketCache.shouldCacheFile implementation. Any caching 
related logic should be in the Cache related classes. Reader should only defer 
the decisions about caching to the Cache implementations.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (HBASE-28496) Troubleshooting the issue of the "hbase-cleanup.sh --cleanAcls" command not taking effect

2024-04-12 Thread ziyang (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-28496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ziyang updated HBASE-28496:
---
Fix Version/s: (was: 2.4.15)

> Troubleshooting the issue of the "hbase-cleanup.sh --cleanAcls" command not 
> taking effect
> -
>
> Key: HBASE-28496
> URL: https://issues.apache.org/jira/browse/HBASE-28496
> Project: HBase
>  Issue Type: Bug
>  Components: Zookeeper
>Affects Versions: 2.4.15
>Reporter: ziyang
>Priority: Major
> Attachments: HBASE-28496.patch
>
>
> When executing the "hbase-cleanup.sh --cleanAcls" command, it was noticed 
> that the ACL permissions of nodes in ZooKeeper did not change. The reason is 
> that in the hbase-cleanup.sh script, the contents of the execute_clean_acls 
> method are as follows:
>  
> {code:java}
> execute_clean_acls() { 
>   command=$1; "$bin"/hbase org.apache.hadoop.hbase.zookeeper.ZkAclReset 
> $command 2>&1 
> } {code}
> The corresponding type in the "hbase-zookeeper" module should be 
> "org.apache.hadoop.hbase.zookeeper.ZKAclReset", so it is necessary to change 
> "org.apache.hadoop.hbase.zookeeper.ZkAclReset" to 
> "org.apache.hadoop.hbase.zookeeper.ZKAclReset" in the "execute_clean_acls" 
> method.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)