Duo Zhang created HBASE-30408:
---------------------------------

             Summary: Reduce zookeeper dependencies in HBase
                 Key: HBASE-30408
                 URL: https://issues.apache.org/jira/browse/HBASE-30408
             Project: HBase
          Issue Type: Umbrella
          Components: Zookeeper
            Reporter: Duo Zhang


We have been working hard in the past to reduce the zookeeper dependencies in 
HBase, and finally we have made sure that for core features, we do not store 
persistent data on zookeeper, only use zk to manage the rs leases and for 
active master election.

But recently, when investigating the code(with AI asistant), I found that there 
are still lots of heavy usage of zookeeper, like the in ACL, we mirror all the 
ACL data on zk and use zk to sync the acl permission data, it leads to great 
pressure on zk when the cluster is large(see HBASE-24211).

And in quota implementation, we store the throttle flag on zookeeper, this is a 
persistent data, which will loss data when recreating a cluster based on only 
fs data.

So this issue is an umbrella issue for tracking all these things and also tell 
our developers to not adding more pressures on zk in the future.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to