Re: [DISCUSS] About using masters as ConnectionRegistry endpoint

2021-08-18 Thread Duo Zhang
We already have a connection to zookeeper at region server side, and we already watched a lot of things, so watching one more znode does not add too much pressure to zk. And I've been implementing a framework to replicate meta location without zookeeper, this could reduce the pressure on zookeeper

Re: [DISCUSS] About using masters as ConnectionRegistry endpoint

2021-08-18 Thread Bharath Vissapragada
Are you referring to meta region location(s) cache? If so, yes we will have more network chatter accessing those znode(s) whenever meta (replicas) move around (what happens in split-meta is still under discussion as you probably are already following, but it is likely that we will still use ZK as

Re: [DISCUSS] About using masters as ConnectionRegistry endpoint

2021-08-18 Thread Nick Dimiduk
I recall that there was a concern about data freshness, that the masters were all tracking the necessary state and all of them would always be up-to-date. Region servers were not already in this business, and doing so would put undue burden on ZooKeeper. Perhaps I miss-remember, or the discussion

Re: Hbase export is very slow - help needed

2021-08-18 Thread Nguyen, Tai Van (EXT - VN)
Hi HBase Team Image can see here : * Export with single regionserver: https://imgur.com/86wSUMV * Export with two regionservers: https://imgur.com/a/XMovlZx Log show about time was: root@solaltiplano-track4-master:~/hbase-exporting/latest# cat hbase_export_compress_default.log | grep

How can I connect hbase with kerberos

2021-08-18 Thread igyu
String krb5Path = "D:\\file\\krb5.conf"; String principal = "jztwk/had...@join.com"; String keytabPath = "D:\\file\\jztwk.keytab"; System.setProperty("java.security.krb5.conf", krb5Path); Configuration conf = new Configuration();

Re: Re: I can't connect hbase

2021-08-18 Thread igyu
Hconf.set("hbase.regionserver.kerberos.principal","hbase/_h...@join.com"); Hconf.set("hbase.master.kerberos.principal","hbase/_h...@join.com"); Hconf.set("dfs.namenode.kerberos.principal", "hdfs/_h...@join.com"); I add this,but aslo get error igyu From: igyu Date: 2021-08-18 15:19 To: user

Re: I can't connect hbase

2021-08-18 Thread igyu
UserGroupInformation.loginUserFromKeytab(principal, keytabPath) is OK HBaseAdmin.available(Hconf) throw exception igyu From: igyu Date: 2021-08-18 14:55 To: user Subject: I can't connect hbase try { String krb5Path = "D:\\file\\krb5.conf"; String principal =

I can't connect hbase

2021-08-18 Thread igyu
try { String krb5Path = "D:\\file\\krb5.conf"; String principal = "jztwk/had...@join.com"; String keytabPath = "D:\\file\\jztwk.keytab"; System.setProperty("java.security.krb5.conf", krb5Path); Configuration conf = new Configuration();