RE: ZKFC ActiveBreadCrumb Value

2018-09-17 Thread Pankaj Kumar
ting | Staffing Solutions | - From: Francisco de Freitas [mailto:chicofranch...@gmail.com] Sent: Monday, September 17, 2018 9:05 AM To: Harsh J Cc: Subject: Re: ZKFC ActiveBreadCrumb Value Thanks a lot Harsh. This is exactly what I di

Re: ZKFC ActiveBreadCrumb Value

2018-09-17 Thread Francisco de Freitas
Thanks a lot Harsh. This is exactly what I did. I appreciate it for having the time to point the correct path as well. Cheers, Francisco On Sat, 15 Sep 2018 at 19:21, Harsh J wrote: > As mentioned by Wellington, the path you're going down will not > guarantee any compatibility in future. > > Th

Re: ZKFC ActiveBreadCrumb Value

2018-09-15 Thread Harsh J
As mentioned by Wellington, the path you're going down will not guarantee any compatibility in future. The format/encoding/content/location/etc. of the messages stored in ZK by the Failover Controller is not for public access and can change without formal deprecation/etc. A cleaner way without th

Re: ZKFC ActiveBreadCrumb Value

2018-09-14 Thread Wellington Chevreuil
You could still use Harsh's solution programatically, or maybe an easier way is to use HAUtil.getAddressOfActive() [1] for that? Ideally we should not need to query ZK directly. [1] https://github.com/c9n/hadoop/blob/master/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HAUt

Re: ZKFC ActiveBreadCrumb Value

2018-09-14 Thread Francisco de Freitas
Hi Harsh, thanks for your message. The thing is that I need to find that out via API programatically so that's why I gave the zkCli command as an example. I'm using this Go Lib ( github.com/samuel/go-zookeeper/zk) and I get the same result. On Fri, 14 Sep 2018 at 02:22 Harsh J wrote: > The valu

Re: ZKFC ActiveBreadCrumb Value

2018-09-13 Thread Harsh J
The value you are looking at directly in ZooKeeper is in a serialized/encoded form. Those are not separator characters but more likely an encoded integer binary value that your terminal is interpreting as a printable character. The standard way to find the active NameNode is to use the 'hdfs haadm

ZKFC ActiveBreadCrumb Value

2018-09-13 Thread Francisco de Freitas
When querying different HDFS clusters I get different separators (don't really know if they're actually separators). >From zkCli.sh on different clusters, running the following I get: cmd: get /hadoop-ha/clusterX/ActiveBreadCrumb Cluster1 (comma): cluster1active-nn1,active-nn1.example.com �>(�>