Hi Mingliang Liu, Thanks a lot for your response, I have read the document for Hadoop 3.3.0 and found that Load balancers will be supported on AWS/Azure, will it supported on A10 Loadbalancers or nginx ?
Regards, Kamaraj InfoSight - SRE From: Mingliang Liu<mailto:lium...@gmail.com> Sent: Saturday, August 22, 2020 2:55 AM To: Muthupandiyan, Kamaraj<mailto:kamaraj.muthupandi...@hpe.com> Cc: user@hadoop.apache.org<mailto:user@hadoop.apache.org> Subject: Re: setting up Load balancer for name nodes Hi Kamaraj, I don't think the feature you are referring to exists in Hadoop 2.9.2. The feature was brought up by JIRA https://issues.apache.org/jira/browse/HADOOP-15707<https://issues.apache.org/jira/browse/HADOOP-15707> which is released in Hadoop 3.2+ (see "Fixed Version") Also, you may want to go through the Hadoop manual/doc for your current Hadoop version. If you change r3.3.0 to r2.9.2 in the URL you posted, you should be reading: https://hadoop.apache.org/docs/r2.9.2/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html<https://hadoop.apache.org/docs/r2.9.2/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html> Thanks, On Fri, Aug 21, 2020 at 11:02 AM Muthupandiyan, Kamaraj <kamaraj.muthupandi...@hpe.com<mailto:kamaraj.muthupandi...@hpe.com>> wrote: Hello team, I need to configure LB for our name node setup and we are using Hadoop 2.9.2 . I was going through the docs from https://hadoop.apache.org/docs/r3.3.0/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html<https://hadoop.apache.org/docs/r3.3.0/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html> and found the below option, but whenever I am using the HTTP endpoints as mentioned below I am getting 404 response If you are running a set of NameNodes behind a Load Balancer (e.g. Azure<https://docs.microsoft.com/en-us/azure/load-balancer/load-balancer-custom-probe-overview> or AWS<https://docs.aws.amazon.com/elasticloadbalancing/latest/classic/elb-healthchecks.html> ) and would like the Load Balancer to point to the active NN, you can use the /isActive HTTP endpoint as a health probe. http://NN_HOSTNAME/isActive<http://nn_hostname/isActive> will return a 200 status code response if the NN is in Active HA State, 405 otherwise. Regards, Kamaraj -- L
