Hi Mohammad, You are right we have HA support for various services that is somewhat generic and based on connectivity failures. Our WebHDFS HA support is a bit more specific and maps to some of the nuanced states that the Namenodes can be in. We have yet to put in specific support for Yarn and like you point out there is a redirect that occurs that needs to be handled.
There is an open JIRA to add support for Yarn’s resource manager in HA mode. https://issues.apache.org/jira/browse/KNOX-719 Sumit From: Mohammad Islam <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>, Mohammad Islam <[email protected]<mailto:[email protected]>> Date: Wednesday, November 2, 2016 at 6:57 PM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>, "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: Re: HA support for YARN and NameNode UI level Just to add more specific use-case of YARN UI. BTW my KNOX service was running behind another FE proxy. When I typed https://<MY_FE_PROXY>/gateway/sandbox/yarn in my browser, I saw the message " This is standby RM. Redirecting to the current active RM: http://<PRIMARY_DIRECT_YARN_UI_HOST>:8088/cluster<http://<PRIMARY_UI_HOST>:8088/cluster>". At this time, my browser also tried to connect to "http://<DIRECT_YARN_UI_HOST_PRIMARY>:8088/cluster<http://<PRIMARY_UI_HOST>:8088/cluster>" but it's timed out because the YARN internal host was behind the firewall and was not directly accessible through browser. Looks like Knox was sending a response to FE proxy with a header "Refresh: 3; url=http://<DIRECT_YARN_UI_HOST_PRIMARY>:8088/cluster". My question is : is there a way for Knox to replace the internal Yarn Host or endpoint with something like knoxy endpoint. Regards, Mohammad On Tuesday, November 1, 2016 12:24 PM, Mohammad Islam <[email protected]<mailto:[email protected]>> wrote: Hi, I'm wandering if there is any built-in support in Knox for any (NN/RM) UI to automatically forward to active NN/RM. I saw there is HA support in WebHDFS level. But not sure if I need to do anything special for HDFSUI. The same is true for YARNUI. Regards, Mohammad
