Greetings, I’m working currently on enabling Amazon EMR debugging UIs running in private subnet via apache Knox. With the steps defined in the documentation I was able to install Knox and access YARN/SparkHistory/Ganglia UIs, which was amazing. But I’m facing issues on accessing certain links particularly the redirection links in NODE MANAGER UI.
My first question, Does the Knox supports redirection internally ?. For instance I was trying to access the container log message in the node manager UI (NODEMANAGERUI -> Local Logs [under tools] -> containers/ and was getting blocked with the browser URL - http://ip-10X.us-east-1.opse.c1.com:8042/logs/containers/?host=ip-10X.us-east-1.opse.c1.com&port=8042 <http://ip-10x.us-east-1.opse.c1.com:8042/logs/containers/?host=ip-10X.us-east-1.opse.c1.com&port=8042> What I noticed was the links that returning Http 3xx are getting broken. Could anyone please help me resolving this issue ? Thanks, Praveen. Log message in gateway.log : ————————————— 2019-07-18 18:41:50,960 DEBUG knox.gateway (GatewayFilter.java:doFilter(119)) - Received request: GET /node/logs/containers 2019-07-18 18:41:50,963 DEBUG knox.gateway (UrlRewriteProcessor.java:rewrite(161)) - Rewrote URL: https://cas-query-sandbox-.emr.us-east-1.opse.c1.com:443/gateway/cto/node/logs/containers?host=ip-10-X.us-east-1.opse.c1.com&port=8042 <https://cas-query-sandbox-sc-866316499622-pp-oeobt24ki6aja.emr.us-east-1.opse.c1.vanguard.com/gateway/cto/node/logs/containers?host=ip-10-156-232-245.us-east-1.opse.c1.vanguard.com&port=8042>, direction: IN via implicit rule: NODEUI/logs/containers to URL: http://ip-10-156X.us-east-1.opse.c1.com:8042/logs/containers?host=ip-10-156X.us-east-1.opse.c1.com&port=8042 <http://ip-10-156x.us-east-1.opse.c1.com:8042/logs/containers?host=ip-10-156X.us-east-1.opse.c1.com&port=8042> 2019-07-18 18:41:50,964 DEBUG knox.gateway (UrlRewriteProcessor.java:rewrite(161)) - Rewrote URL: https://cas-query-sandbox.emr.us-east-1.opse.c1.com/gateway/cto/node/logs/?host=ip-X.us-east-1.opse.c1.com&port=8042 <https://cas-query-sandbox.emr.us-east-1.opse.c1.com/gateway/cto/node/logs/?host=ip-X.us-east-1.opse.c1.com&port=8042>, direction: IN via implicit rule: NODEUI/logs to URL: http://ip-10X.us-east-1.opse.c1.com:8042/logs/ <http://ip-10x.us-east-1.opse.c1.com:8042/logs/> 2019-07-18 18:41:50,964 DEBUG knox.gateway (DefaultDispatch.java:executeOutboundRequest(121)) - Dispatch request: GET http://ipX.us-east-1.opse.c1.com:8042/logs/containers?host=ip-10X.us-east-1.opse.c1.com&port=8042 <http://ipx.us-east-1.opse.c1.vanguard.com:8042/logs/containers?host=ip-10X.us-east-1.opse.c1.vanguard.com&port=8042> 2019-07-18 18:41:50,967 DEBUG knox.gateway (DefaultDispatch.java:executeOutboundRequest(134)) - Dispatch response status: 302 2019-07-18 18:41:50,968 DEBUG knox.gateway (DefaultDispatch.java:getInboundResponseContentType(203)) - Using explicit character set UTF-8 for entity of type text/plain 2019-07-18 18:41:50,968 DEBUG knox.gateway (DefaultDispatch.java:getInboundResponseContentType(211)) - Inbound response entity content type: text/plain; charset=utf-8
