[
https://issues.apache.org/jira/browse/KNOX-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530676#comment-16530676
]
Mert Hocanin commented on KNOX-1334:
------------------------------------
AWS EMR installs hadoop, spark, hive, etc mostly from source. We apply some
changes, fixes, and enhancements so its not 100%. Therefore, I shouldn't expect
there to be any meaningful differences between what we install on EMR and what
others may install. However, when we tried knox out of the box, many rules were
missing, many rules didn't take into account of certain UI's being run on what
we call slave nodes (nodes that run worker processes like Task Tracker,
Datanode, etc), and other changes. Latest version of Hadoop on EMR is 2.8.3,
which is one minor version above what Knox seems to be supporting (2.7.0/1)
which may be one of the reasons why for some of the changes were needed.
> Knox on AWS EMR
> ---------------
>
> Key: KNOX-1334
> URL: https://issues.apache.org/jira/browse/KNOX-1334
> Project: Apache Knox
> Issue Type: Bug
> Reporter: PRAVEEN K RAVIKUMAR
> Priority: Major
> Fix For: 1.1.0
>
> Attachments: KNOX-1343.patch
>
>
> Hi
> I have requirement to send all the request coming to proxy to be forwarded to
> EMR master node.
> Example:
> https://<any dns-name>:<PORT>/ --> Proxy --> EMR master.
> The DNS name could be anything, because there are many slave nodes. I would
> like the proxy to "redirect" dynamically "https://<any dns-name>:<PORT>/" to
> EMR master host. Could you please let me know if a reverse proxy/ Apache Knox
> can do that. I am trying to mimic option2 "SSH Tunnel to the Master Node
> Using Dynamic Port Forwarding"
> https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-ssh-tunnel.html
> Sample URLS:
> YARN ResourceManager https://master-public-dns-name:8088/ YARN NodeManager
> https://slave-public-dns-name:8042/ Spark HistoryServer
> https://master-public-dns-name:18080/
> [https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-ssh-tunnel.html]
>
> If so could you please share me the steps to configure Knox on EMR cluster-
> would be very helpful?
> Praveen.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
