[ https://issues.apache.org/jira/browse/SPARK-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves resolved SPARK-1490. ---------------------------------- Resolution: Fixed Fix Version/s: 1.0.0 > Add kerberos support to the HistoryServer > ----------------------------------------- > > Key: SPARK-1490 > URL: https://issues.apache.org/jira/browse/SPARK-1490 > Project: Spark > Issue Type: Improvement > Components: Web UI > Affects Versions: 1.0.0 > Reporter: Thomas Graves > Assignee: Thomas Graves > Fix For: 1.0.0 > > > Now that we have a history server that works on yarn and mesos we should add > the ability for it to authenticate via kerberos so that it can read HDFS > files without having to be restarted every 24 hours. > One solution to this is to have the history server read a keytab file. The > Hadoop UserGroupInformation class has that functionality built in and as long > as its using rpc to talk to hdfs it will automatically relogin when it needs > to. If the history server isn't using rpc to talk to hdfs then we would > have to add some functionality to relogin approximately every 24 hours > (configurable time). -- This message was sent by Atlassian JIRA (v6.2#6252)