[ 
https://issues.apache.org/jira/browse/HDFS-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209010#comment-13209010
 ] 

Todd Lipcon commented on HDFS-2904:
-----------------------------------

{quote}
when the JT renews delegation tokens on behalf of the job, does it pass the 
job's jobconf or the jobtracker's local conf? If the latter, it may not have a 
local configuration that has the same clusters configured, which would be 
problematic.
{quote}
I talked to Mahadev about this and looked in the source. Unfortunately the 
RM/JT use their local conf, not the job conf, when renewing delegation tokens. 
This means that all HA clusters that will be accessed from MR jobs need to be 
present/configured in the conf on the RM for now. Mahadev and I agree this 
should not be a blocker for merging HA to trunk, but I will file a follow-up to 
figure out a better solution for this when this is committed.
                
> HA: Client support for getting delegation tokens to an HA cluster
> -----------------------------------------------------------------
>
>                 Key: HDFS-2904
>                 URL: https://issues.apache.org/jira/browse/HDFS-2904
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, hdfs client, name-node, security
>    Affects Versions: HA branch (HDFS-1623)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Critical
>         Attachments: hdfs-2904.txt, hdfs-2904.txt, test-dt.sh
>
>
> Currently we have server-side support for delegation tokens in HA, and some 
> tests to verify it, but the client throws NPEs when trying to fetch a DT. 
> This is because the cluster doesn't have a single hostname, but instead a 
> logical nameservice name.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to