[
https://issues.apache.org/jira/browse/HDFS-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173546#comment-13173546
]
Suresh Srinivas commented on HDFS-2665:
---------------------------------------
Sid, I am moving this jira to common and attach common only patch. Please open
a separate jira for HDFS part of the patch.
> Viewfs changes for MAPREDUCE-3529
> ---------------------------------
>
> Key: HDFS-2665
> URL: https://issues.apache.org/jira/browse/HDFS-2665
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.23.0
> Reporter: Siddharth Seth
> Priority: Critical
> Attachments: HADOOP-7933.txt, HDFS2665_v1.txt, HDFS2665_v1.txt
>
>
> ViewFs.getDelegationTokens returns a list of tokens for the associated
> namenodes. Credentials serializes these tokens using the service name for the
> actual namenodes. Effectively, tokens are not cached for viewfs (some more
> details in MR 3529). Affects any job which uses the TokenCache in tasks along
> with viewfs (some Pig jobs).
> Talk to Jitendra about this, some options
> 1. Change Credentials.getAllTokens to return the key, instead of just a token
> list (associate the viewfs canonical name with a token in credentials)
> 2. Have viewfs issue a fake token.
> Both of these would allow for a single viewfs configuration only.
> 3. An additional API in FileSystem - something like
> getDelegationTokens(String renewer, Credentials credentials) - which would
> check the credentials object before making token requests to the actual
> namenode.
> 4. An additional API in FileSystem - getCanonicalServiceNames - similar to
> getDelegationTokens, which would return service names for the actual
> namenodes. TokenCache/Credentials can work using this list.
> 5. have getDelegationTokens check the current UGI - and fetch tokens only if
> they don't exist.
> Have a quick patch for 3, along with associated MR changes.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
