[ 
https://issues.apache.org/jira/browse/GOBBLIN-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sudarshan Vasudevan updated GOBBLIN-1286:
-----------------------------------------
        Fix Version/s: 0.16.0
    Affects Version/s: 0.15.0

> Support fetching multiple DFS tokens for HDFS Federation
> --------------------------------------------------------
>
>                 Key: GOBBLIN-1286
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1286
>             Project: Apache Gobblin
>          Issue Type: Improvement
>          Components: misc
>    Affects Versions: 0.15.0
>            Reporter: Sandeep Devaiah
>            Priority: Major
>             Fix For: 0.16.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> Currently org.apache.gobblin.util.hadoop.TokenUtils#getHdfsToken adds the 
> DistributedFileSystem's delegation token to the Credential's object. However, 
> if the DFS is federated, then only one token for the primary name node is 
> fetched and tokens for child namenodes are not fetched.
> Hence this method needs to be updated to use 
> org.apache.hadoop.fs.FileSystem#addDelegationTokens instead of 
> org.apache.hadoop.fs.FileSystem#getDelegationTokens which automatically 
> fetches the delegation tokens for all child FS as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to