[ 
https://issues.apache.org/jira/browse/FLINK-14360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949209#comment-16949209
 ] 

Shen Yinjie commented on FLINK-14360:
-------------------------------------

Hi ,[~karmagyz] ,We deploy flink on yarn with RM federation and multi hdfs 
namespaces and hdfs clusters,flink  would fail to connect to some hdfs 
namenodes  due to lack of delegation tokens.
We provide a configuration for users to set a list of hdfs scheme names.So that 
before flink appmaster start,it will obtain these delegation tokens for 
specified hdfs namenodes.

> Flink on yarn should support obtain delegation tokens of multi hdfs namespaces
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-14360
>                 URL: https://issues.apache.org/jira/browse/FLINK-14360
>             Project: Flink
>          Issue Type: Improvement
>          Components: Deployment / YARN
>            Reporter: Shen Yinjie
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> There's a scenario when deploy flink on yarn with multi hdfs cluster or hdfs 
> federation, Flink need to get delegation tokens of all the namespaces before 
> start appmaster.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to