Shen Yinjie commented on FLINK-14360:

Hi ,[~karmagyz] ,We deploy flink on yarn with RM federation and multi hdfs 
namespaces and hdfs clusters,flink  would fail to connect to some hdfs 
namenodes  due to lack of delegation tokens.
We provide a configuration for users to set a list of hdfs scheme names.So that 
before flink appmaster start,it will obtain these delegation tokens for 
specified hdfs namenodes.

> Flink on yarn should support obtain delegation tokens of multi hdfs namespaces
> ------------------------------------------------------------------------------
>                 Key: FLINK-14360
>                 URL: https://issues.apache.org/jira/browse/FLINK-14360
>             Project: Flink
>          Issue Type: Improvement
>          Components: Deployment / YARN
>            Reporter: Shen Yinjie
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
> There's a scenario when deploy flink on yarn with multi hdfs cluster or hdfs 
> federation, Flink need to get delegation tokens of all the namespaces before 
> start appmaster.

This message was sent by Atlassian Jira

Reply via email to