[
https://issues.apache.org/jira/browse/FLINK-14360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949209#comment-16949209
]
Shen Yinjie commented on FLINK-14360:
-------------------------------------
Hi ,[~karmagyz] ,We deploy flink on yarn with RM federation and multi hdfs
namespaces and hdfs clusters,flink would fail to connect to some hdfs
namenodes due to lack of delegation tokens.
We provide a configuration for users to set a list of hdfs scheme names.So that
before flink appmaster start,it will obtain these delegation tokens for
specified hdfs namenodes.
> Flink on yarn should support obtain delegation tokens of multi hdfs namespaces
> ------------------------------------------------------------------------------
>
> Key: FLINK-14360
> URL: https://issues.apache.org/jira/browse/FLINK-14360
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN
> Reporter: Shen Yinjie
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> There's a scenario when deploy flink on yarn with multi hdfs cluster or hdfs
> federation, Flink need to get delegation tokens of all the namespaces before
> start appmaster.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
