[
https://issues.apache.org/jira/browse/FLINK-14360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968020#comment-16968020
]
Shen Yinjie commented on FLINK-14360:
-------------------------------------
Yes, it is about Flink on Yarn deployment,similar to Spark on Yarn. In the
current implementation,flink upload certain files to Hdfs according to client's
fs.defaultFs, in the multi-cluster scenario, target Yarn cluster may not have
tokens for this Hdfs. Thus, we need a flexible config option to let user pick
necessary hdfs schemes.
> Flink on yarn should support obtain delegation tokens of multi hdfs namespaces
> ------------------------------------------------------------------------------
>
> Key: FLINK-14360
> URL: https://issues.apache.org/jira/browse/FLINK-14360
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN
> Reporter: Shen Yinjie
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> There's a scenario when deploy flink on yarn with multi hdfs cluster or hdfs
> federation, Flink need to get delegation tokens of all the namespaces before
> start appmaster.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
