[ 
https://issues.apache.org/jira/browse/FLINK-14360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949446#comment-16949446
 ] 

Andrey Zagrebin commented on FLINK-14360:
-----------------------------------------

[~shenyinjie] Could you explain a bit more what you are trying to do?

Looking into the PR, you are changing the part where this is up to Flink to 
decide how to distribute the files which are basically local for the submitting 
client.

Do you want to configure some other HDFS cluster(s) which Flink should use for 
this purpose?

Do the file paths created in the current code not contain correct name nodes to 
obtain necessary tokens or what is the problem?

> Flink on yarn should support obtain delegation tokens of multi hdfs namespaces
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-14360
>                 URL: https://issues.apache.org/jira/browse/FLINK-14360
>             Project: Flink
>          Issue Type: Improvement
>          Components: Deployment / YARN
>            Reporter: Shen Yinjie
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> There's a scenario when deploy flink on yarn with multi hdfs cluster or hdfs 
> federation, Flink need to get delegation tokens of all the namespaces before 
> start appmaster.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to