Ruguo Yu created FLINK-20681:
--------------------------------
Summary: Support specifying the hdfs path when ship archives or
files
Key: FLINK-20681
URL: https://issues.apache.org/jira/browse/FLINK-20681
Project: Flink
Issue Type: Improvement
Components: Deployment / YARN
Affects Versions: 1.12.0
Reporter: Ruguo Yu
Fix For: 1.13.0
Currently, our team try to submit flink job that depends extra resource with
yarn-application target, and use two options: "yarn.ship-archives" and
"yarn.ship-files".
But above options only support specifying local resource and shiping them to
hdfs, besides if it can support remote resource on distributed filesystem (such
as hdfs), then get the following benefits：
* client will exclude the local resource uploading to accelerate the job
submission process
* yarn will cache them on the nodes so that they doesn't need to be downloaded
every time for each application
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
