GitHub user dawidwys opened a pull request:
https://github.com/apache/flink/pull/6107
[FLINK-9366] DistributedCache works with Distributed File System
## What is the purpose of the change
Allows to use DistributeCache to cache files from cluster internal DFS
(reverted behaviour).
## Brief change log
*(for example:)*
- Local files (based on uri schema) are distributed via BlobServer
- Files in DFS are cached from DFS
## Verifying this change
* Added test for distributing files through DFS:
org.apache.flink.hdfstests.DistributedCacheDfsTest
* local files shipping covered by previous tests
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): no
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`:no
- The serializers: no
- The runtime per-record code paths (performance sensitive): no
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: no
- The S3 file system connector: no
## Documentation
- Does this pull request introduce a new feature? no
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dawidwys/flink FLINK-9366
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/6107.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6107
----
commit cc1344d18e2b1d9953e21d5189f2813fdabd7b01
Author: Dawid Wysakowicz <dwysakowicz@...>
Date: 2018-05-31T12:35:44Z
[FLINK-9366] DistributedCache works with Distributed File System
----
---
