GitHub user detonator413 opened a pull request:
https://github.com/apache/flink/pull/1090
Implementation of distributed copying utility using Flink
Uses a "dynamic" input format where faster nodes will get more stuff to be
copied.
The finest level of granularity is a file.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/detonator413/flink distcp-example-20150903
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1090.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1090
----
commit 05fc8ec319780eddbb67269e52f3bc1d090df41f
Author: Vyacheslav Zholudev <[email protected]>
Date: 2015-09-03T14:09:18Z
initial Flink DistCp example
commit c4f2b447e89a4ef80ee6ab171d04c519f7498d0e
Author: Vyacheslav Zholudev <[email protected]>
Date: 2015-09-03T14:13:28Z
a bit more comments
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
