GitHub user fhueske opened a pull request:
https://github.com/apache/incubator-flink/pull/173
[FLINK-1139] Fix for HadoopOF with DOP > 1
This PR allows to execute HadoopOFs with DOP > 1.
It adds a hook to JM that is executed after the last OutputFormat finished.
Hadoop FileOutputFormats need this hook to clean-up temporary files.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/fhueske/incubator-flink hadoopOF
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-flink/pull/173.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #173
----
commit 8f7ba0869d678d1f2f5340fa52b337a0ce8b7d34
Author: Fabian Hueske <[email protected]>
Date: 2014-10-06T14:27:25Z
[FLINK-1139] Added FinalizeOnMaster hook to run code after the last task of
an OutputFormat completed
commit 99a1c9ca204c1c9183a537e46c2fa01ad3632e4f
Author: Fabian Hueske <[email protected]>
Date: 2014-10-06T14:28:00Z
[FLINK-1139] Fixed HadoopOutputFormat to run with DOP > 1
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
