GitHub user tillrohrmann opened a pull request:
https://github.com/apache/incubator-flink/pull/126
Integraion of Daniel's BLOB manager
I rebased the pull request #107 of @warneke. Thanks for your work Daniel,
the code looks really good. Since the master evolved a little bit from the
version of the pull request, I'd like to have another pair of eyes looking over
it. I tried to address the problem of old jar files which are no longer used by
introducing a clean up task which regularly looks for those files. Due to this
I had to extend the book keeping of the LibraryCacheManager a little bit.
I tested WordCount and Kmeans on the cluster with this version.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tillrohrmann/incubator-flink blob_manager
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-flink/pull/126.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #126
----
commit 68474d2ac589c81332d79fb03fc0c258a4b3d20c
Author: Daniel Warneke <[email protected]>
Date: 2014-09-24T13:00:58Z
Integration of new BLOB service.
commit 80c023ac84cb91e6d53147c530b19736b1045e6c
Author: Till Rohrmann <[email protected]>
Date: 2014-09-24T15:47:26Z
Looped through the user code class loader from the envrionment to the tasks.
commit defd8b9d394a77c5b49f6f0f2ccdcbe8fe5f9778
Author: Till Rohrmann <[email protected]>
Date: 2014-09-25T16:41:37Z
Added timed cleanup task to LibraryCacheManager to remove automatically
unreferenced jar files. Moved registration logic out of the IOReadableWritable
serialization logic. Updated logger.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
