[
https://issues.apache.org/jira/browse/FLINK-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148827#comment-15148827
]
ASF GitHub Bot commented on FLINK-3400:
---------------------------------------
GitHub user aljoscha opened a pull request:
https://github.com/apache/flink/pull/1644
[FLINK-3400] Move RocksDB Copy Utils to flink-streaming-java
They are not specific to RocksDB, just utilities for copying local
folders to/from HDFS. Moving them to flink-streaming-java means that
they are always in the classpath of the TaskManager, not only in the
user-code jar when using RocksDB. If they are only in the user-code jar
the external process runner cannot find the class files, leading to
ClassNotFoundExceptions.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/aljoscha/flink rocksdb-fix-copy-utils
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1644.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1644
----
commit 6dfdf5d643d9df2598b25f61134e24ab37ecb7df
Author: Aljoscha Krettek <[email protected]>
Date: 2016-02-15T12:57:15Z
[FLINK-3400] Move RocksDB Copy Utils to flink-streaming-java
They are not specific to RocksDB, just utilities for copying local
folders to/from HDFS. Moving them to flink-streaming-java means that
they are always in the classpath of the TaskManager, not only in the
user-code jar when using RocksDB. If they are only in the user-code jar
the external process runner cannot find the class files, leading to
ClassNotFoundExceptions.
----
> RocksDB Backend does not work when not in Flink lib folder
> ----------------------------------------------------------
>
> Key: FLINK-3400
> URL: https://issues.apache.org/jira/browse/FLINK-3400
> Project: Flink
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.0.0
> Reporter: Aljoscha Krettek
> Assignee: Aljoscha Krettek
> Priority: Blocker
> Fix For: 1.0.0
>
>
> The problem is that the external process runner cannot load the
> {{HDFSCopyFromLocal}} and {{HDFSCopyToLocal}} classes when the rocksdb
> backend jar is not in the Flink lib folder. If rocksdb is only in the
> user-code jar the code cannot be loaded when trying to start the external
> copy runners.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
