[
https://issues.apache.org/jira/browse/FLINK-5998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002716#comment-16002716
]
ASF GitHub Bot commented on FLINK-5998:
---------------------------------------
GitHub user aljoscha opened a pull request:
https://github.com/apache/flink/pull/3856
[FLINK-5998] Fix shaded Hadoop Jar
Now that flink-dist has the shaded hadoop jar as a provided dependency
we need to ensure that the shaded hadoop jar includes all the
dependencies that it needs because flink-dist does not include them
anymore in its shading.
The manifestation of this was that we couldn't start a cluster anymore
because of missing class files.
The upside of this PR is that we can run a cluster again. The downside is
that we now have some dependencies both in the `flink-dist` jar and in the
shaded Hadoop jar, i.e. total size increases.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/aljoscha/flink fix-shaded-hadoop
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3856.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3856
----
commit ce0eb550277b9dd737f4dabb4eb586d36bd6ed35
Author: Aljoscha Krettek <[email protected]>
Date: 2017-05-09T13:50:09Z
[FLINK-5998] Fix shaded Hadoop Jar
Now that flink-dist has the shaded hadoop jar as a provided dependency
we need to ensure that the shaded hadoop jar includes all the
dependencies that it needs because flink-dist does not include them
anymore in its shading.
The manifestation of this was that we couldn't start a cluster anymore
because of missing class files.
----
> Un-fat Hadoop from Flink fat jar
> --------------------------------
>
> Key: FLINK-5998
> URL: https://issues.apache.org/jira/browse/FLINK-5998
> Project: Flink
> Issue Type: Improvement
> Components: Build System
> Reporter: Robert Metzger
> Assignee: Haohui Mai
> Fix For: 1.3.0
>
>
> As a first step towards FLINK-2268, I would suggest to put all hadoop
> dependencies into a jar separate from Flink's fat jar.
> This would allow users to put a custom Hadoop jar in there, or even deploy
> Flink without a Hadoop fat jar at all in environments where Hadoop is
> provided (EMR).
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
