[
https://issues.apache.org/jira/browse/FLINK-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009585#comment-15009585
]
ASF GitHub Bot commented on FLINK-3032:
---------------------------------------
GitHub user rmetzger opened a pull request:
https://github.com/apache/flink/pull/1372
[FLINK-3032] Fix jackson-core dependency conflict with Hadoop 2.7.1.
This commit is also changing how we build the "flink-shaded-hadoop"
artifact.
In the past, we were including all Hadoop dependencies into a fat jar,
without relocating all of them.
Maven was not able to see Hadoop's dependencies and classes ended up in the
classpath multiple times.
With this change, only shaded Hadoop dependencies are included into the
jar. The shade plugin will also
remove only the shaded dependencies from the pom file.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rmetzger/flink flink3032
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1372.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1372
----
commit ad42f13f34f1c026436e050570e9572403dca375
Author: Robert Metzger <[email protected]>
Date: 2015-11-17T13:16:27Z
[FLINK-3032] Fix jackson-core dependency conflict with Hadoop 2.7.1.
This commit is also changing how we build the "flink-shaded-hadoop"
artifact.
In the past, we were including all Hadoop dependencies into a fat jar,
without relocating all of them.
Maven was not able to see Hadoop's dependencies and classes ended up in the
classpath multiple times.
With this change, only shaded Hadoop dependencies are included into the
jar. The shade plugin will also
remove only the shaded dependencies from the pom file.
----
> Flink does not start on Hadoop 2.7.1 (HDP), due to class conflict
> -----------------------------------------------------------------
>
> Key: FLINK-3032
> URL: https://issues.apache.org/jira/browse/FLINK-3032
> Project: Flink
> Issue Type: Bug
> Components: Build System
> Affects Versions: 0.10.0, 1.0.0
> Reporter: Robert Metzger
> Assignee: Robert Metzger
> Priority: Critical
>
> Steps to reproduce:
> - Build flink {{mvn clean install -DskipTests
> -Dhadoop.version=2.7.1.2.3.2.0-2950 -Pvendor-repos}}
> - Start it on a HDP 2.3.2 Hadoop as a yarn-session
> - Watch it fail with
> {code}
> 6:18:56,459 INFO org.apache.flink.runtime.filecache.FileCache
> - User file cache uses directory /hadoop/yarn/local/usercache/flink/appcache
> /application_1447687546708_0005/flink-dist-cache-f4710796-598c-4778-992c-5df000faffae
> 16:18:56,561 ERROR akka.actor.OneForOneStrategy
> - exception during creation
> akka.actor.ActorInitializationException: exception during creation
> at akka.actor.ActorInitializationException$.apply(Actor.scala:164)
> at akka.actor.ActorCell.create(ActorCell.scala:596)
> at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:456)
> at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
> at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:279)
> at akka.dispatch.Mailbox.run(Mailbox.scala:220)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:231)
> at
> scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
> at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
> at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at akka.util.Reflect$.instantiate(Reflect.scala:66)
> at akka.actor.ArgsReflectConstructor.produce(Props.scala:352)
> at akka.actor.Props.newActor(Props.scala:252)
> at akka.actor.ActorCell.newActor(ActorCell.scala:552)
> at akka.actor.ActorCell.create(ActorCell.scala:578)
> ... 10 more
> Caused by: java.lang.NoSuchMethodError:
> com.fasterxml.jackson.core.JsonFactory.requiresPropertyOrdering()Z
> at
> com.fasterxml.jackson.databind.ObjectMapper.<init>(ObjectMapper.java:458)
> at
> com.fasterxml.jackson.databind.ObjectMapper.<init>(ObjectMapper.java:379)
> at
> org.apache.flink.runtime.taskmanager.TaskManager.<init>(TaskManager.scala:153)
> at
> org.apache.flink.yarn.YarnTaskManager.<init>(YarnTaskManager.scala:32)
> ... 19 more
> 16:18:56,564 ERROR org.apache.flink.runtime.taskmanager.TaskManager
> - Actor akka://flink/user/taskmanager#-1189186354 terminated, stopping
> process...
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
