[
https://issues.apache.org/jira/browse/SPARK-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394265#comment-14394265
]
Sean Owen commented on SPARK-6687:
----------------------------------
Does this cause any problem? I expect a lot of things to be different. This is
also a very old version of Hadoop.
> In the hadoop 0.23 profile, hadoop pulls in an older version of netty which
> conflicts with akka's netty
> --------------------------------------------------------------------------------------------------------
>
> Key: SPARK-6687
> URL: https://issues.apache.org/jira/browse/SPARK-6687
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.3.0
> Reporter: Sai Nishanth Parepally
>
> excerpt from mvn -Dverbose dependency:tree of spark-core, note the
> org.jboss.netty:netty dependency:
> [INFO] | | +-
> org.apache.hadoop:hadoop-mapreduce-client-app:jar:0.23.10:compile
> [INFO] | | | +-
> org.apache.hadoop:hadoop-mapreduce-client-common:jar:0.23.10:compile
> [INFO] | | | | +-
> (org.apache.hadoop:hadoop-yarn-common:jar:0.23.10:compile - omitted for
> duplicate)
> [INFO] | | | | +-
> (org.apache.hadoop:hadoop-mapreduce-client-core:jar:0.23.10:compile - omitted
> for duplicate)
> [INFO] | | | | +-
> org.apache.hadoop:hadoop-yarn-server-common:jar:0.23.10:compile
> [INFO] | | | | | +-
> (org.apache.hadoop:hadoop-yarn-common:jar:0.23.10:compile - omitted for
> duplicate)
> [INFO] | | | | | +- (org.apache.zookeeper:zookeeper:jar:3.4.5:compile -
> version managed from 3.4.2; omitted for duplicate)
> [INFO] | | | | | +- (org.slf4j:slf4j-api:jar:1.7.10:compile - version
> managed from 1.6.1; omitted for duplicate)
> [INFO] | | | | | +- (org.slf4j:slf4j-log4j12:jar:1.7.10:compile -
> version managed from 1.6.1; omitted for duplicate)
> [INFO] | | | | | +- (org.jboss.netty:netty:jar:3.2.4.Final:compile -
> omitted for duplicate)
> [INFO] | | | | | +-
> (com.google.protobuf:protobuf-java:jar:2.4.0a:compile - omitted for duplicate)
> [INFO] | | | | | +- (commons-io:commons-io:jar:2.1:compile - omitted for
> duplicate)
> [INFO] | | | | | +- (com.google.inject:guice:jar:3.0:compile - omitted
> for duplicate)
> [INFO] | | | | | +-
> (com.sun.jersey.jersey-test-framework:jersey-test-framework-grizzly2:jar:1.8:compile
> - omitted for duplicate)
> [INFO] | | | | | +- (com.sun.jersey:jersey-server:jar:1.8:compile -
> omitted for duplicate)
> [INFO] | | | | | \-
> (com.sun.jersey.contribs:jersey-guice:jar:1.8:compile - omitted for duplicate)
> [INFO] | | | | +- (com.google.protobuf:protobuf-java:jar:2.4.0a:compile -
> omitted for duplicate)
> [INFO] | | | | +- (org.slf4j:slf4j-api:jar:1.7.10:compile - version
> managed from 1.6.1; omitted for duplicate)
> [INFO] | | | | +- (org.slf4j:slf4j-log4j12:jar:1.7.10:compile - version
> managed from 1.6.1; omitted for duplicate)
> [INFO] | | | | +- (org.apache.hadoop:hadoop-hdfs:jar:1.23.10:compile -
> omitted for duplicate)
> [INFO] | | | | \- (org.jboss.netty:netty:jar:3.2.4.Final:compile -
> omitted for duplicate)
> [INFO] | | | +-
> org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:0.23.10:compile
> [INFO] | | | | +-
> (org.apache.hadoop:hadoop-mapreduce-client-core:jar:0.23.10:compile - omitted
> for duplicate)
> [INFO] | | | | +- (com.google.protobuf:protobuf-java:jar:2.4.0a:compile -
> omitted for duplicate)
> [INFO] | | | | +- (org.slf4j:slf4j-api:jar:1.7.10:compile - version
> managed from 1.6.1; omitted for duplicate)
> [INFO] | | | | +- (org.slf4j:slf4j-log4j12:jar:1.7.10:compile - version
> managed from 1.6.1; omitted for duplicate)
> [INFO] | | | | +- (org.apache.hadoop:hadoop-hdfs:jar:0.23.10:compile -
> omitted for duplicate)
> [INFO] | | | | \- (org.jboss.netty:netty:jar:3.2.4.Final:compile -
> omitted for duplicate)
> [INFO] | | | +- (com.google.protobuf:protobuf-java:jar:2.4.0a:compile -
> omitted for duplicate)
> [INFO] | | | +- (org.slf4j:slf4j-api:jar:1.7.10:compile - version managed
> from 1.6.1; omitted for duplicate)
> [INFO] | | | +- (org.slf4j:slf4j-log4j12:jar:1.7.10:compile - version
> managed from 1.6.1; omitted for duplicate)
> [INFO] | | | +- (org.apache.hadoop:hadoop-hdfs:jar:0.23.10:compile -
> omitted for duplicate)
> [INFO] | | | \- org.jboss.netty:netty:jar:3.2.4.Final:compile
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
