[
https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178292#comment-14178292
]
Jeroen van Wilgenburg commented on SPARK-3955:
----------------------------------------------
Is it possible to include the latest version (1.9.13) of jackson for both
jackson-core-asl and jackson-mapper-asl? Version 1.8.8 is pretty old (january
2012). We're having some issues with methods that are available in 1.9.x and
not in 1.8.x.
I think parquet-hadoop includes the old jar, when you do a
{{mvn dependency:tree -Dincludes=org.codehaus.jackson}}
on the assembly project it shows this tree (we are compiling with Hadoop 2.5.1,
Yarn and the Hadoop 2.4 profile) :
{noformat}
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ spark-assembly_2.10
---
[INFO] org.apache.spark:spark-assembly_2.10:pom:1.1.0
[INFO] \- org.apache.spark:spark-sql_2.10:jar:1.1.0:compile
[INFO] \- com.twitter:parquet-hadoop:jar:1.4.3:compile
[INFO] +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
[INFO] \- org.codehaus.jackson:jackson-core-asl:jar:1.9.11:compile
{noformat}
> Different versions between jackson-mapper-asl and jackson-core-asl
> ------------------------------------------------------------------
>
> Key: SPARK-3955
> URL: https://issues.apache.org/jira/browse/SPARK-3955
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, SQL
> Affects Versions: 1.1.0
> Reporter: Jongyoul Lee
>
> In the parent pom.xml, specified a version of jackson-mapper-asl. This is
> used by sql/hive/pom.xml. When mvn assembly runs, however, jackson-mapper-asl
> is not same as jackson-core-asl. This is because other libraries use several
> versions of jackson, so other version of jackson-core-asl is assembled.
> Simply, fix this problem if pom.xml has a specific version information of
> jackson-core-asl. If it's not set, a version 1.9.11 is merged info
> assembly.jar and we cannot use jackson library properly.
> {code}
> [INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the
> shaded jar.
> [INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the
> shaded jar.
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
