[
https://issues.apache.org/jira/browse/HADOOP-12527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384447#comment-15384447
]
Ben McCann commented on HADOOP-12527:
-------------------------------------
That seems like a reasonable path forward to me
> Upgrade Avro dependency to 1.7.7 or later
> -----------------------------------------
>
> Key: HADOOP-12527
> URL: https://issues.apache.org/jira/browse/HADOOP-12527
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Affects Versions: 2.7.1
> Reporter: Jonathan Kelly
>
> Hadoop has depended upon Avro 1.7.4 for a couple of years now (see
> HADOOP-9672), but Apache Spark depends upon what is currently the latest
> version of Avro (1.7.7).
> This can cause issues if Spark is configured to include the full Hadoop
> classpath, as the classpath would then contain both Avro 1.7.4 and 1.7.7,
> with the 1.7.4 classes possibly winning depending on ordering. Here is an
> example of this issue:
> http://stackoverflow.com/questions/33159254/avro-error-on-aws-emr/33403111#33403111
> Would it be possible to upgrade Hadoop's Avro dependency to 1.7.7 now?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
