[
https://issues.apache.org/jira/browse/SPARK-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Favio Vázquez closed SPARK-7238.
--------------------------------
Resolution: Won't Fix
> Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0
> -----------------------------------------------------------------------
>
> Key: SPARK-7238
> URL: https://issues.apache.org/jira/browse/SPARK-7238
> Project: Spark
> Issue Type: Dependency upgrade
> Components: Build
> Affects Versions: 1.3.1
> Environment: Ubuntu 14.04. Apache Mesos in cluster mode with HDFS
> from cloudera 2.5.0-cdh5.3.3.
> Reporter: Favio Vázquez
> Priority: Blocker
> Labels: 2.5.0-cdh5.3.3, CDH5, HDFS, Mesos
> Fix For: 1.3.1, 1.3.0
>
>
> This upgrade is needed when building spark for CDH5 2.5.0-cdh5.3.3 due to
> incompatibilities in the protobuf version used by com.google.protobuf and the
> one used in hadoop. The default version of protobuf is set to 2.4.1 in the
> global properties, and this is stated in the pom.xml file:
> <!-- In theory we need not directly depend on protobuf since Spark does not
> directly use it. However, when building with Hadoop/YARN 2.2 Maven doesn't
> correctly bump the protobuf version up from the one Mesos gives. For now we
> include this variable to explicitly bump the version when building with YARN.
> It would be nice to figure out why Maven can't resolve this correctly (like
> SBT does). -->
> So this upgrade will only be affecting the com.google.protobuf version of
> java-protobuf. Tested for the Cloudera distribution 2.5.0-cdh5.3.3 using
> Mesos 0.22.0 in cluster mode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
