[
https://issues.apache.org/jira/browse/SPARK-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-987.
-----------------------------
Resolution: Not a Problem
This just looks like a classic version mismatch between client and server. The
app perhaps has embedded Hadoop libs instead of using 'provided' libs from the
server installation.
> Cannot start workers successfully with hadoop 2.2.0
> ---------------------------------------------------
>
> Key: SPARK-987
> URL: https://issues.apache.org/jira/browse/SPARK-987
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 0.8.0
> Reporter: 刘旭
> Priority: Minor
> Labels: 2.2.0, hadoop
>
> Cannot start workers successfully with hadoop 2.2.0.
> I build with:
> $make-distribution.sh -hadoop 2.2.0
> P.S.
> Can work well with hadoop 2.0.5-alpha.
> But cannot connect the hadoop 2.2.0 successfully with this exception :
> scala> var lines =
> sc.textFile("hdfs://localhost:9000/user/hadoop/hadoop/hadoop-hadoop-jobtracker-master.log")
> lines: org.apache.spark.rdd.RDD[String] = MappedRDD[3] at textFile at
> <console>:12
> scala> lines.count
> java.io.IOException: Failed on local exception:
> com.google.protobuf.InvalidProtocolBufferException: Message missing required
> fields: callId, status; Host Details : local host is: "master/192.168.3.103";
> destination host is: "localhost":9000;
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
