Hi All Yesterday,we rewrite the class Serializable's UID as static .Then find that the Executor could resolve the class .But it also thow the Exception imcompitable UID.We also debug the program in remote mode found jvm use bigendian in master and slave.
Once we try ./run-example HDFSWordCount on Spark-0.9.1 it failed,but run on 1.0.0 then it works. We think that Spark-1.0.0 may fix something. But run on standalone mode use kyro or java serilazer it also has the problem . May be Spark cause this problem on Big Endian environment? Thanks a lot! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Big-Endian-IBM-Power7-Spark-Serialization-issue-tp7003p7007.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
