[ https://issues.apache.org/jira/browse/SPARK-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reynold Xin resolved SPARK-2897. -------------------------------- Resolution: Fixed Fix Version/s: 1.0.3 1.1.0 > org.apache.spark.broadcast.TorrentBroadcast does use the serializer class > specified in the spark option "spark.serializer" > -------------------------------------------------------------------------------------------------------------------------- > > Key: SPARK-2897 > URL: https://issues.apache.org/jira/browse/SPARK-2897 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.1.0, 1.0.2 > Reporter: Joseph Su > Assignee: Guoqiang Li > Priority: Blocker > Fix For: 1.1.0, 1.0.3 > > > HTTPBroadcast will changes the serializer according to the setting in > "spark.serializer". > However, TorrentBroadcast does not read that option. It always uses Java > built-in serializer. ( Specifically, it uses > org.apache.spark.util.Utils.serialize() and > org.apache.spark.util.Utils.deserialize() ). > With TorrentBroadcast, Spark programs can not broadcast objects that can be > serialized with custom Kryo serializer but not with Java built-in serializer. -- This message was sent by Atlassian JIRA (v6.2#6252) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org