Hi Mosharaf, Thanks a lot for the detailed reply. The reason I am using Torrent is mainly because I would like to have something different to be a comparison with the IP multicast/broadcast. I will need to transmit larger data size as well.
I tried to increase spark.executor.memory to 2g and spark.akka.frameSize to 1000 but it seems the same problem remains. Is there any other possibility that you can think of? Thanks, Jack -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-BroadcastTest-scala-with-TorrentBroadcastFactory-in-a-standalone-cluster-tp8736p8955.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
