Github user squito commented on the issue: https://github.com/apache/spark/pull/23166 > The only question I have is does this cause more memory usage on the driver because it has a reference to that broadcast value or is something else already holding on to it? yeah good point. I guess that would make you hold onto a reference to the original value, even if it was never used on the driver. the proposal here is more like what is done in TorrentBroadcast.java -- its written to the driver's block manager, and read back if you request the value.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org