Github user squito commented on the issue:
https://github.com/apache/spark/pull/23166
> The only question I have is does this cause more memory usage on the
driver because it has a reference to that broadcast value or is something else
already holding on to it?
yeah good point. I guess that would make you hold onto a reference to the
original value, even if it was never used on the driver. the proposal here is
more like what is done in TorrentBroadcast.java -- its written to the driver's
block manager, and read back if you request the value.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
