Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14333
How about the same for `bcNewCenters` in `KMeans`?
Yeah, it seems like it's pretty rare to want to call `unpersist` here. The
only context where it seems valid are the two left in `Word2Vec` like
`bcSyn0Global` where the driver's state needs to be rebroadcast on each loop.
But even then you could make a new broadcast for the same variable and destroy
it in the loop.
I suppose it saves the overhead of new bookkeeping for a `Broadcast`. But
unless I miss something it's not really worth the separate API. I wouldn't go
so far as deprecating `unpersist` but doesn't look like something that would be
added today if it weren't there.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
