srowen commented on a change in pull request #23685:
[SPARK-26771][CORE][GRAPHX] Make .unpersist(), .destroy() consistently
non-blocking by default
URL: https://github.com/apache/spark/pull/23685#discussion_r252432599
##########
File path: python/pyspark/broadcast.py
##########
@@ -163,8 +163,7 @@ def destroy(self):
"""
Destroy all data and metadata related to this broadcast variable.
Use this with caution; once a broadcast variable has been destroyed,
- it cannot be used again. This method blocks until destroy has
- completed.
+ it cannot be used again.
Review comment:
Good question. There wasn't an option to control it before, but of course
that means there's no way to control it after the behavior changes. I'll add it
for consistency, like with the Pyspark RDD class.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
