Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18685#discussion_r139045469
--- Diff: python/pyspark/cloudpickle.py ---
@@ -667,6 +667,13 @@ def save_file(self, obj):
else:
dispatch[file] = save_file
+ # WeakSet was added in 2.7.
--- End diff --
BTW, I'd add a simple e2e test.--- --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
