Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/23166#discussion_r237248890
--- Diff: python/pyspark/broadcast.py ---
@@ -134,7 +137,15 @@ def value(self):
""" Return the broadcasted value
"""
if not hasattr(self, "_value") and self._path is not None:
- self._value = self.load_from_path(self._path)
+ # we only need to decrypt it here when encryption is enabled
and
--- End diff --
I think you can get in here when encryption off on executors and self._sc
would be not definied
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
