Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/17671#discussion_r154887719
--- Diff: python/pyspark/worker.py ---
@@ -39,6 +39,12 @@
pickleSer = PickleSerializer()
utf8_deserializer = UTF8Deserializer()
+try:
--- End diff --
So this is more you're treating the package install as it being enabled.
Generally in Spark we allow folks to configure new features separate from if
the package is installed or not. But don't bother making changes until we hear
what the other folks have to say anyways since I'm a little hesitant about this
change.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
