Github user kxepal commented on a diff in the pull request:
https://github.com/apache/spark/pull/17671#discussion_r154890793
--- Diff: python/pyspark/worker.py ---
@@ -39,6 +39,12 @@
pickleSer = PickleSerializer()
utf8_deserializer = UTF8Deserializer()
+try:
--- End diff --
Sorry, I'm not familiar with pyspark packaging rules, so would very
appreciate for any help here.
My motivation to add it as extra was the same as the others are there: if,
for instance, pandas is available, you can use pandas-related features of
pyspark, but missing pandas should break pyspark. That's why pandas is defined
in extras, not install requirements, right? Same is for raven.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
