Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23055#discussion_r237716326
--- Diff: python/pyspark/worker.py ---
@@ -22,7 +22,12 @@
import os
import sys
import time
-import resource
+# 'resource' is a Unix specific module.
+has_resource_module = True
+try:
+ import resource
+except ImportError:
+ has_resource_module = False
--- End diff --
I really don't understand what you said above. If the check is done on the
Python side, what is the exact reason why you need it on the JVM side?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
