Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/23055#discussion_r237716012
--- Diff: python/pyspark/worker.py ---
@@ -22,7 +22,12 @@
import os
import sys
import time
-import resource
+# 'resource' is a Unix specific module.
+has_resource_module = True
+try:
+ import resource
+except ImportError:
+ has_resource_module = False
--- End diff --
Yea, so the check and be done in Python side and JVM side. Yes, I am
explicitly disabling it on Windows. I think the proper assumption is that we
note it doesn't work if that's not tested. If someone finds it working, then
that patch explicitly enables it with a proper documentation.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
