Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/7031#issuecomment-115561796
Interesting, it looks like the test failures are not a direct consequence
of the parallelization since they still occur even if I only use one thread:
```python
======================================================================
ERROR: test_termination_sigterm (__main__.DaemonTests)
Ensure that daemon and workers terminate on SIGTERM.
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/pyspark/tests.py",
line 1451, in test_termination_sigterm
self.do_termination_test(lambda daemon: os.kill(daemon.pid, SIGTERM))
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/pyspark/tests.py",
line 1424, in do_termination_test
daemon = Popen([sys.executable, daemon_path], stdin=PIPE, stdout=PIPE)
File "/usr/lib64/python2.6/subprocess.py", line 642, in __init__
errread, errwrite)
File "/usr/lib64/python2.6/subprocess.py", line 1234, in _execute_child
raise child_exception
OSError: [Errno 13] Permission denied
======================================================================
ERROR: test_termination_stdin (__main__.DaemonTests)
Ensure that daemon and workers terminate when stdin is closed.
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/pyspark/tests.py",
line 1446, in test_termination_stdin
self.do_termination_test(lambda daemon: daemon.stdin.close())
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/pyspark/tests.py",
line 1424, in do_termination_test
daemon = Popen([sys.executable, daemon_path], stdin=PIPE, stdout=PIPE)
File "/usr/lib64/python2.6/subprocess.py", line 642, in __init__
errread, errwrite)
File "/usr/lib64/python2.6/subprocess.py", line 1234, in _execute_child
raise child_exception
OSError: [Errno 13] Permission denied
----------------------------------------------------------------------
Ran 97 tests in 102.677s
FAILED (errors=2)
Random listing order was used
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
