Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/8323#issuecomment-148840605
@gliptak I had an offline discussion with @davies . Let's do the following:
1. Change L259 in `pyspark/tests.py` to:
~~~python
# Regression test for SPARK-3415
def test_pickling_file_handles(self):
if not xmlrunner:
ser = CloudPickleSerializer()
out1 = sys.stderr
out2 = ser.loads(ser.dumps(out1))
self.assertEqual(out1, out2)
~~~
Create a JIRA for this so we remember to fix it. The issue is
`CloudPickeSerializer` wraps `stderr`, which conflicts with `xmlrunner`. But it
might take some time to fix.
2. Change the PR title to `Python unit tests" since we do not report
doctests.
Then we can run Jenkins again and see whether it works.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
