GitHub user davies opened a pull request:
https://github.com/apache/spark/pull/3968
[PySpark] Fix tests with Python 2.6 in 0.9 branch
[PySpark] [SPARK-2954] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6
Fixes
- Modify python/run-tests to test with Python 2.6
- Use unittest2 when running on Python 2.6.
Author: Josh Rosen <[email protected]>
Closes #3668 from davies/port_2365 and squashes the following commits:
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/davies/spark fix_python_tests
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3968.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3968
----
commit ac4a353e1d514379f24298644c7c141536ec415e
Author: cocoatomo <[email protected]>
Date: 2014-12-13T03:10:12Z
[PySpark] Fix tests with Python 2.6 in 1.0 branch
[SPARK-2951] [PySpark] support unpickle array.array for Python 2.6
Pyrolite can not unpickle array.array which pickled by Python 2.6, this
patch fix it by extend Pyrolite.
There is a bug in Pyrolite when unpickle array of float/double, this patch
workaround it by reverse the endianness for float/double. This workaround
should be removed after Pyrolite have a new release to fix this issue.
[PySpark] [SPARK-2954] [SPARK-2948] [SPARK-2910] [SPARK-2101] Python 2.6
Fixes
- Modify python/run-tests to test with Python 2.6
- Use unittest2 when running on Python 2.6.
- Fix issue with namedtuple.
- Skip TestOutputFormat.test_newhadoop on Python 2.6 until SPARK-2951
is fixed.
- Fix MLlib _deserialize_double on Python 2.6.
[SPARK-3867][PySpark] ./python/run-tests failed when it run with Python 2.6
and unittest2 is not installed
./python/run-tests search a Python 2.6 executable on PATH and use it if
available.
When using Python 2.6, it is going to import unittest2 module which is
not a standard library in Python 2.6, so it fails with Import
Author: cocoatomo <[email protected]>
Author: Josh Rosen <[email protected]>
Author: Davies Liu <[email protected]>
Author: Davies Liu <[email protected]>
Closes #3668 from davies/port_2365 and squashes the following commits:
b32583d [Davies Liu] rollback _common.py
bda1c72 [cocoatomo] [SPARK-3867][PySpark] ./python/run-tests failed when it
run with Python 2.6 and unittest2 is not installed
14ad3d9 [Josh Rosen] [PySpark] [SPARK-2954] [SPARK-2948] [SPARK-2910]
[SPARK-2101] Python 2.6 Fixes
7c55cff [Davies Liu] [SPARK-2951] [PySpark] support unpickle array.array
for Python 2.6
Conflicts:
python/pyspark/mllib/tests.py
python/pyspark/tests.py
python/run-tests
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
