Hello, I am trying to run unit tests on pyspark. When I try to run unit test I am faced with errors. krishna@Krishna:~/Experiment/spark$ ./python/run-tests Running PySpark tests. Output is in /Users/krishna/Experiment/ spark/python/unit-tests.log Will test against the following Python executables: ['python2.6'] Will test the following Python modules: ['pyspark-core', 'pyspark-ml', 'pyspark-mllib', 'pyspark-sql', 'pyspark-streaming'] Please install unittest2 to test with Python 2.6 or earlier Had test failures in pyspark.sql.tests with python2.6; see logs.
and when I try to Install unittest2, It says requirement already satisfied. krishna@Krishna:~/Experiment/spark$ sudo pip install --upgrade unittest2 Password: Requirement already up-to-date: unittest2 in /usr/local/lib/python2.7/site- packages Requirement already up-to-date: argparse in /usr/local/lib/python2.7/site-packages (from unittest2) Requirement already up-to-date: six>=1.4 in /usr/local/lib/python2.7/site-packages (from unittest2) Requirement already up-to-date: traceback2 in /usr/local/lib/python2.7/site-packages (from unittest2) Requirement already up-to-date: linecache2 in /usr/local/lib/python2.7/site-packages (from traceback2->unittest2) Help! Thanks, Krishna
