GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/21141
[SPARK-23853][PYSPARK][TEST] Run Hive-related PySpark tests only for
`-Phive`
## What changes were proposed in this pull request?
When `PyArrow` or `Pandas` are not available, the corresponding PySpark
tests are skipped automatically. Currently, PySpark tests fail when we are not
using `-Phive`. This PR aims to skip Hive related PySpark tests when `-Phive`
is not given.
## How was this patch tested?
This is a test-only change. First, this should pass the Jenkins. Then,
manually do the following.
```bash
build/mvn -DskipTests clean package
python/run-tests.py --python-executables python2.7 --modules pyspark-sql
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dongjoon-hyun/spark SPARK-23853
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21141.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21141
----
commit dc81cf98d6a14591db244fa41e24e4752ee98521
Author: Dongjoon Hyun <dongjoon@...>
Date: 2018-04-24T07:32:22Z
[SPARK-23853][PYSPARK][TEST] Run Hive-related PySpark tests only for
`-Phive`
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
