This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 7503c4a [SPARK-33565][INFRA][FOLLOW-UP][3.0] Keep the test coverage
with Python 3.8 in GitHub Actions
7503c4a is described below
commit 7503c4a3ab1854d62c49d02221c26fb220546ede
Author: HyukjinKwon <[email protected]>
AuthorDate: Thu Nov 26 12:31:02 2020 +0900
[SPARK-33565][INFRA][FOLLOW-UP][3.0] Keep the test coverage with Python 3.8
in GitHub Actions
### What changes were proposed in this pull request?
This is a backport PR of https://github.com/apache/spark/pull/30510
This PR proposes to keep the test coverage with Python 3.8 in GitHub
Actions. It is not tested for now in Jenkins due to an env issue.
**Before this change in GitHub Actions:**
```
========================================================================
Running PySpark tests
========================================================================
Running PySpark tests. Output is in /__w/spark/spark/python/unit-tests.log
Will test against the following Python executables: ['/usr/bin/python3',
'python2.7', 'pypy3']
...
```
**After this change in GitHub Actions:**
```
========================================================================
Running PySpark tests
========================================================================
Running PySpark tests. Output is in /__w/spark/spark/python/unit-tests.log
Will test against the following Python executables: ['python3.8',
'python2.7', 'pypy3']
```
### Why are the changes needed?
To keep the test coverage with Python 3.8 in GitHub Actions.
### Does this PR introduce _any_ user-facing change?
No, dev-only.
### How was this patch tested?
GitHub Actions in this build will test.
Closes #30511 from HyukjinKwon/SPARK-33565-3.0.
Authored-by: HyukjinKwon <[email protected]>
Signed-off-by: HyukjinKwon <[email protected]>
---
dev/run-tests.py | 6 ++++++
1 file changed, 6 insertions(+)
diff --git a/dev/run-tests.py b/dev/run-tests.py
index fde1def..d58884f 100755
--- a/dev/run-tests.py
+++ b/dev/run-tests.py
@@ -484,6 +484,12 @@ def run_python_tests(test_modules, parallelism,
with_coverage=False):
if test_modules != [modules.root]:
command.append("--modules=%s" % ','.join(m.name for m in test_modules))
command.append("--parallelism=%i" % parallelism)
+ if "GITHUB_ACTIONS" in os.environ:
+ # See SPARK-33565. Python 3.8 was temporarily removed as its default
Python executables
+ # to test because of Jenkins environment issue. Once Jenkins has
Python 3.8 to test,
+ # we should remove this change back and add python3.8 into
python/run-tests.py script.
+ command.append("--python-executable=%s" % ','.join(
+ x for x in ["python3.8", "python2.7", "pypy3", "pypy"] if
which(x)))
run_cmd(command)
if with_coverage:
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
