This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 839f0c98bd8 [SPARK-46002][INFRA] Upgrade to Python 3.9 in SQL test
839f0c98bd8 is described below
commit 839f0c98bd85a14eadad13f8aaac876275ded5a4
Author: Ruifeng Zheng <ruife...@apache.org>
AuthorDate: Mon Nov 20 09:50:51 2023 -0800
[SPARK-46002][INFRA] Upgrade to Python 3.9 in SQL test
### What changes were proposed in this pull request?
Upgrade to Python 3.9 in SQL test
### Why are the changes needed?
this version has not been upgraded in more than 3 years
### Does this PR introduce _any_ user-facing change?
no, test-only
### How was this patch tested?
ci
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #43902 from zhengruifeng/infra_sql_py310.
Authored-by: Ruifeng Zheng <ruife...@apache.org>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
.github/workflows/build_and_test.yml | 12 ++++++------
1 file changed, 6 insertions(+), 6 deletions(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index b56314133cb..731aa343b94 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -244,20 +244,20 @@ jobs:
with:
distribution: zulu
java-version: ${{ matrix.java }}
- - name: Install Python 3.8
+ - name: Install Python 3.9
uses: actions/setup-python@v4
- # We should install one Python that is higher then 3+ for SQL and Yarn
because:
+ # We should install one Python that is higher than 3+ for SQL and Yarn
because:
# - SQL component also has Python related tests, for example,
IntegratedUDFTestUtils.
# - Yarn has a Python specific test too, for example, YarnClusterSuite.
if: contains(matrix.modules, 'yarn') || (contains(matrix.modules, 'sql')
&& !contains(matrix.modules, 'sql-')) || contains(matrix.modules, 'connect')
with:
- python-version: 3.8
+ python-version: '3.9'
architecture: x64
- - name: Install Python packages (Python 3.8)
+ - name: Install Python packages (Python 3.9)
if: (contains(matrix.modules, 'sql') && !contains(matrix.modules,
'sql-')) || contains(matrix.modules, 'connect')
run: |
- python3.8 -m pip install 'numpy>=1.20.0' pyarrow pandas scipy
unittest-xml-reporting 'grpcio>=1.48,<1.57' 'grpcio-status>=1.48,<1.57'
'protobuf==4.25.1'
- python3.8 -m pip list
+ python3.9 -m pip install 'numpy>=1.20.0' pyarrow pandas scipy
unittest-xml-reporting 'grpcio>=1.48,<1.57' 'grpcio-status>=1.48,<1.57'
'protobuf==4.25.1'
+ python3.9 -m pip list
# Run the tests.
- name: Run tests
env: ${{ fromJSON(inputs.envs) }}
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
