This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new 1db5ebe71562 [SPARK-55128][INFRA] Restore SQL tests by pin
'pandas==2.3.3'
1db5ebe71562 is described below
commit 1db5ebe715629b4b622a61512d565f12aca3c8ab
Author: Ruifeng Zheng <[email protected]>
AuthorDate: Thu Jan 22 15:21:22 2026 +0800
[SPARK-55128][INFRA] Restore SQL tests by pin 'pandas==2.3.3'
### What changes were proposed in this pull request?
Restore Restore SQL tests by pin 'pandas<3'
### Why are the changes needed?
pandas 3 is just released, and fail sql tests
https://github.com/apache/spark/actions/runs/21232213791/job/61092886134
currently pandas 3 doesn't affect python tests too much:
1, in `dev/requirements.txt`, the latest `mlflow==3.8.1` requires:
`pandas<3`
2, `pandas==2.3.3` is pinned in most places
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
ci
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #53910 from zhengruifeng/restore_sql.
Authored-by: Ruifeng Zheng <[email protected]>
Signed-off-by: Ruifeng Zheng <[email protected]>
(cherry picked from commit dafb2cd2447d35e7a41f9567651c012303fd4241)
Signed-off-by: Ruifeng Zheng <[email protected]>
---
.github/workflows/build_and_test.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index f0d2acbacff7..5735dc6ad208 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -361,7 +361,7 @@ jobs:
- name: Install Python packages (Python 3.11)
if: (contains(matrix.modules, 'sql') && !contains(matrix.modules,
'sql-')) || contains(matrix.modules, 'connect') || contains(matrix.modules,
'yarn')
run: |
- python3.11 -m pip install 'numpy>=1.22' pyarrow pandas pyyaml scipy
unittest-xml-reporting 'lxml==4.9.4' 'grpcio==1.76.0' 'grpcio-status==1.76.0'
'protobuf==6.33.0' 'zstandard==0.25.0'
+ python3.11 -m pip install 'numpy>=1.22' pyarrow 'pandas==2.3.3' pyyaml
scipy unittest-xml-reporting 'lxml==4.9.4' 'grpcio==1.76.0'
'grpcio-status==1.76.0' 'protobuf==6.33.0' 'zstandard==0.25.0'
python3.11 -m pip list
# Run the tests.
- name: Run tests
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
