Ruifeng Zheng created SPARK-61327:
-------------------------------------

             Summary: Install PyArrow in the Python 3.15 CI image
                 Key: SPARK-61327
                 URL: https://issues.apache.org/jira/browse/SPARK-61327
             Project: Spark
          Issue Type: Improvement
          Components: PySpark
    Affects Versions: 5.0.0
            Reporter: Ruifeng Zheng


PyArrow 26.x now publishes CPython 3.15 Linux wheels, so Spark can install 
PyArrow in its Python 3.15 CI image.

Add PyArrow to the image to enable Arrow-dependent test coverage and resolve 
Python 3.15 CI failures caused by the missing PyArrow dependency. Pandas 
remains excluded because the standard CI dependency groups require pandas 2.x.

The draft PR temporarily selects python-315 and python3.15 in 
build_and_test.yml to validate the image. Restore the standard workflow 
defaults before the PR is ready for review.

PR: https://github.com/apache/spark/pull/60237
Validation: the Python 3.15 image build passed in 
https://github.com/zhengruifeng/spark/actions/runs/42609398311/job/129139730018 
. This verifies the image build; it does not establish that every Spark test 
passes.




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to