[
https://issues.apache.org/jira/browse/SPARK-61327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-61327:
----------------------------------
Affects Version/s: 4.4.0
> Install PyArrow in the Python 3.15 CI image
> -------------------------------------------
>
> Key: SPARK-61327
> URL: https://issues.apache.org/jira/browse/SPARK-61327
> Project: Spark
> Issue Type: Improvement
> Components: Project Infra, PySpark
> Affects Versions: 5.0.0, 4.4.0
> Reporter: Ruifeng Zheng
> Assignee: Ruifeng Zheng
> Priority: Major
> Labels: pull-request-available
>
> PyArrow 26.x now publishes CPython 3.15 Linux wheels, so Spark can install
> PyArrow in its Python 3.15 CI image.
> Add PyArrow to the image to enable Arrow-dependent test coverage and resolve
> Python 3.15 CI failures caused by the missing PyArrow dependency. Pandas
> remains excluded because the standard CI dependency groups require pandas 2.x.
> The draft PR temporarily selects python-315 and python3.15 in
> build_and_test.yml to validate the image. Restore the standard workflow
> defaults before the PR is ready for review.
> PR: https://github.com/apache/spark/pull/60237
> Validation: the Python 3.15 image build passed in
> https://github.com/zhengruifeng/spark/actions/runs/42609398311/job/129139730018
> . This verifies the image build; it does not establish that every Spark test
> passes.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]